1 2 3 … Previous Next 81 Replies Latest reply on Aug 3, 2014 4:18 AM by wulf.rowek

Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

daniel.wehrle Jun 3, 2013 6:28 AM

Hi,

we have some performance problems after running JBoss 7.x for 24 hours. RAM and CPU usage is ok. Trace messages shows that all method calls becomes slower. Any ideas?

(discussion started in https://community.jboss.org/message/818593)

4. 16.05.2013 11:38 (als Antwort auf: Wolf-Dieter Fink)

Re: Is there any docs about jboss eap performance tuning?

Hi Wolf-Dieter,

we have with our application the problem that it gets slower in 24 hosts. Heap and CPU usage is good. After restart of jboss all is fine. Which parameters we have to look at to find where the problem is? We have 10 CUs on the system and not heavy traffic. Over night there are no users on the system.

5. 17.05.2013 04:56 (als Antwort auf: Daniel Wehrle)

Re: Is there any docs about jboss eap performance tuning?

Daniel Wehrle schrieb:

we have with our application the problem that it gets slower in 24 hosts.
Do you meant that the application get slower after 24 hours?
What is slower as I understand that there is no issue with heap memory and CPU load?

6. 17.05.2013 05:17 (als Antwort auf: Wolf-Dieter Fink)

Re: Is there any docs about jboss eap performance tuning?

Yes. 24 hours. Sorry.

No issue with heap and cpu. We have i.e. implemented some background processes with JPA transaction timeout 5 min. If the system is fine, this background process runs in a few seconds. If the system becomes slow it can happen that the transaction timeout is reached. Also in the gui a search with a paged result list becomes slower. We cannot reproduce this on our test systems with heavy load.

We use the standard standalone-full.xml without any modification in thread pool or max-connections. We have a DB connection pool with max. 100 connections (never reached).

We use:

JBoss AS 7.1.1 (also testet with Jboss EAP 6.1.0 alpha)
OS: Windows Server 2008 R2
DB: MS-SQL 2008
JDK 7 (Update 21)
EJB, Stateless SessionBeans
JPA, Entities, Hibernate
Hibernate Search (4.2) and Lucene (3.6)
JMS (hornetQ) and MDBs for asynchroneous background processes
User-Transactions for batch processes
Wicket (6.5) for GUI

1. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

nickarls Jun 3, 2013 6:32 AM (in response to daniel.wehrle)

Are these virtual- or physical servers? Do other applications in the same server also suffer from degraded performance when this occurs?
Actions
2. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

daniel.wehrle Jun 3, 2013 6:36 AM (in response to nickarls)

This are virtual (vmware) servers in different hosting environments. Other applications do not suffer from degraded performance.
Actions
3. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

wdfink Jun 3, 2013 3:18 PM (in response to daniel.wehrle)

Could you identify in the log that a special action is slow?
Do you mean that other applications are running in the same VM with a 'normal' performance=
Actions
4. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

nickarls Jun 3, 2013 3:49 PM (in response to wdfink)

I recall seeing one similar issue on the forums before that sounded like this(?)
Actions
5. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

daniel.wehrle Jun 3, 2013 4:06 PM (in response to wdfink)

@Wolf-Dieter: No special action is slow. Every action is slow.
In the JBoss there is deployed only one ear (=application). But the VM is fast.
Actions
6. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

nickarls Jun 4, 2013 1:35 AM (in response to daniel.wehrle)

How do you determine that? From the web console or from JVM metrics?
Actions
7. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

jaikiran Jun 4, 2013 1:44 AM (in response to daniel.wehrle)

Previous threads discussing similar problems:

https://community.jboss.org/thread/210695
https://community.jboss.org/thread/213546
Actions
8. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

nickarls Jun 4, 2013 1:57 AM (in response to jaikiran)

With the disturbing difference that JSF doesn't appear involved and reproducability on EAP 6.1.x ;-)
Actions
9. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

daniel.wehrle Jun 4, 2013 2:28 AM (in response to nickarls)

@Nicklas: That the virtual server is fast? Or the JVM?
Actions
10. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

nickarls Jun 4, 2013 2:42 AM (in response to daniel.wehrle)

The JVM. You might want to write a small "timer-app", that does a simple loop, timing it, and deploy it to the same AS. Then you compare how this app behaves at server start and how things look when the main app goes sluggish.
Actions
11. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

daniel.wehrle Jun 4, 2013 7:40 AM (in response to nickarls)

@Nicklas: some kind of sleep(1000) and trace if 1000ms are really 1000ms?
Actions
12. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

wdfink Jun 4, 2013 11:07 AM (in response to daniel.wehrle)

Not sure whether this is enough. Maybe a count loop will show better whether the CPU has enough capacity.
Actions
13. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

daniel.wehrle Jun 6, 2013 4:25 AM (in response to wdfink)

Ok. We will use the test case from https://community.jboss.org/thread/213546
Actions
14. Re: Slow performance with JBoss 7.x/EAP 6.1 after 24 hours

daniel.wehrle Jun 26, 2013 10:08 AM (in response to daniel.wehrle)

We have testet it with the test case: created a servlet, make a 3-time-loop.

After JBoss restart:

15ms took to generate array
19500ms took to bubblesort array [1]

16ms took to generate array
19516ms took to bubblesort array [2]

15ms took to generate array
19625ms took to bubblesort array [3]

After 8 hours:

265ms took to generate array
1015583ms took to bubblesort array [1]

280ms took to generate array
1154907ms took to bubblesort array [2]

265ms took to generate array
1158713ms took to bubblesort array [3]
Actions

1 2 3 … Previous Next

Go to original post