-
1. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
jesper.pedersen Mar 31, 2014 8:19 AM (in response to karna1824)Try with a nightly build of WildFly, and provide TRACE log from org.jboss.jca
-
2. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
karna1824 Apr 1, 2014 1:08 AM (in response to jesper.pedersen)Thank you for your response Jesper. i'll try and get back to you with result.
but can you please tell me what is that idleRemover thread and why it is causing the problem?
if you have any idea about it,please share it...
thank you.
-
3. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
peter.falken Apr 6, 2014 2:01 AM (in response to karna1824)Wildfly pegs one core to 99% usage. Test environment is Ubuntu 12.0.3 64 & 32 bits with JDK 1.7.0_u51
Good evening - I'm testing the Wildfly 8.0.1 Snapshots and the issue is still present.
-
4. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
jesper.pedersen Apr 7, 2014 1:20 PM (in response to peter.falken)A "Me too" doesn't provide me with any information.
Please, take the latest WildFly 8.0.1 nightly build, and apply the latest IronJacamar 1.1.5-SNAPSHOT (http://www.ironjacamar.org/doc/userguide/1.1/en-US/html/ch03.html#installas).
Submit your configuration, steps to reproduce, and TRACE log of org.jboss.jca and org.jboss.as.connector.
You can use https://bitbucket.org/pjtr/topthreads/overview to get easy access to a thread dump.
-
5. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
karna1824 Apr 9, 2014 7:52 AM (in response to jesper.pedersen)hi, Jesper.. i downloaded wildfly-8.0.1.Final-SNAPSHOT. i added my datasources to the standalone.xml by removing default ones
i have a java web application,when i try to deploy my application it is searching for exampleDS (which came default in standalone.xml)
ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) JBAS014613: Operation ("deploy") failed - address: ([("deployment" => "YBA.war")]) - failure description: {"JBAS014771: Services with missing/unavailable dependencies" => ["jboss.naming.context.java.module.YBA.YBA.DefaultDataSource is missing [jboss.naming.context.java.jboss.datasources.ExampleDS]"]}
then i added back that datasource configuration then my application is working. so, why it is searching for ExampleDS?
-
6. Re: Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
karna1824 Apr 11, 2014 3:19 AM (in response to jesper.pedersen)i solved that ExampleDS problem. In EE subsystem, you can find default bindings, in that remove r change datasource to your datasource name, problem will be solved.
i deployed my application in wildfly-8.0.1.Final-SNAPSHOT. after 5 minutes CPU usage of my machine is going 100%. here also same "idleRemover" thread is the culprit.But the interesting thing is, in WINDOWS, i didn't face any problem. But when i try in Linux (CentOS 6.5) operating system, CPU usage is hitting 100%.
My datasource configuration is,
<subsystem xmlns="urn:jboss:domain:datasources:2.0">
<datasources>
<datasource jta="false" jndi-name="java:jboss/datasources/yba" pool-name="yba" enabled="true" use-java-context="true" use-ccm="false">
<connection-url>jdbc:mysql://localhost:3306/yba</connection-url>
<driver>m2mmysql</driver>
<transaction-isolation>TRANSACTION_READ_COMMITTED</transaction-isolation>
<pool>
<min-pool-size>5</min-pool-size>
<max-pool-size>20</max-pool-size>
<prefill>true</prefill>
<use-strict-min>true</use-strict-min>
<flush-strategy>IdleConnections</flush-strategy>
</pool>
<security>
<user-name>root</user-name>
<password>root</password>
</security>
<timeout>
<idle-timeout-minutes>5</idle-timeout-minutes>
</timeout>
</datasource>
<datasource jta="false" jndi-name="java:jboss/datasources/m2m" pool-name="m2m" enabled="true" use-java-context="true" use-ccm="false">
<connection-url>jdbc:mysql:localhost:3306/m2m</connection-url>
<driver>mymysql</driver>
<transaction-isolation>TRANSACTION_READ_COMMITTED</transaction-isolation>
<pool>
<min-pool-size>5</min-pool-size>
<max-pool-size>20</max-pool-size>
<prefill>true</prefill>
<use-strict-min>true</use-strict-min>
<flush-strategy>IdleConnections</flush-strategy>
</pool>
<security>
<user-name>root</user-name>
<password>root</password>
</security>
<timeout>
<idle-timeout-minutes>5</idle-timeout-minutes>
</timeout>
</datasource>
<drivers>
<driver name="h2" module="com.h2database.h2">
<xa-datasource-class>org.h2.jdbcx.JdbcDataSource</xa-datasource-class>
</driver>
<driver name="mymysql" module="my.mysql">
<xa-datasource-class>com.mysql.jdbc.jdbc2.optional.MysqlXADataSource</xa-datasource-class>
</driver>
</drivers>
</datasources>
</subsystem>
Then, i removed below tag in both datasource configurations.
<timeout>
<idle-timeout-minutes>5</idle-timeout-minutes>
</timeout>
this time CPU didn't go 100% usage, even if i acces my application left and right. Just to confirm, i again put this tag and changed idle-timeout-minutes to 2, then obviously after 2 mins CPU usage hit 100% and stayed there only.
so, Can you please tell me,
1)Why is that tag causing the problem?
2)why specifically in Linux operating system?
seems to be problem is in idle connections removal logic...
Attached org.jboss.jca log (which has taken when CPU usage @ 100%...
-
jca.log.zip 2.3 KB
-
-
7. Re: Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
ctomc Apr 11, 2014 5:38 AM (in response to karna1824)Can you try with newer nightly build, one that has IronJacamar 1.1.5 in it which was merged few days back
in your log you can see that your build is still using 1.1.4
23:28:57,183 INFO [org.jboss.as.connector.logging] (MSC service thread 1-1) JBAS010408: Starting JCA Subsystem (IronJacamar 1.1.4.Final)
-
8. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
pkolaric Apr 12, 2014 6:17 PM (in response to ctomc) -
9. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
ctomc Apr 12, 2014 6:48 PM (in response to pkolaric)Guys, do you all use mysql when you see this issue?
Also can you verify that you are using latest JDBC driver & have proper mysql datasource configuration, example can be found here https://access.redhat.com/site/documentation/en-US/JBoss_Enterprise_Application_Platform/6/html/Administration_and_Configuration_Guide/Example_MySQL_XA_Datasource1.html
--
tomaz
-
10. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
pkolaric Apr 12, 2014 7:32 PM (in response to ctomc)I use postgresql. (with pgjdbc-ng JDBC driver)
-
11. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
ajcmartins Apr 14, 2014 6:15 AM (in response to karna1824)Hello, i'am experiencing the exact same issue with Postgres and its postgresql-9.2-1000.jdbc4 driver.
Cheers,
-
13. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
jesper.pedersen Apr 14, 2014 9:23 AM (in response to karna1824)Run with <use-strict-min>false</use-strict-min> -- which is the default
-
14. Re: Wildfly8-Idle Remover Thread taking 100% CPU Usage
peter.falken Apr 14, 2014 11:12 AM (in response to jesper.pedersen)Jesper,
I can confirm that this work-around brings the CPU/Core usage back to normal levels on WildFly 8.1.0.CR1
What is the root cause of the issue?
Regards