1 Reply Latest reply on Jun 3, 2013 2:51 PM by tap_mmenne

    slow performance of native call to socketWrite

    tap_mmenne

      Hi,

       

      My deployed application on JBoss 5.1 is having some significant performance problems serializing XML to the socket.  After analyzing the thread dumps, it seems that app hangs on the following call:

       

       

      "http-0.0.0.0-443-8" - Thread t@208

         java.lang.Thread.State: RUNNABLE

      at java.net.SocketOutputStream.socketWrite0(Native Method)

      at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)

      at java.net.SocketOutputStream.write(SocketOutputStream.java:136)

      at com.sun.net.ssl.internal.ssl.OutputRecord.writeBuffer(OutputRecord.java:295)

      at com.sun.net.ssl.internal.ssl.OutputRecord.write(OutputRecord.java:284)

      at com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecordInternal(SSLSocketImpl.java:734)

      at com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:722)

      at com.sun.net.ssl.internal.ssl.AppOutputStream.write(AppOutputStream.java:59)

      - locked <70dbe673> (a com.sun.net.ssl.internal.ssl.AppOutputStream)

      at org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes(InternalOutputBuffer.java:724)

      at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:449)

      at org.apache.tomcat.util.buf.ByteChunk.append(ByteChunk.java:349)

      at org.apache.coyote.http11.InternalOutputBuffer$OutputStreamOutputBuffer.doWrite(InternalOutputBuffer.java:748)

      at org.apache.coyote.http11.filters.ChunkedOutputFilter.doWrite(ChunkedOutputFilter.java:126)

      at org.apache.coyote.http11.InternalOutputBuffer.doWrite(InternalOutputBuffer.java:557)

      at org.apache.coyote.Response.doWrite(Response.java:567)

      at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:394)

      at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:449)

      at org.apache.catalina.connector.OutputBuffer.realWriteChars(OutputBuffer.java:465)

      at org.apache.tomcat.util.buf.CharChunk.flushBuffer(CharChunk.java:440)

      at org.apache.tomcat.util.buf.CharChunk.append(CharChunk.java:371)

      at org.apache.catalina.connector.OutputBuffer.write(OutputBuffer.java:514)

      at org.apache.catalina.connector.CoyoteWriter.write(CoyoteWriter.java:162)

      at org.apache.catalina.connector.CoyoteWriter.write(CoyoteWriter.java:171)

      at .views.TipXmlView.renderMergedOutputModel(TipXmlView.java:97)

      at org.springframework.web.servlet.view.AbstractView.render(AbstractView.java:250)

      at org.springframework.web.servlet.DispatcherServlet.render(DispatcherServlet.java:1063)

      at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:801)

      at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719)

      at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:644)

      at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:560)

      at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)

      at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:638)

      at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:444)

      at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:382)

      at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:310)

      at org.tuckey.web.filters.urlrewrite.NormalRewrittenUrl.doRewrite(NormalRewrittenUrl.java:195)

      at org.tuckey.web.filters.urlrewrite.RuleChain.handleRewrite(RuleChain.java:159)

      at org.tuckey.web.filters.urlrewrite.RuleChain.doRules(RuleChain.java:141)

      at org.tuckey.web.filters.urlrewrite.UrlRewriter.processRequest(UrlRewriter.java:90)

      at org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:417)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at .filters.ResponseCacheHeaderFilter.doFilterInternal(ResponseCacheHeaderFilter.java:155)

      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at cnal(TipHttpMethodFilter.java:54)

      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicatJSeionFilterChain.java:206)

      at codoFilter(ClearssionFilter.java:85)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:343)

      at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109)

      at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:97)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:100)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:78)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:35)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:177)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:188)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.preauth.AbstractPreAuthenticatedProcessingFilter.doFilter(AbstractPreAuthenticatedProcessingFilter.java:89)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:79)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:149)

      at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)

      at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)

      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)

      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)

      at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)

      at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)

      at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)

      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)

      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)

      at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)

      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:567)

      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)

      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)

      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829)

      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:598)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <74f6c1e7> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

       

      **************************************

      *************************************

      *************************************

      *************************************

      *************************************

       

       

       

       

       

      The performance problem does NOT seem to be present when the app is deployed to Tomcat.  It is only present when the app is deployed JBOSS.

       

      The time required to perform socketWrite0 is often times the entirety of the call to the server.  Making this call with a small amounts of data (a couple K) will take around 300 ms to complete.  Making this call with larger amounts of data (1.5 MB) will take 25 seconds or more. 

       

       

      This is my first time posting so please let me know if you need additional data.  I've attached the full Thread Dump below and I have also attached the performance profile as well.

       

      Thanks and Cheers,

      Mike

       

       

       

       

       

      **************************

      **************************

      **************************

      ***************************

      **************************

       

       

      2013-05-29 21:33:00

      Full thread dump Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode):

       

       

      "RMI TCP Connection(274)-10.14.200.73" - Thread t@531

         java.lang.Thread.State: RUNNABLE

      at java.net.SocketInputStream.socketRead0(Native Method)

      at java.net.SocketInputStream.read(SocketInputStream.java:129)

      at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)

      at java.io.BufferedInputStream.read(BufferedInputStream.java:237)

      - locked <76ba3ed2> (a java.io.BufferedInputStream)

      at java.io.FilterInputStream.read(FilterInputStream.java:66)

      at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <3d7289e3> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "RMI TCP Connection(273)-10.14.200.73" - Thread t@530

         java.lang.Thread.State: RUNNABLE

      at java.net.SocketInputStream.socketRead0(Native Method)

      at java.net.SocketInputStream.read(SocketInputStream.java:129)

      at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)

      at java.io.BufferedInputStream.read(BufferedInputStream.java:237)

      - locked <47e865b9> (a java.io.BufferedInputStream)

      at java.io.FilterInputStream.read(FilterInputStream.java:66)

      at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <6a6e7990> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "RMI TCP Connection(272)-10.14.200.73" - Thread t@525

         java.lang.Thread.State: RUNNABLE

      at java.net.SocketInputStream.socketRead0(Native Method)

      at java.net.SocketInputStream.read(SocketInputStream.java:129)

      at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)

      at java.io.BufferedInputStream.read(BufferedInputStream.java:237)

      - locked <65eb0177> (a java.io.BufferedInputStream)

      at java.io.FilterInputStream.read(FilterInputStream.java:66)

      at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <27ad5fe7> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "RMI TCP Connection(271)-10.14.200.73" - Thread t@502

         java.lang.Thread.State: RUNNABLE

      at sun.management.ThreadImpl.dumpThreads0(Native Method)

      at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:374)

      at sun.reflect.GeneratedMethodAccessor1585.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at com.sun.jmx.mbeanserver.ConvertingMethod.invokeWithOpenReturn(ConvertingMethod.java:167)

      at com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:96)

      at com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:33)

      at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)

      at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)

      at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)

      at javax.management.StandardMBean.invoke(StandardMBean.java:391)

      at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)

      at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)

      at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1426)

      at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)

      at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264)

      at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1359)

      at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)

      at sun.reflect.GeneratedMethodAccessor1584.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)

      at sun.rmi.transport.Transport$1.run(Transport.java:159)

      at java.security.AccessController.doPrivileged(Native Method)

      at sun.rmi.transport.Transport.serviceCall(Transport.java:155)

      at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <4243b295> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "RMI TCP Connection(245)-10.14.200.73" - Thread t@488

         java.lang.Thread.State: RUNNABLE

      at java.net.SocketInputStream.socketRead0(Native Method)

      at java.net.SocketInputStream.read(SocketInputStream.java:129)

      at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)

      at java.io.BufferedInputStream.read(BufferedInputStream.java:237)

      - locked <59763e49> (a java.io.BufferedInputStream)

      at java.io.FilterInputStream.read(FilterInputStream.java:66)

      at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)

      at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <466eae2f> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "AWT-Windows" - Thread t@450

         java.lang.Thread.State: RUNNABLE

      at sun.awt.windows.WToolkit.eventLoop(Native Method)

      at sun.awt.windows.WToolkit.run(WToolkit.java:295)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "MultiThreadedHttpConnectionManager cleanup" - Thread t@433

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <17c83dda> (a java.lang.ref.ReferenceQueue$Lock)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)

      at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)

       

         Locked ownable synchronizers:

      - None

       

      "Java2D Disposer" - Thread t@391

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <6a58d718> (a java.lang.ref.ReferenceQueue$Lock)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)

      at sun.java2d.Disposer.run(Disposer.java:125)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-26" - Thread t@273

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <1200dd9e> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-25" - Thread t@272

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <76d5b94d> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-24" - Thread t@271

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <4978ab2e> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-23" - Thread t@270

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <112e7eb1> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-22" - Thread t@269

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <37f9f47> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-21" - Thread t@268

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <5b5c6975> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-20" - Thread t@267

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <6d2871fb> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-19" - Thread t@266

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <2fb1f01c> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-18" - Thread t@265

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <5769098> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-17" - Thread t@264

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <4b0ad6ba> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-16" - Thread t@263

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <2b0eedf5> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-15" - Thread t@262

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <100faf2f> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JDWP Transport Listener: dt_socket" - Thread t@236

         java.lang.Thread.State: RUNNABLE

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-14" - Thread t@234

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <247561a0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-13" - Thread t@233

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <165c6213> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-12" - Thread t@232

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <b2ad8dd> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-11" - Thread t@231

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <21425d54> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-10" - Thread t@230

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <2a039ae5> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "ConnectionValidator" - Thread t@218

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <60578543> (a java.util.concurrent.CopyOnWriteArrayList)

      at org.jboss.resource.connectionmanager.ConnectionValidator$ConnectionValidatorRunnable.run(ConnectionValidator.java:156)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JMX server connection timeout 213" - Thread t@213

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <1c59d98b> (a [I)

      at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-9" - Thread t@209

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <18c9851> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-8" - Thread t@208

         java.lang.Thread.State: RUNNABLE

      at java.net.SocketOutputStream.socketWrite0(Native Method)

      at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)

      at java.net.SocketOutputStream.write(SocketOutputStream.java:136)

      at com.sun.net.ssl.internal.ssl.OutputRecord.writeBuffer(OutputRecord.java:295)

      at com.sun.net.ssl.internal.ssl.OutputRecord.write(OutputRecord.java:284)

      at com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecordInternal(SSLSocketImpl.java:734)

      at com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:722)

      at com.sun.net.ssl.internal.ssl.AppOutputStream.write(AppOutputStream.java:59)

      - locked <70dbe673> (a com.sun.net.ssl.internal.ssl.AppOutputStream)

      at org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes(InternalOutputBuffer.java:724)

      at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:449)

      at org.apache.tomcat.util.buf.ByteChunk.append(ByteChunk.java:349)

      at org.apache.coyote.http11.InternalOutputBuffer$OutputStreamOutputBuffer.doWrite(InternalOutputBuffer.java:748)

      at org.apache.coyote.http11.filters.ChunkedOutputFilter.doWrite(ChunkedOutputFilter.java:126)

      at org.apache.coyote.http11.InternalOutputBuffer.doWrite(InternalOutputBuffer.java:557)

      at org.apache.coyote.Response.doWrite(Response.java:567)

      at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:394)

      at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:449)

      at org.apache.catalina.connector.OutputBuffer.realWriteChars(OutputBuffer.java:465)

      at org.apache.tomcat.util.buf.CharChunk.flushBuffer(CharChunk.java:440)

      at org.apache.tomcat.util.buf.CharChunk.append(CharChunk.java:371)

      at org.apache.catalina.connector.OutputBuffer.write(OutputBuffer.java:514)

      at org.apache.catalina.connector.CoyoteWriter.write(CoyoteWriter.java:162)

      at org.apache.catalina.connector.CoyoteWriter.write(CoyoteWriter.java:171)

      at renderMergedOutputModel(TipXmlView.java:97)

      at org.springframework.web.servlet.view.AbstractView.render(AbstractView.java:250)

      at org.springframework.web.servlet.DispatcherServlet.render(DispatcherServlet.java:1063)

      at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:801)

      at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719)

      at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:644)

      at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:560)

      at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)

      at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:638)

      at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:444)

      at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:382)

      at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:310)

      at org.tuckey.web.filters.urlrewrite.NormalRewrittenUrl.doRewrite(NormalRewrittenUrl.java:195)

      at org.tuckey.web.filters.urlrewrite.RuleChain.handleRewrite(RuleChain.java:159)

      at org.tuckey.web.filters.urlrewrite.RuleChain.doRules(RuleChain.java:141)

      at org.tuckey.web.filters.urlrewrite.UrlRewriter.processRequest(UrlRewriter.java:90)

      at org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:417)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at cponseCacheHeaderFilter.doFilterInternal(ResponseCacheHeaderFilter.java:155)

      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at cpHttpMethodFilter.doFilterInternal(TipHttpMethodFilter.java:54)

      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at coearJSessionFilter.doFilter(ClearJSessionFilter.java:85)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:343)

      at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109)

      at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:97)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:100)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:78)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:35)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:177)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:188)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.preauth.AbstractPreAuthenticatedProcessingFilter.doFilter(AbstractPreAuthenticatedProcessingFilter.java:89)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:79)

      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:355)

      at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:149)

      at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)

      at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)

      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)

      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)

      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)

      at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)

      at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)

      at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)

      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)

      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)

      at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)

      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:567)

      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)

      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)

      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829)

      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:598)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <74f6c1e7> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "http-0.0.0.0-443-7" - Thread t@205

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <33c7e910> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-6" - Thread t@190

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <99633ff> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-5" - Thread t@189

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <642faf43> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-4" - Thread t@188

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a2bcfb> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-3" - Thread t@187

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <769b8b17> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-2" - Thread t@186

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <5dc8cfd6> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-1" - Thread t@185

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <2ac51ab4> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)

      at java.lang.Object.wait(Object.java:485)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)

      at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-443-Acceptor-0" - Thread t@184

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <563c48be> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at com.sun.net.ssl.internal.ssl.SSLServerSocketImpl.accept(SSLServerSocketImpl.java:259)

      at org.apache.tomcat.util.net.jsse.JSSESocketFactory.acceptSocket(JSSESocketFactory.java:151)

      at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:310)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "ajp-0.0.0.0-8009-Acceptor-0" - Thread t@183

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <fcbde2d> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)

      at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:310)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "http-0.0.0.0-8080-Acceptor-0" - Thread t@182

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <11676475> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)

      at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:310)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JBossLifeThread" - Thread t@181

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <725c355b> (a java.lang.Object)

      at java.lang.Object.wait(Object.java:485)

      at org.jboss.bootstrap.AbstractServerImpl$LifeThread.run(AbstractServerImpl.java:866)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-42" - Thread t@179

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3b32405> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.soa.esb.listeners.gateway.JmsGatewayListener.receiveOne(JmsGatewayListener.java:458)

      at org.jboss.soa.esb.listeners.gateway.JmsGatewayListener.doRun(JmsGatewayListener.java:157)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-41" - Thread t@178

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <6601c628> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.soa.esb.listeners.gateway.JmsGatewayListener.receiveOne(JmsGatewayListener.java:458)

      at org.jboss.soa.esb.listeners.gateway.JmsGatewayListener.doRun(JmsGatewayListener.java:157)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "ESBScheduler:c2mediator.esb" - Thread t@177

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:272)

       

         Locked ownable synchronizers:

      - None

       

      "ESBScheduler:c2mediator.esb_Worker-0" - Thread t@176

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <7e78a069> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-40" - Thread t@174

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <216b8e5d> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.soa.esb.listeners.gateway.JmsGatewayListener.receiveOne(JmsGatewayListener.java:458)

      at org.jboss.soa.esb.listeners.gateway.JmsGatewayListener.doRun(JmsGatewayListener.java:157)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-39" - Thread t@173

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <1c4f8ccf> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.internalPickupPayload(JmsCourier.java:505)

      - locked <74ec47d6> (a org.jboss.internal.soa.esb.couriers.JmsCourier)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickupPayload(JmsCourier.java:466)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickup(JmsCourier.java:459)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-38" - Thread t@172

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <2aa5788e> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.internalPickupPayload(JmsCourier.java:505)

      - locked <4edfa9f9> (a org.jboss.internal.soa.esb.couriers.JmsCourier)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickupPayload(JmsCourier.java:466)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickup(JmsCourier.java:459)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-37" - Thread t@171

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <558dc881> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.internalPickupPayload(JmsCourier.java:505)

      - locked <1d9764ea> (a org.jboss.internal.soa.esb.couriers.JmsCourier)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickupPayload(JmsCourier.java:466)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickup(JmsCourier.java:459)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-36" - Thread t@170

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <4f66b908> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.internalPickupPayload(JmsCourier.java:505)

      - locked <27e377a4> (a org.jboss.internal.soa.esb.couriers.JmsCourier)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickupPayload(JmsCourier.java:466)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickup(JmsCourier.java:459)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-35" - Thread t@169

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <60fde4f1> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.internalPickupPayload(JmsCourier.java:505)

      - locked <4badad2b> (a org.jboss.internal.soa.esb.couriers.JmsCourier)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickupPayload(JmsCourier.java:466)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickup(JmsCourier.java:459)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-34" - Thread t@168

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <3cc1bbf6> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport$InVMEntry.pickup(InVMTransport.java:949)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport.pickup(InVMTransport.java:443)

      at org.jboss.internal.soa.esb.couriers.InVMCourier.pickup(InVMCourier.java:108)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-33" - Thread t@167

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <531b32a3> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport$InVMEntry.pickup(InVMTransport.java:949)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport.pickup(InVMTransport.java:443)

      at org.jboss.internal.soa.esb.couriers.InVMCourier.pickup(InVMCourier.java:108)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-32" - Thread t@166

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <1e9995f5> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport$InVMEntry.pickup(InVMTransport.java:949)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport.pickup(InVMTransport.java:443)

      at org.jboss.internal.soa.esb.couriers.InVMCourier.pickup(InVMCourier.java:108)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-31" - Thread t@165

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <75441784> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport$InVMEntry.pickup(InVMTransport.java:949)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport.pickup(InVMTransport.java:443)

      at org.jboss.internal.soa.esb.couriers.InVMCourier.pickup(InVMCourier.java:108)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-30" - Thread t@164

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <49641741> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport$InVMEntry.pickup(InVMTransport.java:949)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport.pickup(InVMTransport.java:443)

      at org.jboss.internal.soa.esb.couriers.InVMCourier.pickup(InVMCourier.java:108)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-29" - Thread t@163

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4a32d20b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport$InVMEntry.pickup(InVMTransport.java:949)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTransport.pickup(InVMTransport.java:443)

      at org.jboss.internal.soa.esb.couriers.InVMCourier.pickup(InVMCourier.java:108)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-20" - Thread t@162

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-19" - Thread t@161

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-18" - Thread t@160

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-17" - Thread t@159

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-16" - Thread t@158

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-15" - Thread t@157

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-14" - Thread t@156

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-13" - Thread t@155

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-12" - Thread t@154

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-11" - Thread t@153

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-10" - Thread t@152

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-28" - Thread t@151

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <2c62c3be> (a org.drools.io.impl.ResourceChangeScannerImpl$ProcessChangeSet)

      at org.drools.io.impl.ResourceChangeScannerImpl$ProcessChangeSet.run(ResourceChangeScannerImpl.java:281)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-27" - Thread t@150

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <82105b6> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at org.drools.io.impl.ResourceChangeNotifierImpl$ProcessChangeSet.run(ResourceChangeNotifierImpl.java:256)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Connection Consumer for dest JBossQueue[CallbackQueue] id=1" - Thread t@149

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <2ffdf3e5> (a java.lang.Object)

      at java.lang.Object.wait(Object.java:485)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "WorkManager(2)-2" - Thread t@143

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <49975800> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-9" - Thread t@142

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-8" - Thread t@141

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-7" - Thread t@140

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JbpmJobExector:LockMonitorThread@10.14.200.73" - Thread t@139

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.jbpm.job.executor.LockMonitorThread.run(LockMonitorThread.java:59)

       

         Locked ownable synchronizers:

      - None

       

      "JbpmJobExector:10.14.200.73:1" - Thread t@138

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <6f128dbe> (a org.jbpm.job.executor.JobExecutor)

      at org.jbpm.job.executor.JobExecutorThread.run(JobExecutorThread.java:69)

       

         Locked ownable synchronizers:

      - None

       

      "H2 Log Writer JBPMDB" - Thread t@137

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.h2.store.WriterThread.run(WriterThread.java:158)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "H2 File Lock Watchdog C:\JBossAS\jboss-5.1.0.GA\server\default\data\h2\jbpmDB.lock.db" - Thread t@136

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.h2.store.FileLock$1.run(FileLock.java:355)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-18-thread-1" - Thread t@134

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <2b17edea> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Timer-2" - Thread t@132

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3004b3c0> (a java.util.TaskQueue)

      at java.util.TimerThread.mainLoop(Timer.java:509)

      at java.util.TimerThread.run(Timer.java:462)

       

         Locked ownable synchronizers:

      - None

       

      "RMI RenewClean-[mlc2dev2:1098]" - Thread t@130

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <4b51ae1> (a java.lang.ref.ReferenceQueue$Lock)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)

      at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JBoss System Threads(1)-3" - Thread t@129

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <df7ac31> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "ESBScheduler:jbossesb.esb" - Thread t@128

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:394)

       

         Locked ownable synchronizers:

      - None

       

      "ESBScheduler:jbossesb.esb_Worker-0" - Thread t@127

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <7f49cc20> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-21" - Thread t@126

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45f88a29> (a java.lang.Object)

      at org.jboss.jms.client.container.ClientConsumer.waitOnLock(ClientConsumer.java:833)

      at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:880)

      at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:530)

      at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)

      at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect_z_handleReceive_679933718.invoke(ConsumerAspect_z_handleReceive_679933718.java)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

      at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

      at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

      at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)

      at org.jboss.jms.client.JBossMessageConsumer.receive(JBossMessageConsumer.java:86)

      at sun.reflect.GeneratedMethodAccessor358.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

      at java.lang.reflect.Method.invoke(Method.java:597)

      at org.jboss.internal.soa.esb.rosetta.pooling.JmsSession$ExceptionHandler.invoke(JmsSession.java:492)

      at $Proxy558.receive(Unknown Source)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.internalPickupPayload(JmsCourier.java:505)

      - locked <797c87d2> (a org.jboss.internal.soa.esb.couriers.JmsCourier)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickupPayload(JmsCourier.java:466)

      at org.jboss.internal.soa.esb.couriers.JmsCourier.pickup(JmsCourier.java:459)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:228)

      at org.jboss.internal.soa.esb.couriers.TwoWayCourierImpl.pickup(TwoWayCourierImpl.java:204)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.waitForEventAndProcess(MessageAwareListener.java:297)

      at org.jboss.soa.esb.listeners.message.MessageAwareListener.doRun(MessageAwareListener.java:253)

      at org.jboss.soa.esb.listeners.lifecycle.AbstractThreadedManagedLifecycle.run(AbstractThreadedManagedLifecycle.java:115)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-6" - Thread t@125

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-5" - Thread t@124

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-4" - Thread t@123

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-3" - Thread t@122

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-2" - Thread t@121

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "pool-9-thread-1" - Thread t@120

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4e7bf63b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "org.springframework.scheduling.concurrent.ScheduledExecutorFactoryBean#0-1" - Thread t@117

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <4036ada2> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)

      at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_QuartzSchedulerThread" - Thread t@116

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:272)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-9" - Thread t@115

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-8" - Thread t@114

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-7" - Thread t@113

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-6" - Thread t@112

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-5" - Thread t@111

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-4" - Thread t@110

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-3" - Thread t@109

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-2" - Thread t@108

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-1" - Thread t@107

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "quartzScheduler_Worker-0" - Thread t@106

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <45c1879d> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "Store cort Expiry Thread" - Thread t@105

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.expiryThreadMain(DiskStore.java:831)

      at net.sf.ehcache.store.DiskStore.access$700(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$ExpiryThread.run(DiskStore.java:1008)

       

         Locked ownable synchronizers:

      - None

       

      "Store com.tSpool Thread" - Thread t@104

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store com Expiry Thread" - Thread t@103

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.expiryThreadMain(DiskStore.java:831)

      at net.sf.ehcache.store.DiskStore.access$700(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$ExpiryThread.run(DiskStore.java:1008)

       

         Locked ownable synchronizers:

      - None

       

      "Store coSpool Thread" - Thread t@102

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store co Spool Thread" - Thread t@101

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store Spool Thread" - Thread t@100

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store  Spool Thread" - Thread t@99

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store l Thread" - Thread t@98

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comate.PositionDom Spool Thread" - Thread t@97

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store coermit Spool Thread" - Thread t@96

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store coTypeTime Spool Thread" - Thread t@95

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comsion Spool Thread" - Thread t@94

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store raftTypeConfig Spool Thread" - Thread t@93

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comed Spool Thread" - Thread t@92

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store  Spool Thread" - Thread t@91

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store cohicle Spool Thread" - Thread t@90

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store cTypeDom Spool Thread" - Thread t@89

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comoint Spool Thread" - Thread t@88

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store cot Spool Thread" - Thread t@87

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comtion Spool Thread" - Thread t@86

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store cotApprovalNumber Spool Thread" - Thread t@85

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comype Spool Thread" - Thread t@84

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comght Spool Thread" - Thread t@83

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comype Spool Thread" - Thread t@82

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comate Spool Thread" - Thread t@81

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comocation Spool Thread" - Thread t@80

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store coson Spool Thread" - Thread t@79

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comraft Spool Thread" - Thread t@78

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store coon Spool Thread" - Thread t@77

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store comrritory Spool Thread" - Thread t@76

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "Store co Spool Thread" - Thread t@75

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at net.sf.ehcache.store.DiskStore.spoolThreadMain(DiskStore.java:556)

      at net.sf.ehcache.store.DiskStore.access$600(DiskStore.java:59)

      at net.sf.ehcache.store.DiskStore$SpoolThread.run(DiskStore.java:990)

       

         Locked ownable synchronizers:

      - None

       

      "IdleRemover" - Thread t@74

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <24ae7832> (a java.util.concurrent.CopyOnWriteArrayList)

      at org.jboss.resource.connectionmanager.IdleRemover$IdleRemoverRunnable.run(IdleRemover.java:167)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-17" - Thread t@67

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.jboss.messaging.core.impl.memory.SimpleMemoryManager$MemoryRunnable.run(SimpleMemoryManager.java:126)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_QuartzSchedulerThread" - Thread t@66

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:394)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-9" - Thread t@65

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-8" - Thread t@64

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-7" - Thread t@63

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-6" - Thread t@62

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-5" - Thread t@61

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-4" - Thread t@60

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-3" - Thread t@59

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-2" - Thread t@58

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-1" - Thread t@57

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "DefaultQuartzScheduler_Worker-0" - Thread t@56

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <3a552d6e> (a java.lang.Object)

      at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:428)

      at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:47)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:518)

       

         Locked ownable synchronizers:

      - None

       

      "WorkManager(2)-1" - Thread t@55

         java.lang.Thread.State: WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <2e19aead> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

      at java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:220)

      at org.jboss.resource.adapter.mail.inflow.NewMsgsWorker.run(NewMsgsWorker.java:76)

      at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:205)

      at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:260)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <16698f40> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "Timer-1" - Thread t@54

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <181af780> (a java.util.TaskQueue)

      at java.util.TimerThread.mainLoop(Timer.java:509)

      at java.util.TimerThread.run(Timer.java:462)

       

         Locked ownable synchronizers:

      - None

       

      "JCA PoolFiller" - Thread t@53

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <126f00dd> (a java.util.LinkedList)

      at java.lang.Object.wait(Object.java:485)

      at org.jboss.resource.connectionmanager.PoolFiller.run(PoolFiller.java:87)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "AOPListner" - Thread t@52

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.jboss.console.plugins.AOPLister$RefreshPoller.run(AOPLister.java:898)

       

         Locked ownable synchronizers:

      - None

       

      "ContainerBackgroundProcessor[StandardEngine[jboss.web]]" - Thread t@51

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1590)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "PooledInvokerAcceptor#0-4445" - Thread t@50

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <46470ff5> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.jboss.invocation.pooled.server.PooledInvoker.run(PooledInvoker.java:262)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "RMI TCP Accept-4444" - Thread t@49

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <6368c1de> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-14" - Thread t@46

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <35a1b69f> (a java.lang.Object)

      at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doBackoffWait(PeriodicRecovery.java:660)

      at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:765)

      at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:412)

       

         Locked ownable synchronizers:

      - None

       

      "Listener:4712" - Thread t@48

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <729008ce> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at com.arjuna.ats.internal.arjuna.recovery.Listener.run(Listener.java:118)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-13" - Thread t@45

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor.run(ExpiredEntryMonitor.java:237)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-12" - Thread t@44

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <bdc9c3b> (a java.util.LinkedList)

      at java.lang.Object.wait(Object.java:485)

      at com.arjuna.ats.arjuna.coordinator.TransactionReaper.waitForCancellations(TransactionReaper.java:504)

      at com.arjuna.ats.internal.arjuna.coordinator.ReaperWorkerThread.run(ReaperWorkerThread.java:74)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-11" - Thread t@43

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <4094eb92> (a com.arjuna.ats.arjuna.coordinator.TransactionReaper)

      at com.arjuna.ats.internal.arjuna.coordinator.ReaperThread.run(ReaperThread.java:98)

       

         Locked ownable synchronizers:

      - None

       

      "Listener:4713" - Thread t@41

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <4e324724> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at com.arjuna.ats.internal.arjuna.recovery.Listener.run(Listener.java:118)

       

         Locked ownable synchronizers:

      - None

       

      "AcceptorThread[ServerSocket[addr=/0.0.0.0,port=0,localport=4446]]" - Thread t@40

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <263c6859> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.jboss.remoting.transport.socket.SocketServerInvoker.accept(SocketServerInvoker.java:1109)

      at org.jboss.remoting.transport.socket.SocketServerInvoker.access$200(SocketServerInvoker.java:70)

      at org.jboss.remoting.transport.socket.SocketServerInvoker$AcceptThread.run(SocketServerInvoker.java:1020)

       

         Locked ownable synchronizers:

      - None

       

      "ServerSocketRefresh" - Thread t@39

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <70f5df5d> (a java.lang.Object)

      at java.lang.Object.wait(Object.java:485)

      at org.jboss.remoting.transport.socket.SocketServerInvoker$ServerSocketRefresh.run(SocketServerInvoker.java:844)

       

         Locked ownable synchronizers:

      - None

       

      "HDScanner" - Thread t@38

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <1e1b8c9b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)

      at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "AcceptorThread[ServerSocket[addr=/0.0.0.0,port=0,localport=3873]]" - Thread t@37

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <47e6beab> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.jboss.remoting.transport.socket.SocketServerInvoker.accept(SocketServerInvoker.java:1109)

      at org.jboss.remoting.transport.socket.SocketServerInvoker.access$200(SocketServerInvoker.java:70)

      at org.jboss.remoting.transport.socket.SocketServerInvoker$AcceptThread.run(SocketServerInvoker.java:1020)

       

         Locked ownable synchronizers:

      - None

       

      "ServerSocketRefresh" - Thread t@36

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <22ac238e> (a java.lang.Object)

      at java.lang.Object.wait(Object.java:485)

      at org.jboss.remoting.transport.socket.SocketServerInvoker$ServerSocketRefresh.run(SocketServerInvoker.java:844)

       

         Locked ownable synchronizers:

      - None

       

      "secondaryServerSocketThread[0]" - Thread t@35

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <7deff16d> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.jboss.remoting.transport.bisocket.BisocketServerInvoker$SecondaryServerSocketThread$1.run(BisocketServerInvoker.java:1110)

      at java.security.AccessController.doPrivileged(Native Method)

      at org.jboss.remoting.transport.bisocket.BisocketServerInvoker$SecondaryServerSocketThread.run(BisocketServerInvoker.java:1106)

       

         Locked ownable synchronizers:

      - None

       

      "AcceptorThread[ServerSocket[addr=/0.0.0.0,port=0,localport=4457]]" - Thread t@34

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <13d36bb3> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.jboss.remoting.transport.socket.SocketServerInvoker.accept(SocketServerInvoker.java:1109)

      at org.jboss.remoting.transport.socket.SocketServerInvoker.access$200(SocketServerInvoker.java:70)

      at org.jboss.remoting.transport.socket.SocketServerInvoker$AcceptThread.run(SocketServerInvoker.java:1020)

       

         Locked ownable synchronizers:

      - None

       

      "ServerSocketRefresh" - Thread t@33

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <5352516a> (a java.lang.Object)

      at java.lang.Object.wait(Object.java:485)

      at org.jboss.remoting.transport.socket.SocketServerInvoker$ServerSocketRefresh.run(SocketServerInvoker.java:844)

       

         Locked ownable synchronizers:

      - None

       

      "RMI RenewClean-[mlc2dev2:50646]" - Thread t@31

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <415f30e2> (a java.lang.ref.ReferenceQueue$Lock)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)

      at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "RMI Scheduler(0)" - Thread t@30

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <508266f5> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)

      at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "RMI TCP Accept-1090" - Thread t@28

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <4aac8d92> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "Thread-5" - Thread t@27

         java.lang.Thread.State: TIMED_WAITING

      at sun.misc.Unsafe.park(Native Method)

      - parking to wait for <2135881e> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)

      at org.jboss.internal.soa.esb.couriers.transport.InVMTemporaryTransport$ReaperThread.run(InVMTemporaryTransport.java:902)

       

         Locked ownable synchronizers:

      - None

       

      "HSQLDB Timer @37602b84" - Thread t@26

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <417b7a9a> (a org.hsqldb.lib.HsqlTimer$TaskQueue)

      at org.hsqldb.lib.HsqlTimer$TaskQueue.park(Unknown Source)

      at org.hsqldb.lib.HsqlTimer.nextTask(Unknown Source)

      at org.hsqldb.lib.HsqlTimer$TaskRunner.run(Unknown Source)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "SubscriptionWatchDog" - Thread t@25

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Thread.sleep(Native Method)

      at org.jboss.ws.extensions.eventing.mgmt.SubscriptionManager$WatchDog.run(SubscriptionManager.java:653)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JBoss System Threads(1)-2" - Thread t@24

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <682928b> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.jnp.server.Main$AcceptHandler.run(Main.java:597)

      at org.jboss.util.threadpool.RunnableTaskWrapper.run(RunnableTaskWrapper.java:147)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <6662e703> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "GC Daemon" - Thread t@23

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <11ae360c> (a sun.misc.GC$LatencyLock)

      at sun.misc.GC$Daemon.run(GC.java:100)

       

         Locked ownable synchronizers:

      - None

       

      "RMI Reaper" - Thread t@22

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <445e56e5> (a java.lang.ref.ReferenceQueue$Lock)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)

      at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:333)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "RMI TCP Accept-1098" - Thread t@21

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <672caa78> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JBoss System Threads(1)-1" - Thread t@20

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <256be133> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at org.jboss.web.WebServer.run(WebServer.java:320)

      at org.jboss.util.threadpool.RunnableTaskWrapper.run(RunnableTaskWrapper.java:147)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - locked <4d8dee76> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

       

      "Timer-Log4jService" - Thread t@19

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <d9af774> (a java.util.TaskQueue)

      at java.util.TimerThread.mainLoop(Timer.java:509)

      at java.util.TimerThread.run(Timer.java:462)

       

         Locked ownable synchronizers:

      - None

       

      "Timer-0" - Thread t@17

         java.lang.Thread.State: TIMED_WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <38ebe7a6> (a java.util.TaskQueue)

      at java.util.TimerThread.mainLoop(Timer.java:509)

      at java.util.TimerThread.run(Timer.java:462)

       

         Locked ownable synchronizers:

      - None

       

      "DestroyJavaVM" - Thread t@15

         java.lang.Thread.State: RUNNABLE

       

         Locked ownable synchronizers:

      - None

       

      "RMI TCP Accept-0" - Thread t@13

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <2122acc1> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "RMI TCP Accept-1234" - Thread t@12

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <6b7bc3e5> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "RMI TCP Accept-0" - Thread t@11

         java.lang.Thread.State: RUNNABLE

      at java.net.PlainSocketImpl.socketAccept(Native Method)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

      - locked <5976a97b> (a java.net.SocksSocketImpl)

      at java.net.ServerSocket.implAccept(ServerSocket.java:453)

      at java.net.ServerSocket.accept(ServerSocket.java:421)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)

      at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)

      at java.lang.Thread.run(Thread.java:619)

       

         Locked ownable synchronizers:

      - None

       

      "JDWP Event Helper Thread" - Thread t@6

         java.lang.Thread.State: RUNNABLE

       

         Locked ownable synchronizers:

      - None

       

      "Attach Listener" - Thread t@4

         java.lang.Thread.State: RUNNABLE

       

         Locked ownable synchronizers:

      - None

       

      "Finalizer" - Thread t@3

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <7b5607c> (a java.lang.ref.ReferenceQueue$Lock)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)

      at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

       

         Locked ownable synchronizers:

      - None

       

      "Reference Handler" - Thread t@2

         java.lang.Thread.State: WAITING

      at java.lang.Object.wait(Native Method)

      - waiting on <14d170d8> (a java.lang.ref.Reference$Lock)

      at java.lang.Object.wait(Object.java:485)

      at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)

       

         Locked ownable synchronizers:

      - None

        • 1. Re: slow performance of native call to socketWrite
          tap_mmenne

          So it turns out that SSL may have been the root of the issue.  After commenting out the SSL connector in the server.xml performance improved dramatically.

           

           

          The overall solution may be to ditch the default Java SSL implementation and instead rely on library like openssl.

           

          I'll have more details for you guys after I make the switch.

           

          Cheers,

          Mike