4 Replies Latest reply on Nov 8, 2009 10:22 PM by Yong Hao Gao

    Deadlock stops JMS messages to be processed

    Johan Hedin Newbie

      In JBoss 4.2.3 + JBoss Messaging 1.4.4, the processing of MDB and other tasks using JMS hangs under high load. The problem is also present in JBoss 4.2.2 + JBoss Messaging 1.4.2.SP1, but much less frequent. I have included a thread dump of a hang server.



      johan@localhost ~/jboss-run $ Full thread dump Java HotSpot(TM) 64-Bit Server VM (1.5.0_20-b02 mixed mode):
      
      "Thread-96" daemon prio=1 tid=0x0000000041084d10 nid=0x69d8 waiting on condition [0x00007f9ac0d50000..0x00007f9ac0d50d90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:807)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1122)
       at java.util.concurrent.SynchronousQueue$Node.waitForPut(SynchronousQueue.java:291)
       at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:443)
       at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:475)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
       at java.lang.Thread.run(Thread.java:595)
      
      "Thread-86" daemon prio=1 tid=0x00007f9aac39ef80 nid=0x5fd7 waiting on condition [0x00007f9ab63a7000..0x00007f9ab63a7a90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:807)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1122)
       at java.util.concurrent.SynchronousQueue$Node.waitForPut(SynchronousQueue.java:291)
       at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:443)
       at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:475)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
       at java.lang.Thread.run(Thread.java:595)
      
      "WorkManager(2)-1299" daemon prio=1 tid=0x00007f9aea236be0 nid=0x5ea8 waiting on condition [0x00007f9ace172000..0x00007f9ace172d90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.commit(JmsXAResource.java:95)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.commit(JcaXAResourceWrapper.java:53)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit(XAResourceRecord.java:487)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3107)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3022)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Commit(BasicAction.java:2126)
       - locked <0x00007f9b140de510> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1819)
       - locked <0x00007f9b140de510> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
       at java.lang.Thread.run(Thread.java:595)
      
      "WorkManager(2)-442" daemon prio=1 tid=0x00007f9aebdc0e70 nid=0x5553 waiting on condition [0x00007f9ac42d4000..0x00007f9ac42d4c90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.commit(JmsXAResource.java:95)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.commit(JcaXAResourceWrapper.java:53)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit(XAResourceRecord.java:487)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3107)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3022)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Commit(BasicAction.java:2126)
       - locked <0x00007f9b1355f448> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1819)
       - locked <0x00007f9b1355f448> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
       at java.lang.Thread.run(Thread.java:595)
      
      "WorkManager(2)-308" daemon prio=1 tid=0x00007f9ae8cff330 nid=0x4f46 waiting on condition [0x00007f9acd465000..0x00007f9acd465c90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.commit(JmsXAResource.java:95)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.commit(JcaXAResourceWrapper.java:53)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit(XAResourceRecord.java:487)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3107)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3022)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Commit(BasicAction.java:2126)
       - locked <0x00007f9b11e4a198> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1819)
       - locked <0x00007f9b11e4a198> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
       at java.lang.Thread.run(Thread.java:595)
      
      "Server.Connection:127.0.0.1:53364" daemon prio=1 tid=0x000000004172fcd0 nid=0x4eff runnable [0x00007f9ac1cae000..0x00007f9ac1caed10]
       at java.net.SocketInputStream.socketRead0(Native Method)
       at java.net.SocketInputStream.read(SocketInputStream.java:129)
       at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:411)
       at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:453)
       at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:183)
       - locked <0x00007f9b116d4a88> (a java.io.InputStreamReader)
       at java.io.InputStreamReader.read(InputStreamReader.java:167)
       at java.io.BufferedReader.fill(BufferedReader.java:136)
       at java.io.BufferedReader.readLine(BufferedReader.java:299)
       - locked <0x00007f9b116d4a88> (a java.io.InputStreamReader)
       at java.io.BufferedReader.readLine(BufferedReader.java:362)
       at com.arjuna.ats.arjuna.recovery.ActionStatusService.doWork(ActionStatusService.java:135)
       at com.arjuna.ats.internal.arjuna.recovery.Connection.run(Connection.java:83)
      
      "Thread-54" prio=1 tid=0x00000000409bab70 nid=0x4e80 waiting on condition [0x00007f9ab6cb0000..0x00007f9ab6cb0b10]
       at java.lang.Thread.sleep(Native Method)
       at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
      
      "Thread-53" prio=1 tid=0x00000000419c3410 nid=0x4e7f waiting on condition [0x00007f9ab6db1000..0x00007f9ab6db1b90]
       at java.lang.Thread.sleep(Native Method)
       at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
      
      "Thread-52" prio=1 tid=0x0000000040c764a0 nid=0x4e7e waiting on condition [0x00007f9ab6eb2000..0x00007f9ab6eb2c10]
       at java.lang.Thread.sleep(Native Method)
       at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
      
      "Thread-51" prio=1 tid=0x00000000416b3d60 nid=0x4e7d waiting on condition [0x00007f9ab6fb3000..0x00007f9ab6fb3c90]
       at java.lang.Thread.sleep(Native Method)
       at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
      
      "WorkManager(2)-280" daemon prio=1 tid=0x00007f9ae97568c0 nid=0x4e3e waiting on condition [0x00007f9ab9bdf000..0x00007f9ab9bdfc90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.commit(JmsXAResource.java:95)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.commit(JcaXAResourceWrapper.java:53)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit(XAResourceRecord.java:487)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3107)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3022)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Commit(BasicAction.java:2126)
       - locked <0x00007f9b1224dbc8> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1819)
       - locked <0x00007f9b1224dbc8> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
       at java.lang.Thread.run(Thread.java:595)
      
      "WorkManager(2)-278" daemon prio=1 tid=0x00007f9ae8927ba0 nid=0x4e3c waiting on condition [0x00007f9ab9de1000..0x00007f9ab9de1d90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
       - locked <0x00007f9b100fd630> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
       - locked <0x00007f9b100fd630> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
       at java.lang.Thread.run(Thread.java:595)
      
      "EJB-Timer-1251451676720[target=jboss.j2ee:service=EJB3,ear=ibcs.ear,jar=ibcs-ejb.par,name=FaultLogTruncateSchedulerBean]" prio=1 tid=0x0000000040a726c0 nid=0x4df6 in Object.wait() [0x00007f9abcd10000..0x00007f9abcd10b90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fefd028> (a java.util.TaskQueue)
       at java.util.TimerThread.mainLoop(Timer.java:509)
       - locked <0x00007f9b0fefd028> (a java.util.TaskQueue)
       at java.util.TimerThread.run(Timer.java:462)
      
      "EJB-Timer-1251451676718[target=jboss.j2ee:service=EJB3,ear=ibcs.ear,jar=ibcs-ejb.par,name=ResendDlqBean]" prio=1 tid=0x0000000041606ca0 nid=0x4dec in Object.wait() [0x00007f9abd518000..0x00007f9abd518b90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0ff9a8c8> (a java.util.TaskQueue)
       at java.util.TimerThread.mainLoop(Timer.java:509)
       - locked <0x00007f9b0ff9a8c8> (a java.util.TaskQueue)
       at java.util.TimerThread.run(Timer.java:462)
      
      "EJB-Timer-1251451676717[target=jboss.j2ee:service=EJB3,ear=ibcs.ear,jar=ibcs-ejb.par,name=ExportSchedulerBean]" prio=1 tid=0x000000004160c6c0 nid=0x4de7 in Object.wait() [0x00007f9abd619000..0x00007f9abd619c10]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fefe248> (a java.util.TaskQueue)
       at java.util.TimerThread.mainLoop(Timer.java:509)
       - locked <0x00007f9b0fefe248> (a java.util.TaskQueue)
       at java.util.TimerThread.run(Timer.java:462)
      
      "WorkManager(2)-200" daemon prio=1 tid=0x00000000411cde30 nid=0x4dbf waiting on condition [0x00007f9abf639000..0x00007f9abf639c10]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.commit(JmsXAResource.java:95)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.commit(JcaXAResourceWrapper.java:53)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit(XAResourceRecord.java:487)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3107)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3022)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Commit(BasicAction.java:2126)
       - locked <0x00007f9b11a92ae0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1819)
       - locked <0x00007f9b11a92ae0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
       at java.lang.Thread.run(Thread.java:595)
      
      "WorkManager(2)-157" daemon prio=1 tid=0x00007f9ad215f270 nid=0x4d7a waiting on condition [0x00007f9ac2bbd000..0x00007f9ac2bbdb90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.commit(JmsXAResource.java:95)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.commit(JcaXAResourceWrapper.java:53)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit(XAResourceRecord.java:487)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3107)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3022)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Commit(BasicAction.java:2126)
       - locked <0x00007f9b1357c260> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1819)
       - locked <0x00007f9b1357c260> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
       at java.lang.Thread.run(Thread.java:595)
      
      "WorkManager(2)-116" daemon prio=1 tid=0x00007f9ad2164e40 nid=0x4d51 waiting on condition [0x00007f9ac54e6000..0x00007f9ac54e6c10]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
       - locked <0x00007f9b0fa27ed0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
       - locked <0x00007f9b0fa27ed0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:756)
       at java.lang.Thread.run(Thread.java:595)
      
      "TimeoutFactory-0" daemon prio=1 tid=0x0000000041700170 nid=0x4d16 in Object.wait() [0x00007f9ac9021000..0x00007f9ac9021d90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fb5f1f0> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.util.timeout.TimeoutPriorityQueueImpl.poll(TimeoutPriorityQueueImpl.java:253)
       - locked <0x00007f9b0fb5f1f0> (a java.lang.Object)
       at org.jboss.util.timeout.TimeoutPriorityQueueImpl.take(TimeoutPriorityQueueImpl.java:230)
       at org.jboss.util.timeout.TimeoutFactory.doWork(TimeoutFactory.java:215)
       at org.jboss.util.timeout.TimeoutFactory.access$000(TimeoutFactory.java:41)
       at org.jboss.util.timeout.TimeoutFactory$1.run(TimeoutFactory.java:136)
      
      "WorkManager(2)-55" daemon prio=1 tid=0x00007f9aeb2b96a0 nid=0x4d12 waiting on condition [0x00007f9ac9425000..0x00007f9ac9425b90]
       at sun.misc.Unsafe.park(Native Method)
       at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
       at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
       at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
       at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
       at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
       at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
       at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
       at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
       - locked <0x00007f9b0fad4bd0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
       - locked <0x00007f9b0fad4bd0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
       at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
       at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
       at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
       at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
       at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
       at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
       at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
       at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:756)
       at java.lang.Thread.run(Thread.java:595)
      
      "http-0.0.0.0-8443-Acceptor-0" daemon prio=1 tid=0x00007f9ae8713150 nid=0x4cfb runnable [0x00007f9ac992a000..0x00007f9ac992aa90]
       at java.net.PlainSocketImpl.socketAccept(Native Method)
       at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
       - locked <0x00007f9b018c6100> (a java.net.SocksSocketImpl)
       at java.net.ServerSocket.implAccept(ServerSocket.java:450)
       at java.net.ServerSocket.accept(ServerSocket.java:421)
       at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
       at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:309)
       at java.lang.Thread.run(Thread.java:595)
      
      "http-0.0.0.0-8080-Acceptor-0" daemon prio=1 tid=0x00007f9aeb720060 nid=0x4cfa runnable [0x00007f9ac9a2b000..0x00007f9ac9a2bb10]
       at java.net.PlainSocketImpl.socketAccept(Native Method)
       at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
       - locked <0x00007f9b018c6048> (a java.net.SocksSocketImpl)
       at java.net.ServerSocket.implAccept(ServerSocket.java:450)
       at java.net.ServerSocket.accept(ServerSocket.java:421)
       at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
       at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:309)
       at java.lang.Thread.run(Thread.java:595)
      
      "Thread-6" prio=1 tid=0x00007f9ad2664270 nid=0x4cf9 waiting on condition [0x00007f9ac9b2c000..0x00007f9ac9b2cb90]
       at java.lang.Thread.sleep(Native Method)
       at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWork(PeriodicRecovery.java:248)
       at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:163)
      
      "JBossLifeThread" prio=1 tid=0x00007f9ae8cbcf60 nid=0x4cf8 in Object.wait() [0x00007f9ac9c2d000..0x00007f9ac9c2dc10]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fc5ad00> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.system.server.ServerImpl$LifeThread.run(ServerImpl.java:940)
       - locked <0x00007f9b0fc5ad00> (a java.lang.Object)
      
      "Connection Consumer for dest JBossQueue[VirtualRis] id=37" daemon prio=1 tid=0x00000000410cb540 nid=0x4cf7 in Object.wait() [0x00007f9ac9d2e000..0x00007f9ac9d2ec90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fa27340> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0fa27340> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSCommandBus-type-startup] id=36" daemon prio=1 tid=0x00000000410c9c70 nid=0x4cf3 in Object.wait() [0x00007f9ac9f30000..0x00007f9ac9f30d90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fa3f0f8> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0fa3f0f8> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus-type-2] id=35" daemon prio=1 tid=0x0000000041f31fc0 nid=0x4cf1 in Object.wait() [0x00007f9aca132000..0x00007f9aca132a90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fa57c28> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0fa57c28> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSCommandBus-type-reindex] id=34" daemon prio=1 tid=0x0000000040f847a0 nid=0x4cf0 in Object.wait() [0x00007f9aca233000..0x00007f9aca233b10]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0fa12cf0> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0fa12cf0> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSCommandBus-type-reindexUnit] id=33" daemon prio=1 tid=0x00000000411bcb20 nid=0x4cee in Object.wait() [0x00007f9aca435000..0x00007f9aca435c10]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f9d6678> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f9d6678> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[RegionalDataResponse] id=32" daemon prio=1 tid=0x0000000040f85000 nid=0x4ceb in Object.wait() [0x00007f9aca738000..0x00007f9aca738d90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f9fd550> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f9fd550> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[RegionalDataInquiry] id=31" daemon prio=1 tid=0x0000000040f45f70 nid=0x4cea in Object.wait() [0x00007f9aca839000..0x00007f9aca839e10]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f9e9f18> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f9e9f18> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[PatientHistoryResult] id=30" daemon prio=1 tid=0x00000000411b9c50 nid=0x4ce8 in Object.wait() [0x00007f9acaa3b000..0x00007f9acaa3bb10]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f9e6d20> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f9e6d20> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[PatientHistoryOrder] id=29" daemon prio=1 tid=0x00000000411bc030 nid=0x4ce5 in Object.wait() [0x00007f9acad3e000..0x00007f9acad3ec90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f185198> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f185198> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus-type-3] id=28" daemon prio=1 tid=0x00000000410cdb50 nid=0x4ce3 in Object.wait() [0x00007f9acaf40000..0x00007f9acaf40d90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f1939c0> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f1939c0> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus-type-11] id=27" daemon prio=1 tid=0x00000000411b8b50 nid=0x4ce1 in Object.wait() [0x00007f9acb142000..0x00007f9acb142a90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f1c1070> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f1c1070> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[NotificationQueue] id=26" daemon prio=1 tid=0x00000000411b90f0 nid=0x4cdf in Object.wait() [0x00007f9acb344000..0x00007f9acb344b90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f0eaf38> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f0eaf38> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus] id=25" daemon prio=1 tid=0x00007f9aeb3aa830 nid=0x4cdd in Object.wait() [0x00007f9acb546000..0x00007f9acb546c90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f1cfa50> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f1cfa50> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[Merge] id=24" daemon prio=1 tid=0x00000000410ce560 nid=0x4cda in Object.wait() [0x00007f9acb748000..0x00007f9acb748d90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f03bdd0> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f03bdd0> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus-type-7] id=23" daemon prio=1 tid=0x00000000416538d0 nid=0x4cd8 in Object.wait() [0x00007f9acb94a000..0x00007f9acb94aa90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f1b02d8> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f1b02d8> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[LogQueue] id=22" daemon prio=1 tid=0x0000000040f897b0 nid=0x4cd6 in Object.wait() [0x00007f9acbb4c000..0x00007f9acbb4cb90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f10ce30> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f10ce30> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[ImageViewerUnpackQueue] id=21" daemon prio=1 tid=0x0000000040f8a520 nid=0x4cd4 in Object.wait() [0x00007f9acbd4e000..0x00007f9acbd4ec90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f074360> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f074360> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[ImageTransferBetweenCNsQueue] id=20" daemon prio=1 tid=0x00000000413b94f0 nid=0x4cd2 in Object.wait() [0x00007f9acbf50000..0x00007f9acbf50d90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f171a88> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f171a88> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus-type-10] id=19" daemon prio=1 tid=0x0000000040f8a210 nid=0x4cd0 in Object.wait() [0x00007f9acc152000..0x00007f9acc152a90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f09eff8> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f09eff8> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus-type-1] id=18" daemon prio=1 tid=0x00000000413b9ba0 nid=0x4cce in Object.wait() [0x00007f9acc354000..0x00007f9acc354b90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f052a80> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f052a80> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSCommandBus-type-GopCommand] id=17" daemon prio=1 tid=0x00000000413bdc10 nid=0x4ccc in Object.wait() [0x00007f9acc556000..0x00007f9acc556c90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f0c0d80> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f0c0d80> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSMessageBus-type-6] id=16" daemon prio=1 tid=0x00000000413bcad0 nid=0x4cca in Object.wait() [0x00007f9acc758000..0x00007f9acc758d90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f1a11e8> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f1a11e8> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelegate.java)
       at org.jboss.jms.client.JBossConnectionConsumer.run(JBossConnectionConsumer.java:248)
       at java.lang.Thread.run(Thread.java:595)
      
      "Connection Consumer for dest JBossQueue[IBCSExport] id=15" daemon prio=1 tid=0x0000000041408fd0 nid=0x4cc8 in Object.wait() [0x00007f9acc95a000..0x00007f9acc95aa90]
       at java.lang.Object.wait(Native Method)
       - waiting on <0x00007f9b0f141e88> (a java.lang.Object)
       at java.lang.Object.wait(Object.java:474)
       at org.jboss.jms.client.container.ClientConsumer.getMessage(ClientConsumer.java:866)
       at org.jboss.jms.client.container.ClientConsumer.receive(ClientConsumer.java:506)
       - locked <0x00007f9b0f141e88> (a java.lang.Object)
       at org.jboss.jms.client.container.ConsumerAspect.handleReceive(ConsumerAspect.java:194)
       at org.jboss.aop.advice.org.jboss.jms.client.container.ConsumerAspect54.invoke(ConsumerAspect54.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
       at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate$receive_N8299950230150603585.invokeNext(ClientConsumerDelegate$receive_N8299950230150603585.java)
       at org.jboss.jms.client.delegate.ClientConsumerDelegate.receive(ClientConsumerDelega


        • 1. Re: Deadlock stops JMS messages to be processed
          Johan Hedin Newbie

          After restarting the server, I can see hang locks building up in WorkManager(2)-92

          johan@localhost ~/jboss-run $ Full thread dump Java HotSpot(TM) 64-Bit Server VM (1.5.0_20-b02 mixed mode):
          
          "Thread-57" daemon prio=1 tid=0x00007f3541563a00 nid=0x1029 waiting on condition [0x00007f3514a2d000..0x00007f3514a2dc10]
           at sun.misc.Unsafe.park(Native Method)
           at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146)
           at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:807)
           at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1122)
           at java.util.concurrent.SynchronousQueue$Node.waitForPut(SynchronousQueue.java:291)
           at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:443)
           at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:475)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
           at java.lang.Thread.run(Thread.java:595)
          
          "Thread-56" daemon prio=1 tid=0x00007f3541af58c0 nid=0xfc9 waiting on condition [0x00007f350e7b2000..0x00007f350e7b2c10]
           at sun.misc.Unsafe.park(Native Method)
           at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146)
           at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:807)
           at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1122)
           at java.util.concurrent.SynchronousQueue$Node.waitForPut(SynchronousQueue.java:291)
           at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:443)
           at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:475)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-325" daemon prio=1 tid=0x00007f3541d01420 nid=0xf85 in Object.wait() [0x00007f352a183000..0x00007f352a183b90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-324" daemon prio=1 tid=0x00007f3541d00860 nid=0xf84 in Object.wait() [0x00007f352d6c8000..0x00007f352d6c8c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-323" daemon prio=1 tid=0x00007f3541ceed90 nid=0xf83 in Object.wait() [0x00007f3514326000..0x00007f3514326a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-322" daemon prio=1 tid=0x00007f3541dd59b0 nid=0xf82 in Object.wait() [0x00007f35109d4000..0x00007f35109d4b10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-321" daemon prio=1 tid=0x00007f3541283830 nid=0xf81 in Object.wait() [0x00007f35118e3000..0x00007f35118e3d90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-320" daemon prio=1 tid=0x00007f3541cff980 nid=0xf7f in Object.wait() [0x00007f35114df000..0x00007f35114dfe10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-319" daemon prio=1 tid=0x00007f35408967e0 nid=0xf7e in Object.wait() [0x00007f35115e0000..0x00007f35115e0c90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-318" daemon prio=1 tid=0x00007f3540895d00 nid=0xf7d in Object.wait() [0x00007f35116e1000..0x00007f35116e1d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-317" daemon prio=1 tid=0x00007f3540895650 nid=0xf7c in Object.wait() [0x00007f35119e4000..0x00007f35119e4b90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-316" daemon prio=1 tid=0x00007f354107c1c0 nid=0xf7b in Object.wait() [0x00007f3511ae5000..0x00007f3511ae5c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-315" daemon prio=1 tid=0x00007f3540b48010 nid=0xf7a in Object.wait() [0x00007f3533e43000..0x00007f3533e43a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-314" daemon prio=1 tid=0x00007f3540b47200 nid=0xf79 in Object.wait() [0x00007f3511be6000..0x00007f3511be6b10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-313" daemon prio=1 tid=0x00007f35417a76b0 nid=0xf78 in Object.wait() [0x00007f35128f3000..0x00007f35128f3d90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-312" daemon prio=1 tid=0x00007f3542730820 nid=0xf77 in Object.wait() [0x00007f35127f2000..0x00007f35127f2e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-311" daemon prio=1 tid=0x00007f3540c3cb70 nid=0xf76 in Object.wait() [0x00007f35113de000..0x00007f35113dec90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-310" daemon prio=1 tid=0x00007f35429bcf70 nid=0xf75 in Object.wait() [0x00007f350fdc8000..0x00007f350fdc8d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-309" daemon prio=1 tid=0x00007f35426b6ad0 nid=0xf74 in Object.wait() [0x00007f351876a000..0x00007f351876ab90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-308" daemon prio=1 tid=0x00007f3541810710 nid=0xf72 in Object.wait() [0x00007f35108d3000..0x00007f35108d3c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-307" daemon prio=1 tid=0x00007f3540a06cb0 nid=0xf71 in Object.wait() [0x00007f350efba000..0x00007f350efbaa90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-306" daemon prio=1 tid=0x00007f3542907ce0 nid=0xf70 in Object.wait() [0x00007f3510fda000..0x00007f3510fdab10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-305" daemon prio=1 tid=0x00007f3541648090 nid=0xf6f in Object.wait() [0x00007f350f6c1000..0x00007f350f6c1d90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-304" daemon prio=1 tid=0x00007f35416cc420 nid=0xf6e in Object.wait() [0x00007f3510cd7000..0x00007f3510cd7e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-303" daemon prio=1 tid=0x00007f354243b4d0 nid=0xf6d in Object.wait() [0x00007f350ffca000..0x00007f350ffcac90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-302" daemon prio=1 tid=0x00007f3540d5b220 nid=0xf6c in Object.wait() [0x00007f350f5c0000..0x00007f350f5c0d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-301" daemon prio=1 tid=0x00007f3540cc5660 nid=0xf6b in Object.wait() [0x00007f350f3be000..0x00007f350f3beb90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-300" daemon prio=1 tid=0x00007f3541f11040 nid=0xf6a in Object.wait() [0x00007f350ecb7000..0x00007f350ecb7c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-299" daemon prio=1 tid=0x00007f35408900e0 nid=0xf69 in Object.wait() [0x00007f352d9cb000..0x00007f352d9cba90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-298" daemon prio=1 tid=0x00007f3540c3e3b0 nid=0xf68 in Object.wait() [0x00007f350ebb6000..0x00007f350ebb6b10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-297" daemon prio=1 tid=0x00007f3540720050 nid=0xf67 in Object.wait() [0x00007f350e9b4000..0x00007f350e9b4d90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-296" daemon prio=1 tid=0x00007f35424777f0 nid=0xf66 in Object.wait() [0x00007f350edb8000..0x00007f350edb8e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-295" daemon prio=1 tid=0x00007f354071e520 nid=0xf64 in Object.wait() [0x00007f3510ad5000..0x00007f3510ad5c90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-294" daemon prio=1 tid=0x00007f354110beb0 nid=0xf63 in Object.wait() [0x00007f35102cd000..0x00007f35102cdd10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-293" daemon prio=1 tid=0x00007f354159c9c0 nid=0xf62 in Object.wait() [0x00007f35103ce000..0x00007f35103ceb90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-292" daemon prio=1 tid=0x00007f35417a5a00 nid=0xf61 in Object.wait() [0x00007f35106d1000..0x00007f35106d1c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-291" daemon prio=1 tid=0x00007f3540794880 nid=0xf60 in Object.wait() [0x00007f35105d0000..0x00007f35105d0a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-290" daemon prio=1 tid=0x00007f354151afa0 nid=0xf5f in Object.wait() [0x00007f35111dc000..0x00007f35111dcb10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-289" daemon prio=1 tid=0x00007f35409c0720 nid=0xf5e in Object.wait() [0x00007f3513b05000..0x00007f3513b05d90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-288" daemon prio=1 tid=0x00007f35407de460 nid=0xf5c in Object.wait() [0x00007f350f9c4000..0x00007f350f9c4e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-287" daemon prio=1 tid=0x00007f3541af5590 nid=0xf5b in Object.wait() [0x00007f3510ed9000..0x00007f3510ed9c90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-286" daemon prio=1 tid=0x00007f35406a1100 nid=0xf5a in Object.wait() [0x00007f350f8c3000..0x00007f350f8c3d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-285" daemon prio=1 tid=0x00007f3541af8740 nid=0xf59 in Object.wait() [0x00007f350fec9000..0x00007f350fec9b90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-284" daemon prio=1 tid=0x00007f35412649a0 nid=0xf57 in Object.wait() [0x00007f350fac5000..0x00007f350fac5c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-283" daemon prio=1 tid=0x00007f3541d08110 nid=0xf56 in Object.wait() [0x00007f35110db000..0x00007f35110dba90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-282" daemon prio=1 tid=0x00007f3541baaee0 nid=0xf51 in Object.wait() [0x00007f35117e2000..0x00007f35117e2b10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-281" daemon prio=1 tid=0x00007f354161c560 nid=0xf50 in Object.wait() [0x00007f35112dd000..0x00007f35112ddd90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-280" daemon prio=1 tid=0x00007f35411ac6b0 nid=0xf4f in Object.wait() [0x00007f35104cf000..0x00007f35104cfe10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-279" daemon prio=1 tid=0x00007f35417a8b60 nid=0xf4e in Object.wait() [0x00007f350f7c2000..0x00007f350f7c2c90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-278" daemon prio=1 tid=0x00007f3540c23660 nid=0xf4d in Object.wait() [0x00007f35123ee000..0x00007f35123eed10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-277" daemon prio=1 tid=0x00007f3541d04ff0 nid=0xf4c in Object.wait() [0x00007f35122ed000..0x00007f35122edb90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-276" daemon prio=1 tid=0x00007f3541e6d9e0 nid=0xf4b in Object.wait() [0x00007f3510dd8000..0x00007f3510dd8c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-275" daemon prio=1 tid=0x00007f3541e97060 nid=0xf45 in Object.wait() [0x00007f3512af5000..0x00007f3512af5a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-274" daemon prio=1 tid=0x00007f35400e2b30 nid=0xf41 in Object.wait() [0x00007f3516d50000..0x00007f3516d50e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-273" daemon prio=1 tid=0x00007f3541bb0240 nid=0xf40 in Object.wait() [0x00007f3515c3f000..0x00007f3515c3fc90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-272" daemon prio=1 tid=0x00007f354123f250 nid=0xf3f in Object.wait() [0x00007f35125f0000..0x00007f35125f0d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-271" daemon prio=1 tid=0x00007f354022f6d0 nid=0xf3e in Object.wait() [0x00007f3513600000..0x00007f3513600b90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-270" daemon prio=1 tid=0x00007f3542426520 nid=0xf39 in Object.wait() [0x00007f351aa8d000..0x00007f351aa8de10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-269" daemon prio=1 tid=0x00007f3540793bc0 nid=0xf35 in Object.wait() [0x00007f3517c5f000..0x00007f3517c5fc90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-268" daemon prio=1 tid=0x00007f3540c1f7c0 nid=0xf2f in Object.wait() [0x00007f3511fea000..0x00007f3511fead10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-267" daemon prio=1 tid=0x00007f3540eddd00 nid=0xf2e in Object.wait() [0x00007f35121ec000..0x00007f35121ecb90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-266" daemon prio=1 tid=0x00007f3541e61e60 nid=0xf2c in Object.wait() [0x00007f351a588000..0x00007f351a588c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-265" daemon prio=1 tid=0x00007f3540bd8bf0 nid=0xf2b in Object.wait() [0x00007f351a98c000..0x00007f351a98ca90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-264" daemon prio=1 tid=0x00007f35417c5610 nid=0xf24 in Object.wait() [0x00007f352b636000..0x00007f352b636e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-263" daemon prio=1 tid=0x00007f3541e71250 nid=0xf23 in Object.wait() [0x00007f35100cb000..0x00007f35100cbc90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-262" daemon prio=1 tid=0x00007f354151a550 nid=0xf22 in Object.wait() [0x00007f352b838000..0x00007f352b838d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-261" daemon prio=1 tid=0x00007f35411a7d90 nid=0xf1b in Object.wait() [0x00007f3511ee9000..0x00007f3511ee9a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-260" daemon prio=1 tid=0x00007f3540c23ea0 nid=0xf1a in Object.wait() [0x00007f35120eb000..0x00007f35120ebb10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-259" daemon prio=1 tid=0x00007f3541d324e0 nid=0xf19 in Object.wait() [0x00007f351482b000..0x00007f351482bd90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-258" daemon prio=1 tid=0x00007f3541cfc850 nid=0xf15 in Object.wait() [0x00007f350fcc7000..0x00007f350fcc7e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-257" daemon prio=1 tid=0x00007f35417ae2a0 nid=0xf14 in Object.wait() [0x00007f351a88b000..0x00007f351a88bc90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-256" daemon prio=1 tid=0x00007f35419ef1b0 nid=0xf13 in Object.wait() [0x00007f3516649000..0x00007f3516649d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-255" daemon prio=1 tid=0x00007f35419eeec0 nid=0xf12 in Object.wait() [0x00007f3515a3d000..0x00007f3515a3db90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-254" daemon prio=1 tid=0x00007f3540ede260 nid=0xf11 in Object.wait() [0x00007f35129f4000..0x00007f35129f4c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-253" daemon prio=1 tid=0x00007f354107d0d0 nid=0xf0d in Object.wait() [0x00007f350eeb9000..0x00007f350eeb9e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-252" daemon prio=1 tid=0x00007f3541d05bc0 nid=0xf07 in Object.wait() [0x00007f3514d30000..0x00007f3514d30a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-251" daemon prio=1 tid=0x00007f35415abfb0 nid=0xf06 in Object.wait() [0x00007f35132fd000..0x00007f35132fdb10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-250" daemon prio=1 tid=0x00007f3540edfa70 nid=0xf05 in Object.wait() [0x00007f35124ef000..0x00007f35124efd90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-249" daemon prio=1 tid=0x00007f35416112f0 nid=0xf04 in Object.wait() [0x00007f350eab5000..0x00007f350eab5e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-248" daemon prio=1 tid=0x00007f354180dea0 nid=0xefd in Object.wait() [0x00007f35131fc000..0x00007f35131fcd90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-247" daemon prio=1 tid=0x00007f35411b12b0 nid=0xef9 in Object.wait() [0x00007f3513802000..0x00007f3513802d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-246" daemon prio=1 tid=0x00007f3541a20e10 nid=0xef8 in Object.wait() [0x00007f3514023000..0x00007f3514023b90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-245" daemon prio=1 tid=0x00007f354264ae30 nid=0xef7 in Object.wait() [0x00007f3518568000..0x00007f3518568c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-244" daemon prio=1 tid=0x00007f3540a07ac0 nid=0xef6 in Object.wait() [0x00007f3515437000..0x00007f3515437a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-243" daemon prio=1 tid=0x00007f354071c690 nid=0xef4 in Object.wait() [0x00007f3514629000..0x00007f3514629b10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-242" daemon prio=1 tid=0x00007f3540666420 nid=0xef3 in Object.wait() [0x00007f3514b2e000..0x00007f3514b2ed90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-241" daemon prio=1 tid=0x00007f35424733a0 nid=0xef2 in Object.wait() [0x00007f351472a000..0x00007f351472ae10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-240" daemon prio=1 tid=0x00007f3540a07690 nid=0xef1 in Object.wait() [0x00007f3512bf6000..0x00007f3512bf6c90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-239" daemon prio=1 tid=0x00007f35416d02e0 nid=0xef0 in Object.wait() [0x00007f35126f1000..0x00007f35126f1d10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-238" daemon prio=1 tid=0x00007f3542473030 nid=0xeed in Object.wait() [0x00007f3513701000..0x00007f3513701b90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-237" daemon prio=1 tid=0x00007f3541c91140 nid=0xeec in Object.wait() [0x00007f352e1d3000..0x00007f352e1d3c10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-236" daemon prio=1 tid=0x00007f3540c42070 nid=0xeeb in Object.wait() [0x00007f3513a04000..0x00007f3513a04a90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-235" daemon prio=1 tid=0x00007f35407eb1d0 nid=0xeea in Object.wait() [0x00007f3512ef9000..0x00007f3512ef9b10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-234" daemon prio=1 tid=0x00007f3540cfe2d0 nid=0xee9 in Object.wait() [0x00007f3513903000..0x00007f3513903d90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-233" daemon prio=1 tid=0x00007f35417c9830 nid=0xee8 in Object.wait() [0x00007f3512cf7000..0x00007f3512cf7e10]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
           - locked <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
           at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
           at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
           at java.lang.Thread.run(Thread.java:595)
          
          "Messaging Timeout(3)-232" daemon prio=1 tid=0x00007f354107f7a0 nid=0xee7 in Object.wait() [0x00007f35133fe000..0x00007f35133fec90]
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00007f356a4c1c20> (a java.lang.Object)
           at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
          


          • 2. Re: Deadlock stops JMS messages to be processed
            Johan Hedin Newbie

            Another thread dump of the same server. No it has stopped all transacted JMS processing (and hence almost all of the application since it relies on JMS internally).

            johan@localhost ~/jboss-run $ Full thread dump Java HotSpot(TM) 64-Bit Server VM (1.5.0_20-b02 mixed mode):
            
            "WorkManager(2)-332" daemon prio=1 tid=0x0000000042140420 nid=0x1296 in Object.wait() [0x00007f35103ce000..0x00007f35103cec90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-331" daemon prio=1 tid=0x00000000420fe3d0 nid=0x1295 in Object.wait() [0x00007f350edb8000..0x00007f350edb8d10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-341" daemon prio=1 tid=0x00007f35405bd990 nid=0x1294 in Object.wait() [0x00007f352d9cb000..0x00007f352d9cbb90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-330" daemon prio=1 tid=0x000000004323a530 nid=0x1292 in Object.wait() [0x00007f350f3be000..0x00007f350f3bec10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-329" daemon prio=1 tid=0x0000000043acbe20 nid=0x1291 in Object.wait() [0x00007f3514023000..0x00007f3514023a90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-340" daemon prio=1 tid=0x00007f3540a06cb0 nid=0x1290 in Object.wait() [0x00007f350ebb6000..0x00007f350ebb6b10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-328" daemon prio=1 tid=0x00000000435356d0 nid=0x128c in Object.wait() [0x00007f35102cd000..0x00007f35102cdd90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-327" daemon prio=1 tid=0x0000000043b21830 nid=0x128b in Object.wait() [0x00007f3510ad5000..0x00007f3510ad5e10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-339" daemon prio=1 tid=0x00007f3541a20e10 nid=0x128a in Object.wait() [0x00007f350e9b4000..0x00007f350e9b4c90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-326" daemon prio=1 tid=0x0000000043b0d250 nid=0x1287 in Object.wait() [0x00007f350ecb7000..0x00007f350ecb7c10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-325" daemon prio=1 tid=0x0000000042e104b0 nid=0x1286 in Object.wait() [0x00007f3510cd7000..0x00007f3510cd7a90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-338" daemon prio=1 tid=0x00007f35416112f0 nid=0x1285 in Object.wait() [0x00007f350ffca000..0x00007f350ffcab10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-324" daemon prio=1 tid=0x000000004213a520 nid=0x127e in Object.wait() [0x00007f350f5c0000..0x00007f350f5c0a90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-323" daemon prio=1 tid=0x0000000042dc06e0 nid=0x127d in Object.wait() [0x00007f350f6c1000..0x00007f350f6c1b10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-337" daemon prio=1 tid=0x00007f35424777f0 nid=0x127c in Object.wait() [0x00007f350fdc8000..0x00007f350fdc8d90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-336" daemon prio=1 tid=0x00007f35406a1100 nid=0x127a in Object.wait() [0x00007f351876a000..0x00007f351876ae10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-322" daemon prio=1 tid=0x0000000041f8a6a0 nid=0x1279 in Object.wait() [0x00007f350efba000..0x00007f350efbac90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-321" daemon prio=1 tid=0x0000000042df9fa0 nid=0x1278 in Object.wait() [0x00007f3510fda000..0x00007f3510fdad10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-335" daemon prio=1 tid=0x00007f35412649a0 nid=0x1277 in Object.wait() [0x00007f35108d3000..0x00007f35108d3b90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-320" daemon prio=1 tid=0x0000000043911b70 nid=0x1274 in Object.wait() [0x00007f35113de000..0x00007f35113deb10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-319" daemon prio=1 tid=0x000000004213b080 nid=0x1273 in Object.wait() [0x00007f35127f2000..0x00007f35127f2d90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-334" daemon prio=1 tid=0x00007f3542429070 nid=0x1272 in Object.wait() [0x00007f35116e1000..0x00007f35116e1e10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-318" daemon prio=1 tid=0x000000004321a170 nid=0x1271 in Object.wait() [0x00007f35119e4000..0x00007f35119e4c90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-317" daemon prio=1 tid=0x00000000425f17b0 nid=0x1270 in Object.wait() [0x00007f3511be6000..0x00007f3511be6d10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-333" daemon prio=1 tid=0x00007f3541d324e0 nid=0x126f in Object.wait() [0x00007f35114df000..0x00007f35114dfb90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-316" daemon prio=1 tid=0x0000000041fe3050 nid=0x126e in Object.wait() [0x00007f35115e0000..0x00007f35115e0c10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-315" daemon prio=1 tid=0x00000000431f1760 nid=0x126d in Object.wait() [0x00007f3511ae5000..0x00007f3511ae5a90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-332" daemon prio=1 tid=0x00007f354107d0d0 nid=0x126c in Object.wait() [0x00007f3533e43000..0x00007f3533e43b10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-314" daemon prio=1 tid=0x0000000043b0a690 nid=0x126b runnable [0x00007f35109d4000..0x00007f35109d4d90]
             at java.net.SocketInputStream.socketRead0(Native Method)
             at java.net.SocketInputStream.read(SocketInputStream.java:129)
             at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:113)
             at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160)
             at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188)
             - locked <0x00007f35698c3de0> (a com.mysql.jdbc.util.ReadAheadInputStream)
             at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2452)
             at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2906)
             at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2895)
             at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3438)
             at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1951)
             at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2101)
             at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2554)
             - locked <0x00007f35698bc4c8> (a java.lang.Object)
             at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1761)
             at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2046)
             - locked <0x00007f35698bc4c8> (a java.lang.Object)
             at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1964)
             at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1949)
             at com.mysql.jdbc.jdbc2.optional.PreparedStatementWrapper.executeUpdate(PreparedStatementWrapper.java:874)
             at org.jboss.resource.adapter.jdbc.WrappedPreparedStatement.executeUpdate(WrappedPreparedStatement.java:365)
             at org.hibernate.persister.entity.AbstractEntityPersister.update(AbstractEntityPersister.java:2407)
             at org.hibernate.persister.entity.AbstractEntityPersister.updateOrInsert(AbstractEntityPersister.java:2307)
             at org.hibernate.persister.entity.AbstractEntityPersister.update(AbstractEntityPersister.java:2607)
             at org.hibernate.action.EntityUpdateAction.execute(EntityUpdateAction.java:92)
             at org.hibernate.engine.ActionQueue.execute(ActionQueue.java:250)
             at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:234)
             at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:142)
             at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
             at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
             at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
             at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
             at org.hibernate.transaction.CacheSynchronization.beforeCompletion(CacheSynchronization.java:59)
             at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.beforeCompletion(SynchronizationImple.java:114)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.beforeCompletion(TwoPhaseCoordinator.java:247)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:86)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:756)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-313" daemon prio=1 tid=0x00000000431f2d80 nid=0x1265 in Object.wait() [0x00007f351e8cb000..0x00007f351e8cbc10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-312" daemon prio=1 tid=0x00000000435a98b0 nid=0x1264 in Object.wait() [0x00007f351c8ab000..0x00007f351c8aba90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-331" daemon prio=1 tid=0x00007f354081b8e0 nid=0x1263 in Object.wait() [0x00007f351d8bb000..0x00007f351d8bbb10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-311" daemon prio=1 tid=0x00000000420b76f0 nid=0x1262 in Object.wait() [0x00007f351eacd000..0x00007f351eacdd90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-310" daemon prio=1 tid=0x0000000042a7bb10 nid=0x1261 in Object.wait() [0x00007f351bea1000..0x00007f351bea1e10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-330" daemon prio=1 tid=0x00007f35409ec150 nid=0x1260 in Object.wait() [0x00007f35134ff000..0x00007f35134ffc90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-329" daemon prio=1 tid=0x00007f3540ad28b0 nid=0x125f in Object.wait() [0x00007f3516b4e000..0x00007f3516b4ed10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-309" daemon prio=1 tid=0x00000000434e6790 nid=0x1258 in Object.wait() [0x00007f35209ec000..0x00007f35209eca90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-308" daemon prio=1 tid=0x0000000042ba85c0 nid=0x1257 in Object.wait() [0x00007f3520bee000..0x00007f3520beeb10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-328" daemon prio=1 tid=0x00007f354126a800 nid=0x1256 in Object.wait() [0x00007f3521f01000..0x00007f3521f01d90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-307" daemon prio=1 tid=0x0000000042df63f0 nid=0x1255 in Object.wait() [0x00007f351f6d9000..0x00007f351f6d9e10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-306" daemon prio=1 tid=0x00000000431f0300 nid=0x1254 in Object.wait() [0x00007f35212f5000..0x00007f35212f5c90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-327" daemon prio=1 tid=0x00007f3540a42b00 nid=0x1253 in Object.wait() [0x00007f351dcbf000..0x00007f351dcbfd10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-305" daemon prio=1 tid=0x0000000042830b30 nid=0x124e runnable [0x00007f3512ff9000..0x00007f3512ffaa90]
             at java.net.SocketInputStream.socketRead0(Native Method)
             at java.net.SocketInputStream.read(SocketInputStream.java:129)
             at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:113)
             at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160)
             at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188)
             - locked <0x00007f3566191618> (a com.mysql.jdbc.util.ReadAheadInputStream)
             at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2452)
             at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2906)
             at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2895)
             at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3438)
             at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1951)
             at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2101)
             at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2554)
             - locked <0x00007f3566189d28> (a java.lang.Object)
             at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1761)
             at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2046)
             - locked <0x00007f3566189d28> (a java.lang.Object)
             at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1964)
             at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1949)
             at com.mysql.jdbc.jdbc2.optional.PreparedStatementWrapper.executeUpdate(PreparedStatementWrapper.java:874)
             at org.jboss.resource.adapter.jdbc.WrappedPreparedStatement.executeUpdate(WrappedPreparedStatement.java:365)
             at org.hibernate.persister.entity.AbstractEntityPersister.update(AbstractEntityPersister.java:2407)
             at org.hibernate.persister.entity.AbstractEntityPersister.updateOrInsert(AbstractEntityPersister.java:2307)
             at org.hibernate.persister.entity.AbstractEntityPersister.update(AbstractEntityPersister.java:2607)
             at org.hibernate.action.EntityUpdateAction.execute(EntityUpdateAction.java:92)
             at org.hibernate.engine.ActionQueue.execute(ActionQueue.java:250)
             at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:234)
             at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:142)
             at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
             at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
             at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
             at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
             at org.hibernate.transaction.CacheSynchronization.beforeCompletion(CacheSynchronization.java:59)
             at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.beforeCompletion(SynchronizationImple.java:114)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.beforeCompletion(TwoPhaseCoordinator.java:247)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:86)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:756)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-304" daemon prio=1 tid=0x00000000422e08b0 nid=0x124b in Object.wait() [0x00007f3521e00000..0x00007f3521e00e10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-303" daemon prio=1 tid=0x0000000041afa060 nid=0x124a in Object.wait() [0x00007f351eed1000..0x00007f351eed1c90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-326" daemon prio=1 tid=0x00007f3541aa25f0 nid=0x1249 in Object.wait() [0x00007f351fde0000..0x00007f351fde0d10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-302" daemon prio=1 tid=0x0000000042807d00 nid=0x1248 in Object.wait() [0x00007f351f3d6000..0x00007f351f3d6b90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-301" daemon prio=1 tid=0x0000000043c0a6b0 nid=0x1247 in Object.wait() [0x00007f351f8db000..0x00007f351f8dbc10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Thread-57" daemon prio=1 tid=0x00007f3541563a00 nid=0x1029 waiting on condition [0x00007f3514a2d000..0x00007f3514a2dc10]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:807)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1122)
             at java.util.concurrent.SynchronousQueue$Node.waitForPut(SynchronousQueue.java:291)
             at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:443)
             at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:475)
             at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
             at java.lang.Thread.run(Thread.java:595)
            
            "Messaging Timeout(3)-245" daemon prio=1 tid=0x00007f354264ae30 nid=0xef7 in Object.wait() [0x00007f3518568000..0x00007f3518568c10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f356944a100> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "Thread-55" daemon prio=1 tid=0x00007f3540e3b080 nid=0xed0 waiting on condition [0x00007f3510bd6000..0x00007f3510bd6a90]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:807)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1122)
             at java.util.concurrent.SynchronousQueue$Node.waitForPut(SynchronousQueue.java:291)
             at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:443)
             at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:475)
             at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
             at java.lang.Thread.run(Thread.java:595)
            
            "Server.Connection:127.0.0.1:47635" daemon prio=1 tid=0x00007f3540b22130 nid=0xe3f runnable [0x00007f351492c000..0x00007f351492ca90]
             at java.net.SocketInputStream.socketRead0(Native Method)
             at java.net.SocketInputStream.read(SocketInputStream.java:129)
             at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:411)
             at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:453)
             at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:183)
             - locked <0x00007f356a512060> (a java.io.InputStreamReader)
             at java.io.InputStreamReader.read(InputStreamReader.java:167)
             at java.io.BufferedReader.fill(BufferedReader.java:136)
             at java.io.BufferedReader.readLine(BufferedReader.java:299)
             - locked <0x00007f356a512060> (a java.io.InputStreamReader)
             at java.io.BufferedReader.readLine(BufferedReader.java:362)
             at com.arjuna.ats.arjuna.recovery.ActionStatusService.doWork(ActionStatusService.java:135)
             at com.arjuna.ats.internal.arjuna.recovery.Connection.run(Connection.java:83)
            
            "Thread-52" prio=1 tid=0x0000000041e2db90 nid=0xd0e waiting on condition [0x00007f350f0bb000..0x00007f350f0bbe10]
             at java.lang.Thread.sleep(Native Method)
             at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
            
            "Thread-51" prio=1 tid=0x0000000041e2f7e0 nid=0xd0d waiting on condition [0x00007f350f1bc000..0x00007f350f1bcc90]
             at java.lang.Thread.sleep(Native Method)
             at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
            
            "Thread-50" prio=1 tid=0x000000004279fd10 nid=0xd0c waiting on condition [0x00007f350f2bd000..0x00007f350f2bdd10]
             at java.lang.Thread.sleep(Native Method)
             at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
            
            "Thread-49" prio=1 tid=0x00000000427a01d0 nid=0xd0a waiting on condition [0x00007f350f4bf000..0x00007f350f4bfc10]
             at java.lang.Thread.sleep(Native Method)
             at se.ecare.ib.core.cs.CNConnectivityService$CNPollerThread.run(CNConnectivityService.java:313)
            
            "EJB-Timer-1251459704163[target=jboss.j2ee:service=EJB3,ear=ibcs.ear,jar=ibcs-ejb.par,name=FaultLogTruncateSchedulerBean]" prio=1 tid=0x0000000042dbfde0 nid=0xc74 in Object.wait() [0x00007f3514124000..0x00007f3514124c90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f35698e58c8> (a java.util.TaskQueue)
             at java.util.TimerThread.mainLoop(Timer.java:509)
             - locked <0x00007f35698e58c8> (a java.util.TaskQueue)
             at java.util.TimerThread.run(Timer.java:462)
            
            "EJB-Timer-1251459704161[target=jboss.j2ee:service=EJB3,ear=ibcs.ear,jar=ibcs-ejb.par,name=ResendDlqBean]" prio=1 tid=0x000000004203c700 nid=0xc6f in Object.wait() [0x00007f3514427000..0x00007f3514427c10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f35698ce6d8> (a java.util.TaskQueue)
             at java.util.TimerThread.mainLoop(Timer.java:509)
             - locked <0x00007f35698ce6d8> (a java.util.TaskQueue)
             at java.util.TimerThread.run(Timer.java:462)
            
            "EJB-Timer-1251459704160[target=jboss.j2ee:service=EJB3,ear=ibcs.ear,jar=ibcs-ejb.par,name=ExportSchedulerBean]" prio=1 tid=0x000000004282ea40 nid=0xc6a in Object.wait() [0x00007f3514528000..0x00007f3514528a90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f35698b6358> (a java.util.TaskQueue)
             at java.util.TimerThread.mainLoop(Timer.java:509)
             - locked <0x00007f35698b6358> (a java.util.TaskQueue)
             at java.util.TimerThread.run(Timer.java:462)
            
            "WorkManager(2)-288" daemon prio=1 tid=0x0000000043326110 nid=0xc43 waiting on condition [0x00007f351593c000..0x00007f351593cd90]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
             at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
             at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
             at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
             at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
             at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
             at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
             - locked <0x00007f356a4faa70> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
             - locked <0x00007f356a4faa70> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-224" daemon prio=1 tid=0x00000000423b7b70 nid=0xbfb waiting on condition [0x00007f351a184000..0x00007f351a184d90]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
             at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
             at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
             at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
             at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
             at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
             at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
             - locked <0x00007f356a58e5c8> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
             - locked <0x00007f356a58e5c8> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-209" daemon prio=1 tid=0x00000000432a8ae0 nid=0xbe6 waiting on condition [0x00007f351b497000..0x00007f351b497d10]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
             at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
             at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
             at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
             at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
             at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
             at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
             - locked <0x00007f3569b97288> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
             - locked <0x00007f3569b97288> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-195" daemon prio=1 tid=0x00000000420eb760 nid=0xbd7 waiting on condition [0x00007f351c2a5000..0x00007f351c2a5e10]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
             at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
             at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
             at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
             at org.jboss.resource.adapter.jms.JmsXAResource.commit(JmsXAResource.java:95)
             at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.commit(JcaXAResourceWrapper.java:53)
             at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit(XAResourceRecord.java:487)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3107)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doCommit(BasicAction.java:3022)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Commit(BasicAction.java:2126)
             - locked <0x00007f356a5cedd0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1819)
             - locked <0x00007f356a5cedd0> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-181" daemon prio=1 tid=0x000000004350b250 nid=0xbc9 waiting on condition [0x00007f351d0b3000..0x00007f351d0b3b10]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
             at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
             at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
             at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
             at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
             at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
             at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
             - locked <0x00007f3569ac1bf8> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
             - locked <0x00007f3569ac1bf8> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-160" daemon prio=1 tid=0x0000000043359520 nid=0xbb2 in Object.wait() [0x00007f351e3c6000..0x00007f351e3c6b90]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-145" daemon prio=1 tid=0x0000000042806030 nid=0xba3 in Object.wait() [0x00007f351f2d5000..0x00007f351f2d5d10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)
             - locked <0x00007f3559cab960> (a java.lang.Object)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(PooledExecutor.java:736)
             at org.jboss.util.threadpool.MinPooledExecutor.getTask(MinPooledExecutor.java:106)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:760)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-140" daemon prio=1 tid=0x0000000041afb750 nid=0xb9c waiting on condition [0x00007f351f7da000..0x00007f351f7dad90]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
             at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
             at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
             at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
             at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
             at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
             at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
             - locked <0x00007f3569bece70> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
             - locked <0x00007f3569bece70> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
             at java.lang.Thread.run(Thread.java:595)
            
            "WorkManager(2)-130" daemon prio=1 tid=0x0000000042448ee0 nid=0xb8c waiting on condition [0x00007f35203e6000..0x00007f35203e6b90]
             at sun.misc.Unsafe.park(Native Method)
             at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
             at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
             at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
             at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
             at org.jboss.resource.adapter.jms.JmsManagedConnection.lock(JmsManagedConnection.java:392)
             at org.jboss.resource.adapter.jms.JmsXAResource.end(JmsXAResource.java:69)
             at org.jboss.resource.connectionmanager.xa.JcaXAResourceWrapper.end(JcaXAResourceWrapper.java:58)
             at com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare(XAResourceRecord.java:259)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2871)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2828)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2382)
             - locked <0x00007f3569b76790> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1783)
             - locked <0x00007f3569b76790> (a com.arjuna.ats.internal.jta.transaction.arjunacore.AtomicAction)
             at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:88)
             at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:177)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1389)
             at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:135)
             at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:87)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.end(JmsServerSession.java:494)
             at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:248)
             at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:204)
             at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:275)
             at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:761)
             at java.lang.Thread.run(Thread.java:595)
            
            "TimeoutFactory-0" daemon prio=1 tid=0x00000000432b7280 nid=0xb71 in Object.wait() [0x00007f3521cff000..0x00007f3521cffc10]
             at java.lang.Object.wait(Native Method)
             - waiting on <0x00007f35693efc48> (a java.lang.Object)
             at org.jboss.util.timeout.TimeoutPriorityQueueImpl.poll(TimeoutPriorityQueueImpl.java:271)
             - locked <0x00007f35693efc48> (a java.lang.Object)
             at org.jboss.util.timeout.Timeo


            • 3. Solved: Deadlock stops JMS messages to be processed
              Johan Hedin Newbie

              Found the solution

              https://jira.jboss.org/jira/browse/JBAS-5801

              Adding <track-connection-by-tx/> to hajndi-jms-ds.xml did make 4.2.3 + JBoss messaging 1.4.4 run with heavy load for 36h without a single hang thread

              • 4. Re: Deadlock stops JMS messages to be processed
                Yong Hao Gao Master

                good to know you have a solution. :)