0 Replies Latest reply on Nov 27, 2009 1:08 PM by jmesnil

    test suite hanging on NettyProducerFlowControlTest.testFlowC

    jmesnil

      I had the test suite hanging while executing NettyProducerFlowControlTest.testFlowControlLargerMessagesSmallWindowSize.

      For the record, the logs:

       [junit] [main] 19:03:43,764 INFO [org.hornetq.tests.util.UnitTestCase] ###### starting test org.hornetq.tests.integration.client.NettyProducerFlowControlTest.testFlowControlLargerMessagesSmallWindowSize
       [junit] [main] 19:03:43,765 INFO [org.hornetq.core.server.impl.HornetQServerImpl] live server is starting..
       [junit] [main] 19:03:43,765 WARNING [org.hornetq.core.management.impl.ManagementServiceImpl] It has been detected that the cluster admin user and password which are used to replicate management operation from one node to the other have not been changed from the installation default. Please see the HornetQ user guide for instructions on how to do this.
       [junit] [main] 19:03:43,770 INFO [org.hornetq.integration.transports.netty.NettyAcceptor] Started Netty Acceptor version 3.1.5.GA-r1772
       [junit] [main] 19:03:43,772 INFO [org.hornetq.core.server.impl.HornetQServerImpl] HornetQ Server version 2.0.0.BETA5 (hornet-baby, 108) started
       [junit] [main] 19:03:43,780 INFO [org.hornetq.tests.integration.client.ProducerFlowControlTest] created consumer
       [junit] [GC 41635K->25806K(198004K), 0.0064505 secs]
       [junit] [GC 41805K->25644K(198004K), 0.0026597 secs]
       [junit] [GC 41644K->25615K(198004K), 0.0029785 secs]
      


      and the corresponding kill -3

       [junit] 2009-11-27 19:05:12
       [junit] Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.1-b02-90 mixed mode):
       [junit]
       [junit] "New I/O server worker #19-1" prio=5 tid=0x0000000102323000 nid=0x151598000 runnable [0x0000000151597000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
       [junit] at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136)
       [junit] at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
       [junit] at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
       [junit] - locked <0x00000001071c9cd0> (a sun.nio.ch.Util$1)
       [junit] - locked <0x00000001071c9cb8> (a java.util.Collections$UnmodifiableSet)
       [junit] - locked <0x00000001071c9c40> (a sun.nio.ch.KQueueSelectorImpl)
       [junit] at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
       [junit] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:158)
       [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
       [junit] at org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:46)
       [junit] at org.jboss.netty.util.VirtualExecutorService$ChildExecutorRunnable.run(VirtualExecutorService.java:179)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "hornetq-failure-check-thread" prio=5 tid=0x0000000102ba7000 nid=0x15118c000 in Object.wait() [0x000000015118b000]
       [junit] java.lang.Thread.State: TIMED_WAITING (on object monitor)
       [junit] at java.lang.Object.wait(Native Method)
       [junit] at org.hornetq.core.remoting.server.impl.RemotingServiceImpl$FailureCheckThread.run(RemotingServiceImpl.java:522)
       [junit] - locked <0x00000001071b0118> (a org.hornetq.core.remoting.server.impl.RemotingServiceImpl$FailureCheckThread)
       [junit]
       [junit] "New I/O server boss #19 (channelId: 988800765, /127.0.0.1:5445)" prio=5 tid=0x0000000102e69800 nid=0x1508b5000 runnable [0x00000001508b4000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
       [junit] at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136)
       [junit] at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
       [junit] at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
       [junit] - locked <0x00000001071b0340> (a sun.nio.ch.Util$1)
       [junit] - locked <0x00000001071b0358> (a java.util.Collections$UnmodifiableSet)
       [junit] - locked <0x00000001071b02c8> (a sun.nio.ch.KQueueSelectorImpl)
       [junit] at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
       [junit] at org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink$Boss.run(NioServerSocketPipelineSink.java:223)
       [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
       [junit] at org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:46)
       [junit] at org.jboss.netty.util.VirtualExecutorService$ChildExecutorRunnable.run(VirtualExecutorService.java:179)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "Thread-0 (group:HornetQ-scheduled-threads-212437262)" prio=5 tid=0x0000000102dfd800 nid=0x1507b2000 waiting on condition [0x00000001507b1000]
       [junit] java.lang.Thread.State: TIMED_WAITING (parking)
       [junit] at sun.misc.Unsafe.park(Native Method)
       [junit] - parking to wait for <0x00000001071ca288> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
       [junit] at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
       [junit] at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
       [junit] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "hornetq-expiry-reaper-thread" prio=3 tid=0x0000000102dfe000 nid=0x150536000 in Object.wait() [0x0000000150535000]
       [junit] java.lang.Thread.State: TIMED_WAITING (on object monitor)
       [junit] at java.lang.Object.wait(Native Method)
       [junit] at org.hornetq.core.postoffice.impl.PostOfficeImpl$Reaper.run(PostOfficeImpl.java:1053)
       [junit] - locked <0x00000001071b0538> (a org.hornetq.core.postoffice.impl.PostOfficeImpl$Reaper)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "New I/O client worker #22-1" daemon prio=5 tid=0x000000010232c000 nid=0x1518d1000 runnable [0x00000001518d0000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
       [junit] at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136)
       [junit] at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
       [junit] at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
       [junit] - locked <0x00000001071b1ae8> (a sun.nio.ch.Util$1)
       [junit] - locked <0x00000001071b1ad0> (a java.util.Collections$UnmodifiableSet)
       [junit] - locked <0x00000001071b14f8> (a sun.nio.ch.KQueueSelectorImpl)
       [junit] at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
       [junit] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:158)
       [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
       [junit] at org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:46)
       [junit] at org.jboss.netty.util.VirtualExecutorService$ChildExecutorRunnable.run(VirtualExecutorService.java:179)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "Thread-4 (group:HornetQ-client-global-scheduled-threads-393978767)" daemon prio=5 tid=0x00000001020ff800 nid=0x151495000 waiting on condition [0x0000000151494000]
       [junit] java.lang.Thread.State: TIMED_WAITING (parking)
       [junit] at sun.misc.Unsafe.park(Native Method)
       [junit] - parking to wait for <0x0000000108ead668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
       [junit] at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
       [junit] at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
       [junit] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "Thread-3 (group:HornetQ-client-global-scheduled-threads-393978767)" daemon prio=5 tid=0x00000001029c2800 nid=0x151089000 waiting on condition [0x0000000151088000]
       [junit] java.lang.Thread.State: TIMED_WAITING (parking)
       [junit] at sun.misc.Unsafe.park(Native Method)
       [junit] - parking to wait for <0x0000000108ead668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
       [junit] at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
       [junit] at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
       [junit] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "Thread-2 (group:HornetQ-client-global-scheduled-threads-393978767)" daemon prio=5 tid=0x00000001029c1000 nid=0x150e83000 waiting on condition [0x0000000150e82000]
       [junit] java.lang.Thread.State: TIMED_WAITING (parking)
       [junit] at sun.misc.Unsafe.park(Native Method)
       [junit] - parking to wait for <0x0000000108ead668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
       [junit] at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
       [junit] at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
       [junit] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "Thread-1 (group:HornetQ-client-global-scheduled-threads-393978767)" daemon prio=5 tid=0x0000000102a94800 nid=0x150d80000 waiting on condition [0x0000000150d7f000]
       [junit] java.lang.Thread.State: TIMED_WAITING (parking)
       [junit] at sun.misc.Unsafe.park(Native Method)
       [junit] - parking to wait for <0x0000000108ead668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
       [junit] at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
       [junit] at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
       [junit] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "Thread-0 (group:HornetQ-client-global-scheduled-threads-393978767)" daemon prio=5 tid=0x0000000102a93800 nid=0x150c7d000 waiting on condition [0x0000000150c7c000]
       [junit] java.lang.Thread.State: TIMED_WAITING (parking)
       [junit] at sun.misc.Unsafe.park(Native Method)
       [junit] - parking to wait for <0x0000000108ead668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
       [junit] at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
       [junit] at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
       [junit] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
       [junit] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
       [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
       [junit] at java.lang.Thread.run(Thread.java:637)
       [junit]
       [junit] "Low Memory Detector" daemon prio=5 tid=0x0000000102850000 nid=0x15020d000 runnable [0x0000000000000000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit]
       [junit] "CompilerThread1" daemon prio=9 tid=0x0000000102068000 nid=0x15010a000 waiting on condition [0x0000000000000000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit]
       [junit] "CompilerThread0" daemon prio=9 tid=0x0000000102067000 nid=0x150007000 waiting on condition [0x0000000000000000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit]
       [junit] "Signal Dispatcher" daemon prio=9 tid=0x000000010284f800 nid=0x14ff04000 waiting on condition [0x0000000000000000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit]
       [junit] "Surrogate Locker Thread (CMS)" daemon prio=5 tid=0x0000000102066800 nid=0x14fe01000 waiting on condition [0x0000000000000000]
       [junit] java.lang.Thread.State: RUNNABLE
       [junit]
       [junit] "Finalizer" daemon prio=8 tid=0x000000010284e800 nid=0x14f90e000 in Object.wait() [0x000000014f90d000]
       [junit] java.lang.Thread.State: WAITING (on object monitor)
       [junit] at java.lang.Object.wait(Native Method)
       [junit] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
       [junit] - locked <0x0000000108bc4628> (a java.lang.ref.ReferenceQueue$Lock)
       [junit] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
       [junit] at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
       [junit]
       [junit] "Reference Handler" daemon prio=10 tid=0x000000010284e000 nid=0x14f80b000 in Object.wait() [0x000000014f80a000]
       [junit] java.lang.Thread.State: WAITING (on object monitor)
       [junit] at java.lang.Object.wait(Native Method)
       [junit] at java.lang.Object.wait(Object.java:485)
       [junit] at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
       [junit] - locked <0x0000000108bc0848> (a java.lang.ref.Reference$Lock)
       [junit]
       [junit] "main" prio=5 tid=0x0000000102800800 nid=0x101301000 waiting on condition [0x00000001012ff000]
       [junit] java.lang.Thread.State: WAITING (parking)
       [junit] at sun.misc.Unsafe.park(Native Method)
       [junit] - parking to wait for <0x00000001071cf870> (a java.util.concurrent.Semaphore$NonfairSync)
       [junit] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
       [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
       [junit] at java.util.concurrent.Semaphore.acquire(Semaphore.java:441)
       [junit] at org.hornetq.core.client.impl.ClientProducerCreditsImpl.acquireCredits(ClientProducerCreditsImpl.java:69)
       [junit] at org.hornetq.core.client.impl.ClientProducerImpl.doSend(ClientProducerImpl.java:273)
       [junit] at org.hornetq.core.client.impl.ClientProducerImpl.send(ClientProducerImpl.java:133)
       [junit] at org.hornetq.tests.integration.client.ProducerFlowControlTest.testFlowControl(ProducerFlowControlTest.java:302)
       [junit] at org.hornetq.tests.integration.client.ProducerFlowControlTest.testFlowControl(ProducerFlowControlTest.java:154)
       [junit] at org.hornetq.tests.integration.client.ProducerFlowControlTest.testFlowControlLargerMessagesSmallWindowSize(ProducerFlowControlTest.java:95)
       [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       [junit] at java.lang.reflect.Method.invoke(Method.java:597)
       [junit] at junit.framework.TestCase.runTest(TestCase.java:164)
       [junit] at junit.framework.TestCase.runBare(TestCase.java:130)
       [junit] at junit.framework.TestResult$1.protect(TestResult.java:106)
       [junit] at junit.framework.TestResult.runProtected(TestResult.java:124)
       [junit] at junit.framework.TestResult.run(TestResult.java:109)
       [junit] at junit.framework.TestCase.run(TestCase.java:120)
       [junit] at junit.framework.TestSuite.runTest(TestSuite.java:230)
       [junit] at junit.framework.TestSuite.run(TestSuite.java:225)
       [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
       [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
       [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:743)
       [junit]
       [junit] "VM Thread" prio=9 tid=0x0000000102847000 nid=0x14f708000 runnable
       [junit]
       [junit] "Gang worker#0 (Parallel GC Threads)" prio=9 tid=0x0000000102802000 nid=0x106102000 runnable
       [junit]
       [junit] "Gang worker#1 (Parallel GC Threads)" prio=9 tid=0x0000000102802800 nid=0x106205000 runnable
       [junit]
       [junit] "Concurrent Mark-Sweep GC Thread" prio=9 tid=0x0000000102041000 nid=0x14f3d2000 runnable
       [junit] "VM Periodic Task Thread" prio=10 tid=0x0000000102851000 nid=0x150310000 waiting on condition
       [junit]
       [junit] "Exception Catcher Thread" prio=10 tid=0x0000000102801800 nid=0x101701000 runnable
       [junit] JNI global references: 1027
       [junit]
       [junit] Heap
       [junit] par new generation total 18624K, used 2544K [0x0000000106210000, 0x00000001076d0000, 0x0000000108ba0000)
       [junit] eden space 16000K, 13% used [0x0000000106210000, 0x000000010643f640, 0x00000001071b0000)
       [junit] from space 2624K, 11% used [0x00000001071b0000, 0x00000001071fcc50, 0x0000000107440000)
       [junit] to space 2624K, 0% used [0x0000000107440000, 0x0000000107440000, 0x00000001076d0000)
       [junit] concurrent mark-sweep generation total 179380K, used 25308K [0x0000000108ba0000, 0x0000000113acd000, 0x0000000146210000)
       [junit] concurrent-mark-sweep perm gen total 27276K, used 16682K [0x0000000146210000, 0x0000000147cb3000, 0x000000014b610000)
       [junit]
       [junit] [Full GC 27853K->7781K(198004K), 0.2222782 secs]
       [junit]
       [junit] num #instances #bytes class name
       [junit] ----------------------------------------------
       [junit] 1: 26632 3399160 <constMethodKlass>
       [junit] 2: 26632 3204576 <methodKlass>
       [junit] 3: 3626 2412296 [B
       [junit] 4: 2287 2400560 <constantPoolKlass>
       [junit] 5: 37138 1849864 <symbolKlass>
       [junit] 6: 10324 1754288 [C
       [junit] 7: 2287 1751728 <instanceKlassKlass>
       [junit] 8: 2033 1549696 <constantPoolCacheKlass>
       [junit] 9: 1566 677528 <methodDataKlass>
       [junit] 10: 2480 456320 java.lang.Class
       [junit] 11: 10876 435040 java.lang.String
       [junit] 12: 7200 345600 java.util.concurrent.locks.ReentrantLock$NonfairSync
       [junit] 13: 3686 337920 [[I
       [junit] 14: 6512 312576 java.util.concurrent.ConcurrentHashMap$Segment
       [junit] 15: 1917 291384 java.lang.reflect.Method
       [junit] 16: 1617 258720 org.hornetq.core.persistence.impl.journal.FileLargeServerMessage
       [junit] 17: 3323 242552 [S
       [junit] 18: 6512 234608 [Ljava.util.concurrent.ConcurrentHashMap$HashEntry;
       [junit] 19: 1794 216368 [Ljava.util.HashMap$Entry;
       [junit] 20: 1636 183232 org.hornetq.core.journal.impl.NIOSequentialFile
       [junit] 21: 1493 153576 [Ljava.lang.Object;
       [junit] 22: 2403 149936 [I
       [junit] 23: 1947 124608 java.lang.ref.Finalizer
       [junit] 24: 5149 123576 java.util.concurrent.atomic.AtomicInteger
       [junit] 25: 2495 119760 java.util.HashMap$Entry
       [junit] 26: 1602 102528 java.util.HashMap
       [junit] 27: 164 94464 <objArrayKlassKlass>
       [junit] 28: 2228 68272 [Ljava.lang.Class;
       [junit] 29: 407 61864 [Ljava.util.concurrent.ConcurrentHashMap$Segment;
       [junit] 30: 1234 59232 java.util.Hashtable$Entry
       [junit] 31: 795 57240 java.lang.ThreadGroup
       [junit] 32: 1658 53056 java.io.File
       [junit] 33: 1618 51776 org.hornetq.utils.TypedProperties
       [junit] 34: 779 44584 [Ljava.lang.Thread;
       [junit] 35: 1772 42528 java.util.concurrent.atomic.AtomicLong
       [junit] 36: 1636 39264 org.hornetq.core.journal.impl.AbstractSequentialFile$LocalBufferObserver
       [junit] 37: 288 36864 java.lang.reflect.Field
       [junit] 38: 573 36672 java.util.LinkedHashMap$Entry
       [junit] 39: 551 30856 org.apache.xerces.dom.AttrImpl
       [junit] 40: 250 30000 java.lang.reflect.Constructor
       [junit] 41: 407 29304 java.util.concurrent.ConcurrentHashMap
       [junit] 42: 687 27480 org.hornetq.utils.SimpleString
       [junit] 43: 570 27360 java.util.concurrent.ConcurrentHashMap$HashEntry
       [junit] 44: 272 23936 org.apache.xerces.dom.ElementImpl
       [junit] 45: 410 22728 [Ljava.lang.String;
       [junit] 46: 451 21648 java.lang.ref.WeakReference
       [junit] 47: 539 21560 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject
       [junit] 48: 63 20624 [Ljava.util.Hashtable$Entry;
       [junit] 49: 362 20272 java.lang.ref.SoftReference
       [junit] 50: 218 19184 java.util.concurrent.FutureTask$Sync
       [junit] 51: 185 19016 [Ljava.lang.reflect.Method;
       [junit] 52: 465 18600 java.util.LinkedList$Entry
       [junit] 53: 427 17080 java.util.ArrayList
       [junit] 54: 142 15904 java.util.logging.Logger
       [junit] 55: 650 15600 java.util.HashMap$EntrySet
       [junit] 56: 387 15480 java.util.Vector
       [junit] 57: 317 15216 javax.management.MBeanParameterInfo
       [junit] 58: 190 15200 java.util.LinkedHashMap
       [junit] 59: 145 15080 java.net.URL
       [junit] 60: 615 14760 org.hornetq.utils.TypedProperties$IntValue
       [junit] 61: 576 13824 java.util.concurrent.locks.ReentrantLock
       [junit] 62: 549 13176 java.lang.Long
       [junit] 63: 69 12848 [Ljavax.management.MBeanAttributeInfo;
       [junit] 64: 218 12208 java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask
       [junit] 65: 271 10840 org.apache.xerces.dom.AttributeMap
       [junit] 66: 269 10760 org.hornetq.core.journal.impl.JournalImpl$JournalRecord
       [junit] 67: 110 10560 java.lang.Package
       [junit] 68: 314 10048 java.util.jar.Attributes$Name
       [junit] 69: 303 9696 <compiledICHolderKlass>
       [junit] 70: 132 9504 java.util.WeakHashMap$Entry
       [junit] 71: 235 9400 sun.reflect.NativeMethodAccessorImpl
       [junit] 72: 233 9320 java.util.LinkedList
       [junit] 73: 42 9072 java.text.DecimalFormat
       [junit] 74: 85 8840 java.util.concurrent.ThreadPoolExecutor
       [junit] 75: 69 8832 org.hornetq.core.remoting.impl.ChannelImpl
       [junit] 76: 153 8568 javax.management.MBeanAttributeInfo
       [junit] 77: 214 8560 org.hornetq.utils.Pair
       [junit] 78: 209 8360 java.util.logging.LogManager$LogNode
       [junit] 79: 2 8272 [Ljava.lang.ThreadGroup;
       [junit] 80: 146 8176 java.util.concurrent.locks.AbstractQueuedSynchronizer$Node
       [junit] 81: 333 7992 java.lang.Integer
       [junit] 82: 113 7232 javax.management.MBeanOperationInfo
       [junit] 83: 37 7104 org.hornetq.core.paging.impl.PagingStoreImpl
       [junit] 84: 218 6976 java.util.concurrent.Executors$RunnableAdapter
       [junit] 85: 426 6816 java.lang.Object
       [junit] 86: 166 6640 javax.management.ImmutableDescriptor
       [junit] 87: 81 6480 java.nio.DirectByteBuffer
       [junit] 88: 18 6336 org.hornetq.core.config.impl.ConfigurationImpl
       [junit] 89: 192 6144 org.hornetq.core.postoffice.impl.DuplicateIDCacheImpl$ByteArrayHolder
       [junit] 90: 62 6136 [Ljavax.management.MBeanOperationInfo;
       [junit] 91: 255 6120 java.util.HashSet
       [junit] 92: 33 6040 [Ljava.util.WeakHashMap$Entry;
       [junit] 93: 81 5832 sun.misc.Cleaner
       [junit] 94: 90 5760 java.util.TreeMap$Entry
       [junit] 95: 237 5688 sun.reflect.DelegatingMethodAccessorImpl
       [junit] 96: 68 5440 javax.management.MBeanInfo
       [junit] 97: 112 5376 org.jboss.netty.util.internal.ConcurrentHashMap$Segment
       [junit] 98: 18 5328 org.hornetq.core.server.impl.HornetQServerImpl
       [junit] 99: 66 5280 java.util.concurrent.LinkedBlockingQueue
       [junit] 100: 93 5208 java.lang.ThreadLocal$ThreadLocalMap$Entry
       [junit] 101: 80 5120 java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync
       [junit] 102: 212 5088 java.util.HashMap$KeySet
       [junit] 103: 105 5040 com.sun.jmx.mbeanserver.ConvertingMethod
       [junit] 104: 30 5040 java.lang.Thread
       [junit] 105: 26 4992 org.hornetq.core.journal.impl.JournalImpl
       [junit] 106: 44 4928 java.util.jar.JarFile$JarFileEntry
       [junit] 107: 19 4808 [Ljava.lang.ThreadLocal$ThreadLocalMap$Entry;
       [junit] 108: 199 4776 org.hornetq.core.client.impl.FailoverManagerImpl$ActualScheduled
       [junit] 109: 33 4752 org.jboss.netty.util.internal.LinkedTransferQueue$PaddedAtomicReference
       [junit] 110: 86 4664 [Ljavax.management.MBeanParameterInfo;
       [junit] 111: 116 4640 sun.security.util.ObjectIdentifier
       [junit] 112: 58 4640 java.util.jar.JarFile
       [junit] 113: 72 4608 org.hornetq.utils.concurrent.LinkedBlockingDeque
       [junit] 114: 8 4608 <typeArrayKlassKlass>
       [junit] 115: 95 4560 org.hornetq.utils.OrderedExecutorFactory$OrderedExecutor
       [junit] 116: 38 4256 org.hornetq.core.settings.impl.AddressSettings
       [junit] 117: 126 4184 [Ljava.lang.reflect.Constructor;
       [junit] 118: 18 4176 org.hornetq.core.client.impl.FailoverManagerImpl
       [junit] 119: 58 4176 sun.misc.URLClassPath$JarLoader
       [junit] 120: 168 4032 java.util.jar.Attributes
       [junit] 121: 42 4032 java.text.DecimalFormatSymbols
       [junit] 122: 82 3936 java.math.BigInteger
       [junit] 123: 18 3888 org.hornetq.core.client.impl.ClientSessionFactoryImpl
       [junit] 124: 19 3648 org.hornetq.core.remoting.server.impl.RemotingServiceImpl$FailureCheckThread
       [junit] 125: 32 3584 javax.management.openmbean.OpenMBeanAttributeInfoSupport
       [junit] 126: 112 3584 [Lorg.jboss.netty.util.internal.ConcurrentHashMap$HashEntry;
       [junit] 127: 64 3584 sun.security.pkcs11.SunPKCS11$Descriptor
       [junit] 128: 22 3520 org.hornetq.core.client.impl.ClientSessionImpl
       [junit] 129: 146 3504 org.hornetq.core.logging.Logger
       [junit] 130: 146 3504 org.hornetq.core.logging.impl.JULLogDelegate
       [junit] 131: 54 3456 java.util.Hashtable
       [junit] 132: 142 3408 java.util.HashMap$Values
       [junit] 133: 105 3360 java.util.concurrent.CopyOnWriteArrayList
       [junit] 134: 19 3344 org.hornetq.core.management.impl.ManagementServiceImpl
       [junit] 135: 32 3328 java.security.Provider$Service
       [junit] 136: 135 3240 java.util.concurrent.ConcurrentHashMap$Values
       [junit] 137: 112 3240 [Lcom.sun.jmx.mbeanserver.OpenConverter;
       [junit] 138: 32 2928 [Ljava.lang.reflect.Field;
       [junit] 139: 73 2920 sun.reflect.NativeConstructorAccessorImpl
       [junit] 140: 72 2880 java.security.Provider$ServiceKey
       [junit] 141: 19 2736 org.hornetq.core.postoffice.impl.PostOfficeImpl
       [junit] 142: 42 2688 java.text.DigitList
       [junit] 143: 84 2688 java.util.concurrent.locks.ReentrantReadWriteLock$Sync$HoldCounter
       [junit] 144: 67 2680 java.util.concurrent.locks.ReentrantReadWriteLock
       [junit] 145: 66 2640 sun.reflect.generics.tree.SimpleClassTypeSignature
       [junit] 146: 66 2640 com.sun.jmx.mbeanserver.PerInterface$MethodAndSig
       [junit] 147: 81 2592 java.nio.DirectByteBuffer$Deallocator
       [junit] 148: 23 2576 org.hornetq.core.remoting.impl.RemotingConnectionImpl
       [junit] 149: 63 2520 sun.reflect.annotation.AnnotationInvocationHandler
       [junit] 150: 37 2368 org.hornetq.core.settings.impl.HierarchicalObjectRepository
       [junit] 151: 6 2352 [J
       [junit] 152: 12 2304 <klassKlass>
       [junit] 153: 19 2280 org.hornetq.core.remoting.server.impl.RemotingServiceImpl
       [junit] 154: 95 2280 org.hornetq.utils.OrderedExecutorFactory$OrderedExecutor$1
       [junit] 155: 20 2240 java.util.concurrent.ScheduledThreadPoolExecutor
       [junit] 156: 40 2240 org.hornetq.core.journal.impl.NIOSequentialFileFactory
       [junit] 157: 46 2208 java.util.concurrent.SynchronousQueue
       [junit] 158: 91 2184 sun.reflect.DelegatingConstructorAccessorImpl
       [junit] 159: 45 2160 java.util.zip.Inflater
       [junit] 160: 38 2128 java.io.ObjectStreamField
       [junit] 161: 53 2120 org.hornetq.utils.HornetQThreadFactory
       [junit] 162: 66 2112 java.util.concurrent.LinkedBlockingQueue$Node
       [junit] 163: 22 2112 java.util.regex.Pattern
       [junit] 164: 20 2080 sun.reflect.DelegatingClassLoader
       [junit] 165: 65 2080 java.util.concurrent.ConcurrentLinkedQueue$Node
       [junit] 166: 52 2080 java.util.concurrent.Executors$DefaultThreadFactory
       [junit] 167: 1 2072 [Ljava.lang.Integer;
       [junit] 168: 1 2072 [Ljava.lang.Long;
       [junit] 169: 64 2048 java.util.concurrent.ConcurrentLinkedQueue
       [junit] 170: 28 2016 java.util.WeakHashMap
       [junit] 171: 80 1920 java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock
       [junit] 172: 80 1920 java.util.concurrent.locks.ReentrantReadWriteLock$Sync$ThreadLocalHoldCounter
       [junit] 173: 77 1848 org.hornetq.utils.OrderedExecutorFactory
       [junit] 174: 74 1776 java.util.concurrent.atomic.AtomicBoolean
       [junit] 175: 54 1728 java.util.Collections$SingletonList
       [junit] 176: 42 1680 java.lang.ref.ReferenceQueue
       [junit] 177: 19 1672 org.hornetq.core.management.impl.HornetQServerControlImpl
       [junit] 178: 66 1664 [Lsun.reflect.generics.tree.TypeArgument;
       [junit] 179: 13 1664 org.hornetq.core.journal.impl.TimedBuffer
       [junit] 180: 67 1608 java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock
       [junit] 181: 13 1560 org.hornetq.core.persistence.impl.journal.JournalStorageManager
       [junit] 182: 63 1512 org.hornetq.utils.ConcurrentHashSet
       [junit] 183: 37 1480 org.hornetq.core.config.TransportConfiguration
       [junit] 184: 18 1440 java.util.TreeMap
       [junit] 185: 30 1440 java.security.Provider$EngineDescription
       [junit] 186: 45 1440 org.hornetq.utils.SimpleIDGenerator
       [junit] 187: 22 1408 org.hornetq.core.remoting.impl.invm.InVMConnector
       [junit] 188: 19 1368 org.hornetq.core.paging.impl.PagingManagerImpl
       [junit] 189: 19 1368 org.hornetq.core.transaction.impl.ResourceManagerImpl
       [junit] 190: 15 1320 javax.management.openmbean.ArrayType
       [junit] 191: 12 1296 [Z
       [junit] 192: 32 1280 sun.security.util.DerInputBuffer
       [junit] 193: 32 1280 com.sun.jmx.mbeanserver.OpenConverter$IdentityConverter
       [junit] 194: 32 1280 sun.security.util.DerValue
       [junit] 195: 35 1240 [Ljavax.management.ObjectName$Property;
       [junit] 196: 19 1216 org.hornetq.core.journal.impl.JournalFileImpl
       [junit] 197: 19 1216 org.hornetq.core.paging.impl.PagingStoreFactoryNIO
       [junit] 198: 30 1200 sun.security.x509.RDN
       [junit] 199: 37 1184 org.hornetq.core.server.impl.ServerProducerCreditManagerImpl
       [junit] 200: 21 1176 javax.management.MBeanNotificationInfo
       [junit] 201: 21 1176 org.hornetq.core.remoting.impl.invm.InVMConnection
       [junit] 202: 18 1152 org.hornetq.core.remoting.impl.invm.InVMAcceptor
       [junit] 203: 10 1120 sun.nio.cs.MacRoman$Encoder
       [junit] 204: 23 1104 java.util.regex.Pattern$Curly
       [junit] 205: 46 1104 java.util.concurrent.SynchronousQueue$TransferStack
       [junit] 206: 45 1080 java.util.concurrent.ConcurrentHashMap$KeySet
       [junit] 207: 19 1064 org.hornetq.core.server.impl.QueueFactoryImpl
       [junit] 208: 19 1064 org.hornetq.core.messagecounter.impl.MessageCounterManagerImpl
       [junit] 209: 36 1064 [Ljavax.management.MBeanConstructorInfo;
       [junit] 210: 19 1064 org.hornetq.core.postoffice.impl.WildcardAddressManager
       [junit] 211: 7 1064 [Lorg.jboss.netty.util.internal.ConcurrentHashMap$Segment;
       [junit] 212: 11 1056 org.hornetq.core.transaction.impl.TransactionImpl
       [junit] 213: 22 1056 sun.security.x509.OIDMap$OIDInfo
       [junit] 214: 22 1056 java.lang.Exception
       [junit] 215: 43 1032 $Proxy5
       [junit] 216: 16 1024 com.sun.jmx.mbeanserver.MXBeanSupport
       [junit] 217: 32 1024 sun.security.util.DerInputStream
       [junit] 218: 21 1008 java.security.AccessControlContext
       [junit] 219: 14 1008 javax.management.openmbean.SimpleType
       [junit] 220: 18 1008 javax.management.ObjectName
       [junit] 221: 30 960 sun.security.x509.AVA
       [junit] 222: 30 960 [Lsun.security.x509.AVA;
       [junit] 223: 15 960 com.sun.jmx.mbeanserver.PerInterface
       [junit] 224: 17 952 com.sun.jmx.mbeanserver.WeakIdentityHashMap$IdentityWeakReference
       [junit] 225: 39 936 java.util.concurrent.Executors$FinalizableDelegatedExecutorService
       [junit] 226: 29 928 java.security.Provider$UString
       [junit] 227: 23 920 org.hornetq.tests.integration.client.NettyProducerFlowControlTest
       [junit] 228: 23 920 com.sun.jmx.mbeanserver.StandardMBeanSupport
       [junit] 229: 19 912 java.util.Locale
       [junit] 230: 22 880 org.hornetq.core.remoting.impl.wireformat.CreateSessionResponseMessage
       [junit] 231: 22 880 org.hornetq.core.client.impl.ClientProducerCreditManagerImpl
       [junit] 232: 11 880 java.util.ResourceBundle$CacheKey
       [junit] 233: 9 864 javax.management.openmbean.CompositeType
       [junit] 234: 9 864 sun.nio.cs.StreamEncoder
       [junit] 235: 21 840 sun.security.x509.AVAKeyword
       [junit] 236: 8 832 javax.management.openmbean.OpenMBeanParameterInfoSupport
       [junit] 237: 17 816 sun.reflect.UnsafeQualifiedStaticObjectFieldAccessorImpl
       [junit] 238: 20 800 java.util.Random
       [junit] 239: 20 800 java.util.PriorityQueue
       [junit] 240: 20 800 java.util.concurrent.DelayQueue
       [junit] 241: 25 800 javax.management.ObjectName$Property
       [junit] 242: 25 800 java.lang.ProcessEnvironment$Value
       [junit] 243: 20 800 javax.management.NotificationBroadcasterSupport
       [junit] 244: 25 800 java.lang.ProcessEnvironment$Variable
       [junit] 245: 20 800 org.hornetq.core.settings.impl.Match
       [junit] 246: 25 784 [Ljavax.management.MBeanNotificationInfo;
       [junit] 247: 19 760 org.hornetq.core.transaction.impl.ResourceManagerImpl$TxTimeoutHandler
       [junit] 248: 13 728 java.security.ProtectionDomain
       [junit] 249: 13 728 java.security.CodeSource
       [junit] 250: 18 720 org.hornetq.core.security.impl.HornetQSecurityManagerImpl
       [junit] 251: 18 720 org.hornetq.core.management.NotificationType
       [junit] 252: 22 704 org.hornetq.core.client.impl.FailoverManagerImpl$Channel0Handler
       [junit] 253: 44 704 java.lang.ref.ReferenceQueue$Lock
       [junit] 254: 22 704 org.hornetq.core.client.impl.FailoverManagerImpl$DelegatingFailureListener
       [junit] 255: 22 704 org.hornetq.core.remoting.impl.wireformat.NullResponseMessage
       [junit] 256: 22 704 org.hornetq.core.client.impl.DelegatingSession
       [junit] 257: 11 704 java.util.ResourceBundle$BundleReference
       [junit] 258: 22 704 org.hornetq.core.client.impl.ClientSessionPacketHandler
       [junit] 259: 14 672 java.security.Permissions
       [junit] 260: 14 640 [Ljava.io.ObjectStreamField;
       [junit] 261: 3 640 [Ljava.math.BigInteger;
       [junit] 262: 13 624 org.hornetq.utils.VariableLatch$CountSync
       [junit] 263: 13 624 java.io.FilePermission
       [junit] 264: 13 624 org.hornetq.core.persistence.impl.journal.BatchingIDGenerator
       [junit] 265: 11 616 java.util.ResourceBundle$LoaderReference
       [junit] 266: 19 608 org.hornetq.core.postoffice.impl.PostOfficeImpl$Reaper
       [junit] 267: 19 608 java.lang.ThreadLocal$ThreadLocalMap
       [junit] 268: 19 608 java.util.regex.Pattern$Start
       [junit] 269: 15 600 java.lang.RuntimePermission
       [junit] 270: 15 600 org.hornetq.core.buffers.HeapChannelBuffer
       [junit] 271: 10 600 [Ljava.security.ProtectionDomain;
       [junit] 272: 37 592 org.hornetq.core.settings.impl.HierarchicalObjectRepository$MatchComparator
       [junit] 273: 15 584 [Ljava.security.cert.Certificate;
       [junit] 274: 18 576 java.text.DateFormat$Field
       [junit] 275: 18 576 org.hornetq.core.client.impl.RoundRobinConnectionLoadBalancingPolicy
       [junit] 276: 18 576 [Lorg.hornetq.core.client.impl.FailoverManager;
       [junit] 277: 12 576 java.security.BasicPermissionCollection
       [junit] 278: 10 560 java.nio.HeapByteBuffer
       [junit] 279: 3 552 java.net.SocksSocketImpl
       [junit] 280: 23 552 org.hornetq.core.client.impl.FailoverManagerImpl$DelegatingBufferHandler
       [junit] 281: 17 544 com.sun.jmx.mbeanserver.NamedObject
       [junit] 282: 6 528 sun.security.x509.X500Name
       [junit] 283: 11 528 org.jboss.netty.util.internal.LinkedTransferQueue$QNode
       [junit] 284: 16 512 sun.security.pkcs11.wrapper.CK_ATTRIBUTE
       [junit] 285: 7 504 com.sun.jmx.mbeanserver.OpenConverter$CompositeConverter
       [junit] 286: 9 504 java.util.concurrent.ThreadPoolExecutor$Worker
       [junit] 287: 7 504 java.io.BufferedWriter
       [junit] 288: 7 504 org.jboss.netty.util.internal.ConcurrentHashMap
       [junit] 289: 21 504 org.hornetq.core.remoting.impl.invm.InVMConnector$Listener
       [junit] 290: 21 504 sun.reflect.generics.tree.ClassTypeSignature
       [junit] 291: 20 480 java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue
       [junit] 292: 20 480 org.hornetq.core.management.ObjectNameBuilder
       [junit] 293: 10 480 sun.security.jca.ProviderConfig
       [junit] 294: 10 480 org.hornetq.core.transaction.impl.XidImpl
       [junit] 295: 10 480 sun.security.x509.AlgorithmId
       [junit] 296: 15 480 javax.management.StandardMBean
       [junit] 297: 12 480 java.io.FileOutputStream
       [junit] 298: 12 480 sun.misc.JarIndex
       [junit] 299: 14 464 [Ljava.lang.Byte;
       [junit] 300: 19 456 java.util.regex.Pattern$Dot
       [junit] 301: 19 456 java.io.FileDescriptor
       [junit] 302: 19 456 org.hornetq.core.remoting.server.impl.RemotingServiceImpl$DelegatingBufferHandler
       [junit] 303: 8 448 java.io.PrintStream
       [junit] 304: 14 448 org.jboss.netty.logging.JdkLogger
       [junit] 305: 8 448 sun.misc.ProxyGenerator$PrimitiveTypeInfo
       [junit] 306: 6 432 java.util.Properties
       [junit] 307: 9 432 java.util.concurrent.atomic.AtomicReferenceFieldUpdater$AtomicReferenceFieldUpdaterImpl
       [junit] 308: 18 432 org.hornetq.utils.Random
       [junit] 309: 18 432 sun.reflect.BootstrapConstructorAccessorImpl
       [junit] 310: 9 432 java.io.OutputStreamWriter
       [junit] 311: 9 432 java.util.regex.Pattern$Branch
       [junit] 312: 13 416 java.util.Arrays$ArrayList
       [junit] 313: 13 416 java.io.FilePermissionCollection
       [junit] 314: 26 416 org.hornetq.core.journal.impl.Reclaimer
       [junit] 315: 5 416 [D
       [junit] 316: 13 416 org.hornetq.core.journal.impl.TimedBuffer$CheckTimer
       [junit] 317: 5 400 java.net.Inet6Address
       [junit] 318: 10 400 java.net.InetSocketAddress
       [junit] 319: 5 400 sun.util.calendar.ZoneInfo
       [junit] 320: 7 392 sun.reflect.annotation.AnnotationType
       [junit] 321: 6 384 sun.reflect.generics.repository.MethodRepository
       [junit] 322: 6 384 [Lsun.security.x509.RDN;
       [junit] 323: 4 384 org.jboss.netty.channel.socket.nio.NioWorker
       [junit] 324: 16 384 java.lang.Byte
       [junit] 325: 12 384 java.util.jar.Manifest
       [junit] 326: 3 384 sun.security.x509.X509CertImpl
       [junit] 327: 8 384 java.lang.OutOfMemoryError
       [junit] 328: 23 368 org.hornetq.core.remoting.impl.PacketDecoder
       [junit] 329: 9 360 [Ljava.util.regex.Pattern$Node;
       [junit] 330: 3 360 sun.nio.ch.KQueueSelectorImpl
       [junit] 331: 9 360 java.util.logging.Level
       [junit] 332: 9 360 org.jboss.netty.util.internal.LinkedTransferQueue
       [junit] 333: 5 360 sun.management.MemoryPoolImpl
       [junit] 334: 9 360 java.net.Inet4Address
       [junit] 335: 5 360 org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext
       [junit] 336: 7 352 [Ljava.lang.Boolean;
       [junit] 337: 11 352 java.util.regex.Pattern$Slice
       [junit] 338: 2 352 sun.nio.ch.SocketChannelImpl
       [junit] 339: 2 336 [Ljava.text.DateFormat$Field;
       [junit] 340: 7 336 [Ljava.lang.annotation.ElementType;
       [junit] 341: 6 336 javax.management.MBeanConstructorInfo
       [junit] 342: 14 336 org.jboss.netty.logging.InternalLoggerFactory$1
       [junit] 343: 10 320 java.util.regex.Pattern$GroupHead
       [junit] 344: 5 320 sun.management.MemoryPoolImpl$PoolSensor
       [junit] 345: 10 320 sun.nio.cs.Surrogate$Parser
       [junit] 346: 5 320 sun.management.MemoryPoolImpl$CollectionSensor
       [junit] 347: 10 320 java.util.regex.Pattern$GroupTail
       [junit] 348: 8 320 java.math.RoundingMode
       [junit] 349: 13 312 [Ljava.security.Principal;
       [junit] 350: 13 312 org.hornetq.utils.VariableLatch
       [junit] 351: 10 312 [Ljava.lang.reflect.Type;
       [junit] 352: 3 312 sun.security.x509.X509CertInfo
       [junit] 353: 2 304 java.util.GregorianCalendar
       [junit] 354: 6 288 org.jboss.netty.util.internal.ConcurrentHashMap$HashEntry
       [junit] 355: 6 288 sun.reflect.generics.tree.MethodTypeSignature
       [junit] 356: 12 288 java.lang.ThreadLocal
       [junit] 357: 17 272 org.hornetq.core.remoting.impl.invm.InVMConnectorFactory
       [junit] 358: 3 264 javax.management.openmbean.OpenMBeanOperationInfoSupport
       [junit] 359: 11 264 java.text.NumberFormat$Field
       [junit] 360: 8 256 sun.reflect.generics.factory.CoreReflectionFactory
       [junit] 361: 8 256 java.util.Collections$UnmodifiableRandomAccessList
       [junit] 362: 8 256 java.lang.annotation.ElementType
       [junit] 363: 4 256 java.util.IdentityHashMap
       [junit] 364: 9 240 [Lsun.reflect.generics.tree.FieldTypeSignature;
       [junit] 365: 1 240 org.apache.xerces.dom.DocumentImpl
       [junit] 366: 2 240 sun.util.calendar.Gregorian$Date
       [junit] 367: 6 240 sun.reflect.generics.reflectiveObjects.ParameterizedTypeImpl
       [junit] 368: 6 240 org.hornetq.core.persistence.impl.nullpm.NullStorageManager
       [junit] 369: 5 240 sun.util.LocaleServiceProviderPool
       [junit] 370: 10 240 java.util.Formatter$Flags
       [junit] 371: 2 224 sun.net.www.protocol.jar.URLJarFile
       [junit] 372: 7 224 java.util.Date
       [junit] 373: 7 224 sun.security.x509.NetscapeCertTypeExtension$MapEntry
       [junit] 374: 9 216 java.util.regex.Pattern$BranchConn
       [junit] 375: 3 216 sun.security.util.MemoryCache$SoftCacheEntry
       [junit] 376: 3 216 org.apache.tools.ant.taskdefs.optional.junit.FormatterElement
       [junit] 377: 8 216 [Lsun.reflect.generics.tree.FormalTypeParameter;
       [junit] 378: 1 216 org.hornetq.core.server.impl.QueueImpl
       [junit] 379: 9 216 java.util.Collections$UnmodifiableSet
       [junit] 380: 1 216 org.jboss.netty.channel.socket.nio.NioClientSocketChannel
       [junit] 381: 2 208 java.security.SecureRandom
       [junit] 382: 5 200 java.io.BufferedOutputStream
       [junit] 383: 1 200 org.jboss.netty.channel.socket.nio.NioAcceptedSocketChannel
       [junit] 384: 4 192 com.sun.jmx.mbeanserver.OpenConverter$ArrayConverter
       [junit] 385: 1 192 org.hornetq.core.server.impl.ServerSessionImpl
       [junit] 386: 3 192 sun.nio.ch.SelectionKeyImpl
       [junit] 387: 6 192 org.hornetq.jms.server.management.impl.JMSServerControlImpl$NotificationType
       [junit] 388: 6 192 sun.reflect.generics.scope.MethodScope
       [junit] 389: 4 192 java.lang.ClassLoader$NativeLibrary
       [junit] 390: 6 192 org.hornetq.core.transaction.Transaction$State
       [junit] 391: 3 192 sun.security.x509.AuthorityKeyIdentifierExtension
       [junit] 392: 6 192 sun.misc.URLClassPath$FileLoader
       [junit] 393: 2 184 [[B
       [junit] 394: 1 176 org.hornetq.integration.transports.netty.NettyAcceptor
       [junit] 395: 3 176 [Ljava.io.File;
       [junit] 396: 2 176 javax.management.openmbean.TabularType
       [junit] 397: 2 176 java.util.jar.JarVerifier
       [junit] 398: 1 176 java.util.logging.LogManager$Cleaner
       [junit] 399: 2 176 java.io.ExpiringCache$1
       [junit] 400: 1 176 org.hornetq.core.client.impl.ClientConsumerImpl
       [junit] 401: 3 168 sun.misc.URLClassPath
       [junit] 402: 1 168 [Lsun.security.util.ObjectIdentifier;
       [junit] 403: 3 168 org.jboss.netty.channel.UnfailingChannelFuture
       [junit] 404: 3 168 org.jboss.netty.channel.DefaultChannelPipeline
       [junit] 405: 1 168 java.lang.ref.Finalizer$FinalizerThread
       [junit] 406: 7 168 java.util.LinkedHashSet
       [junit] 407: 1 168 [Lorg.hornetq.core.management.NotificationType;
       [junit] 408: 3 168 java.util.Collections$SynchronizedMap
       [junit] 409: 3 168 sun.reflect.generics.reflectiveObjects.TypeVariableImpl
       [junit] 410: 1 168 java.lang.ref.Reference$ReferenceHandler
       [junit] 411: 1 168 [[Ljava.lang.Byte;
       [junit] 412: 4 160 java.util.Stack
       [junit] 413: 1 160 java.util.logging.FileHandler
       [junit] 414: 5 160 org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner$3
       [junit] 415: 5 160 sun.security.jca.ServiceId
       [junit] 416: 1 152 sun.misc.Launcher$ExtClassLoader
       [junit] 417: 3 152 [Ljava.net.InetAddress;
       [junit] 418: 1 152 org.hornetq.core.server.impl.ServerConsumerImpl
       [junit] 419: 1 152 org.hornetq.integration.transports.netty.NettyConnector
       [junit] 420: 3 144 com.sun.jmx.mbeanserver.OpenConverter$EnumConverter
       [junit] 421: 2 144 sun.nio.ch.SocketAdaptor
       [junit] 422: 3 144 [Ljava.nio.channels.SelectionKey;
       [junit] 423: 6 144 [Lsun.reflect.generics.tree.TypeSignature;
       [junit] 424: 1 144 sun.nio.ch.ServerSocketChannelImpl
       [junit] 425: 1 144 sun.security.rsa.SunRsaSign
       [junit] 426: 1 144 sun.security.provider.Sun
       [junit] 427: 6 144 sun.security.x509.KeyIdentifier
       [junit] 428: 1 144 sun.security.jca.ProviderList$1
       [junit] 429: 3 144 org.jboss.netty.channel.group.DefaultChannelGroup
       [junit] 430: 2 144 com.sun.jmx.mbeanserver.MBeanIntrospector$PerInterfaceMap
       [junit] 431: 3 144 sun.nio.ch.KQueueArrayWrapper
       [junit] 432: 2 144 sun.nio.cs.MacRoman$Decoder
       [junit] 433: 3 144 sun.security.x509.SubjectKeyIdentifierExtension
       [junit] 434: 3 144 sun.security.x509.NetscapeCertTypeExtension
       [junit] 435: 2 144 com.sun.jmx.mbeanserver.MBeanIntrospector$MBeanInfoMap
       [junit] 436: 1 136 [Ljavax.management.openmbean.SimpleType;
       [junit] 437: 1 136 sun.misc.Launcher$AppClassLoader
       [junit] 438: 4 128 org.jboss.netty.channel.ChannelState
       [junit] 439: 4 128 java.text.Normalizer$Form
       [junit] 440: 2 128 [Lsun.security.jca.ProviderConfig;
       [junit] 441: 4 128 java.io.FileInputStream
       [junit] 442: 2 128 java.text.ChoiceFormat
       [junit] 443: 1 128 org.apache.tools.ant.taskdefs.optional.junit.JUnitTest
       [junit] 444: 2 128 org.jboss.netty.channel.socket.nio.DefaultNioSocketChannelConfig
       [junit] 445: 2 128 com.sun.jmx.mbeanserver.OpenConverter$TabularConverter
       [junit] 446: 2 128 org.jboss.netty.buffer.DynamicChannelBuffer
       [junit] 447: 2 128 sun.security.provider.DSAPublicKeyImpl
       [junit] 448: 1 120 java.util.logging.LogManager$RootLogger
       [junit] 449: 5 120 $Proxy0
       [junit] 450: 5 120 $Proxy2
       [junit] 451: 3 120 org.jboss.netty.buffer.BigEndianHeapChannelBuffer
       [junit] 452: 5 120 $Proxy6
       [junit] 453: 3 120 sun.security.pkcs11.Secmod$DbMode
       [junit] 454: 3 120 sun.security.x509.CertificateExtensions
       [junit] 455: 2 112 sun.management.GarbageCollectorImpl
       [junit] 456: 2 112 com.sun.jmx.mbeanserver.OpenConverter$CollectionConverter
       [junit] 457: 2 112 sun.reflect.generics.repository.ClassRepository
       [junit] 458: 2 112 org.jboss.netty.channel.socket.nio.NioSocketChannel$WriteBuffer
       [junit] 459: 2 112 org.jboss.netty.util.VirtualExecutorService
       [junit] 460: 1 104 java.util.ResourceBundle$RBClassLoader
       [junit] 461: 1 104 [Ljava.text.Format;
       [junit] 462: 1 104 java.util.logging.ConsoleHandler
       [junit] 463: 1 104 [Ljava.lang.Runnable;
       [junit] 464: 1 104 org.hornetq.core.client.impl.ClientMessageImpl
       [junit] 465: 1 104 java.text.SimpleDateFormat
       [junit] 466: 1 104 org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner
       [junit] 467: 3 96 sun.reflect.generics.tree.FormalTypeParameter
       [junit] 468: 3 96 org.hornetq.core.settings.impl.AddressFullMessagePolicy
       [junit] 469: 3 96 org.hornetq.core.postoffice.BindingType
       [junit] 470: 3 96 org.jboss.netty.util.VirtualExecutorService$ChildExecutorRunnable
       [junit] 471: 1 96 sun.security.provider.NativePRNG$RandomIO
       [junit] 472: 3 96 sun.security.x509.CertificateValidity
       [junit] 473: 2 96 [Ljava.lang.annotation.RetentionPolicy;
       [junit] 474: 2 96 sun.security.x509.SubjectAlternativeNameExtension
       [junit] 475: 2 96 java.util.regex.Pattern$BnM
       [junit] 476: 3 96 [Ljava.security.CodeSigner;
       [junit] 477: 1 96 java.text.DateFormatSymbols
       [junit] 478: 3 96 java.lang.annotation.RetentionPolicy
       [junit] 479: 1 96 org.jboss.netty.channel.socket.nio.NioServerSocketChannel
       [junit] 480: 1 96 org.hornetq.core.messagecounter.MessageCounter
       [junit] 481: 3 96 sun.security.util.BitArray
       [junit] 482: 3 96 org.jboss.netty.util.ThreadRenamingRunnable
       [junit] 483: 3 96 sun.security.util.Cache$EqualByteArray
       [junit] 484: 3 96 java.util.regex.Pattern$Ctype
       [junit] 485: 3 96 java.util.regex.Pattern$BitClass
       [junit] 486: 2 96 java.io.ExpiringCache
       [junit] 487: 2 96 org.hornetq.core.management.impl.AcceptorControlImpl
       [junit] 488: 2 96 java.util.concurrent.Semaphore$NonfairSync
       [junit] 489: 3 96 org.jboss.netty.util.internal.ThreadLocalBoolean
       [junit] 490: 3 96 sun.nio.ch.AllocatedNativeObject
       [junit] 491: 3 96 sun.security.x509.CertificateIssuerName
       [junit] 492: 2 96 java.security.AlgorithmParameters
       [junit] 493: 3 96 org.apache.tools.ant.util.TeeOutputStream
       [junit] 494: 2 96 java.lang.NullPointerException
       [junit] 495: 3 96 java.util.regex.Pattern$Single
       [junit] 496: 3 96 org.hornetq.core.server.HandleStatus
       [junit] 497: 2 96 sun.security.x509.KeyUsageExtension
       [junit] 498: 3 96 sun.misc.Signal
       [junit] 499: 3 96 sun.security.x509.CertificateSubjectName
       [junit] 500: 1 88 sun.nio.ch.FileChannelImpl
       [junit] 501: 1 88 org.hornetq.core.security.impl.SecurityStoreImpl
       [junit] 502: 1 88 [[Ljava.lang.Object;
       [junit] 503: 1 88 sun.security.provider.SHA
       [junit] 504: 1 88 [Ljava.math.RoundingMode;
       [junit] 505: 1 80 sun.nio.cs.StreamDecoder
       [junit] 506: 2 80 org.hornetq.core.client.impl.FailoverManagerImpl$PingRunnable
       [junit] 507: 1 80 [Lsun.security.x509.NetscapeCertTypeExtension$MapEntry;
       [junit] 508: 2 80 sun.reflect.generics.tree.ClassSignature
       [junit] 509: 2 80 sun.security.util.MemoryCache
       [junit] 510: 2 80 org.jboss.netty.channel.AdaptiveReceiveBufferSizePredictor
       [junit] 511: 2 80 [Lorg.jboss.netty.channel.socket.nio.NioWorker;
       [junit] 512: 2 80 org.hornetq.integration.transports.netty.Horn