8 Replies Latest reply on Feb 13, 2004 9:42 AM by starksm64

    JBoss MQ hangs

    arabin

      I have a Jboss application, that sometimes hangs.
      Has 2 clients, and a server.
      The first client, exampleMultipleLocalSenderAnsAsynchWaiter, sends point-to-point messages to the second application, exampleAsynchReceiverAndAnswerer. While doing it, exampleMultipleLocalSenderAnsAsynchWaiter creates a queue via destination manager, where it is going to accept an answer asynchronousely.
      exampleAsynchReceiverAndAnswerer accepts the message asynchronously on a callback, and answers to exampleMultipleLocalSenderAnsAsynchWaiter back. exampleMultipleLocalSenderAnsAsynchWaiter accepts that answer, destroys the queue via destination manager, and repeats the loop.

      Everything is OK with this, except that sometimes it hangs. That hangs after I send 1500 messages, or something like that.

      The thread dump are enclosed. Is it possible to find out what is going on?
      It looks like exampleMultipleLocalSenderAnsAsynchWaiter has just sent a message to exampleAsynchReceiverAndAnswerer and is waiting for an answer. But it is difficult to say why the answer is not coming.

      Do you have any idea why?

        • 1. Re: JBoss MQ hangs
          arabin

          It looks like I canbnot attach files.

          • 2. Re: JBoss MQ hangs
            arabin

            C:\teamworks\run>exampleAsynchReceiverAndAnswerer.bat

            C:\teamworks\run>C:\j2sdk1.4.2_01\bin\java -cp .;jboss-jmx.jar;jbossall-client.j
            ar;concurrent.jar;jboss-j2ee.jar;cms.jar com.wrn.teamworks.cms.client.ExampleAsy
            nchReceiverAndAnswerer
            Callback Handler caught call # 1091 on time 01:30:13,019
            Full thread dump Java HotSpot(TM) Client VM (1.4.2_01-b06 mixed mode):

            "Thread-1" prio=5 tid=0x02cd78f8 nid=0x34c0 waiting on condition [30bf000..30bfd
            94]
            at java.lang.Thread.sleep(Native Method)
            at com.wrn.teamworks.cms.client.ExampleAsynchReceiver.run(ExampleAsynchR
            eceiver.java:44)
            at java.lang.Thread.run(Thread.java:534)

            "MessageListenerThread - q1" prio=5 tid=0x02c98a78 nid=0x1c2c in Object.wait() [
            307f000..307fd94]
            at java.lang.Object.wait(Native Method)
            - waiting on <0x10522200> (a java.util.LinkedList)
            at java.lang.Object.wait(Object.java:429)
            at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
            - locked <0x10522200> (a java.util.LinkedList)
            at java.lang.Thread.run(Thread.java:534)

            "Connection Monitor Thread" daemon prio=5 tid=0x02c9a3d0 nid=0x2fe4 in Object.wa
            it() [303f000..303fd94]
            at java.lang.Object.wait(Native Method)
            - waiting on <0x10517960> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemo
            n)
            at EDU.oswego.cs.dl.util.concurrent.ClockDaemon.nextTask(ClockDaemon.jav
            a:328)
            - locked <0x10517960> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemon)
            at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(ClockDaemon.
            java:362)
            at java.lang.Thread.run(Thread.java:534)

            "OILClientILService-0" daemon prio=5 tid=0x02c96e28 nid=0x1c94 runnable [2fff000
            ..2fffd94]
            at java.net.SocketInputStream.socketRead0(Native Method)
            at java.net.SocketInputStream.read(SocketInputStream.java:129)
            at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
            at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
            - locked <0x10518230> (a java.io.BufferedInputStream)
            at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
            :2133)
            at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
            InputStream.java:2313)
            at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
            am.java:2380)
            at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
            .java:2452)
            at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
            ream.java:2601)
            at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
            at org.jboss.mq.il.oil.OILClientILService.run(OILClientILService.java:18
            3)
            at java.lang.Thread.run(Thread.java:534)

            "GC Daemon" daemon prio=2 tid=0x00a3b360 nid=0x27c4 in Object.wait() [2f7f000..2
            f7fd94]
            at java.lang.Object.wait(Native Method)
            - waiting on <0x1050a218> (a sun.misc.GC$LatencyLock)
            at sun.misc.GC$Daemon.run(GC.java:100)
            - locked <0x1050a218> (a sun.misc.GC$LatencyLock)

            "RMI RenewClean-[192.168.1.19:3028]" daemon prio=5 tid=0x00a3b0c8 nid=0xba8 in O
            bject.wait() [2f3f000..2f3fd94]
            at java.lang.Object.wait(Native Method)
            - waiting on <0x10509fe8> (a java.lang.ref.ReferenceQueue$Lock)
            at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
            - locked <0x10509fe8> (a java.lang.ref.ReferenceQueue$Lock)
            at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCCli
            ent.java:500)
            at java.lang.Thread.run(Thread.java:534)

            "Signal Dispatcher" daemon prio=10 tid=0x009f8ef0 nid=0x232c waiting on conditio
            n [0..0]

            "Finalizer" daemon prio=9 tid=0x009bf0d8 nid=0x1f58 in Object.wait() [2b5f000..2
            b5fd94]
            at java.lang.Object.wait(Native Method)
            - waiting on <0x104f9480> (a java.lang.ref.ReferenceQueue$Lock)
            at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
            - locked <0x104f9480> (a java.lang.ref.ReferenceQueue$Lock)
            at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
            at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

            "Reference Handler" daemon prio=10 tid=0x009bdca8 nid=0xeb4 in Object.wait() [2b
            1f000..2b1fd94]
            at java.lang.Object.wait(Native Method)
            - waiting on <0x104f94e8> (a java.lang.ref.Reference$Lock)
            at java.lang.Object.wait(Object.java:429)
            at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
            - locked <0x104f94e8> (a java.lang.ref.Reference$Lock)

            "main" prio=5 tid=0x00034d00 nid=0x1518 waiting on condition [7f000..7fc3c]
            at java.lang.Thread.sleep(Native Method)
            at com.wrn.teamworks.cms.client.ExampleAsynchReceiverAndAnswerer.main(Ex
            ampleAsynchReceiverAndAnswerer.java:75)

            "VM Thread" prio=5 tid=0x009f76f8 nid=0x214c runnable

            "VM Periodic Task Thread" prio=10 tid=0x009fb708 nid=0x210c waiting on condition

            "Suspend Checker Thread" prio=10 tid=0x009f85a8 nid=0x82c runnable

            • 3. Re: JBoss MQ hangs
              arabin

              This is JBoss server thread dump:

              Full thread dump Java HotSpot(TM) Client VM (1.4.2_01-b06 mixed mode):

              "Thread-3335" prio=5 tid=0x02d7a030 nid=0x1d0c runnable [4b8f000..4b8fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x11c6e850> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-3334" prio=5 tid=0x038cf7d0 nid=0x2a08 runnable [4acf000..4acfd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x11c6f540> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-3333" prio=5 tid=0x03697530 nid=0x2f84 runnable [484f000..484fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x11c6ce70> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-3332" prio=5 tid=0x038d1b38 nid=0x13a0 runnable [430f000..430fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x11c6db60> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-3331" prio=5 tid=0x009feb90 nid=0x18cc runnable [2c9f000..2c9fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x11c70230> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "SimpleTimer-3290" daemon prio=5 tid=0x038e2a40 nid=0x1444 in Object.wait() [5c0
              f000..5c0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11c448a0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11c448a0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3281" daemon prio=5 tid=0x038bde18 nid=0x276c in Object.wait() [5bc
              f000..5bcfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11c44908> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11c44908> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3262" daemon prio=5 tid=0x038bd158 nid=0x31c4 in Object.wait() [5b8
              f000..5b8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11c34c00> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11c34c00> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3261" daemon prio=5 tid=0x03870e98 nid=0x2c84 in Object.wait() [5b4
              f000..5b4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11c34c50> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11c34c50> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3204" daemon prio=5 tid=0x0386fa30 nid=0x2680 in Object.wait() [5b0
              f000..5b0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11bf1460> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11bf1460> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3152" daemon prio=5 tid=0x0386ec90 nid=0x80c in Object.wait() [5acf
              000..5acfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11bc5730> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11bc5730> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3131" daemon prio=5 tid=0x0386e070 nid=0x171c in Object.wait() [5a8
              f000..5a8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11baf638> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11baf638> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3129" daemon prio=5 tid=0x0386d4a8 nid=0x1a5c in Object.wait() [5a4
              f000..5a4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11baf688> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11baf688> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3096" daemon prio=5 tid=0x03951828 nid=0x2a4c in Object.wait() [5a0
              f000..5a0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b93610> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b93610> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3095" daemon prio=5 tid=0x03969e90 nid=0x3528 in Object.wait() [59c
              f000..59cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b93678> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b93678> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3078" daemon prio=5 tid=0x03950008 nid=0x1e68 in Object.wait() [598
              f000..598fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b777e8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b777e8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3052" daemon prio=5 tid=0x03935448 nid=0x1d24 in Object.wait() [594
              f000..594fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b4f340> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b4f340> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3050" daemon prio=5 tid=0x03934a30 nid=0x2d04 in Object.wait() [590
              f000..590fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b4f390> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b4f390> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3048" daemon prio=5 tid=0x03917848 nid=0xc44 in Object.wait() [58cf
              000..58cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b4f3e0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b4f3e0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3031" daemon prio=5 tid=0x03916c40 nid=0x33d4 in Object.wait() [588
              f000..588fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b461c8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b461c8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3009" daemon prio=5 tid=0x03916008 nid=0x37cc in Object.wait() [584
              f000..584fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b30b70> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b30b70> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-3001" daemon prio=5 tid=0x03915d40 nid=0x2bec in Object.wait() [580
              f000..580fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b2a348> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b2a348> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2972" daemon prio=5 tid=0x039151c0 nid=0x1c30 in Object.wait() [57c
              f000..57cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b17608> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b17608> (a org.jboss.mq.server.SimpleTimer)

              "OILClientILService-4" daemon prio=5 tid=0x03914ef8 nid=0xb08 runnable [578f000.
              .578fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x11b0c3b8> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILClientILService.run(OILClientILService.java:18
              3)
              at java.lang.Thread.run(Thread.java:534)

              "SimpleTimer-2968" daemon prio=5 tid=0x0390e910 nid=0x2b4c in Object.wait() [574
              f000..574fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11b079e0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11b079e0> (a org.jboss.mq.server.SimpleTimer)

              "OIL Worker-6" prio=5 tid=0x0390df88 nid=0xdd8 runnable [570f000..570fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x11b0cd28> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILServerILService$Client.run(OILServerILService.
              java:210)
              at java.lang.Thread.run(Thread.java:534)

              "SimpleTimer-2842" daemon prio=5 tid=0x03872008 nid=0xdb8 in Object.wait() [55cf
              000..55cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11a83db8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11a83db8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2831" daemon prio=5 tid=0x03801b30 nid=0x1758 in Object.wait() [558
              f000..558fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11a7ad88> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11a7ad88> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2779" daemon prio=5 tid=0x037ff8b0 nid=0x166c in Object.wait() [554
              f000..554fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11a4d318> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11a4d318> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2774" daemon prio=5 tid=0x037ff3d8 nid=0x14b0 in Object.wait() [550
              f000..550fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11a4d368> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11a4d368> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2746" daemon prio=5 tid=0x037fc630 nid=0xa74 in Object.wait() [54cf
              000..54cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11a33cb8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11a33cb8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2703" daemon prio=5 tid=0x0391b2c8 nid=0x131c in Object.wait() [548
              f000..548fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11a0b4e8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11a0b4e8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2687" daemon prio=5 tid=0x0391af60 nid=0x1d54 in Object.wait() [544
              f000..544fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x119fbc08> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x119fbc08> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2667" daemon prio=5 tid=0x03919b00 nid=0x2fa0 in Object.wait() [540
              f000..540fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x119ee158> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x119ee158> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2606" daemon prio=5 tid=0x038be010 nid=0x29ac in Object.wait() [53c
              f000..53cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1199f2a0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x1199f2a0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2560" daemon prio=5 tid=0x03871940 nid=0x1458 in Object.wait() [538
              f000..538fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11980bd0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11980bd0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2349" daemon prio=5 tid=0x03854640 nid=0x313c in Object.wait() [534
              f000..534fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x118b6cc0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x118b6cc0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2298" daemon prio=5 tid=0x038542a0 nid=0xde8 in Object.wait() [530f
              000..530fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11881d50> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11881d50> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2246" daemon prio=5 tid=0x03852d90 nid=0x1218 in Object.wait() [52c
              f000..52cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x118570f8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x118570f8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2195" daemon prio=5 tid=0x037fa950 nid=0x1074 in Object.wait() [528
              f000..528fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1182dab8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x1182dab8> (a org.jboss.mq.server.SimpleTimer)

              "Message Pushers-3" daemon prio=5 tid=0x03931e08 nid=0x2b50 in Object.wait() [52
              4f000..524fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10d223c0> (a java.util.LinkedList)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.mq.threadpool.ThreadPool$WorkerThread.idle(ThreadPool.java:
              205)
              at org.jboss.mq.threadpool.ThreadPool$WorkerThread.run(ThreadPool.java:2
              24)
              - locked <0x10d223c0> (a java.util.LinkedList)

              "SimpleTimer-2165" daemon prio=5 tid=0x03931b70 nid=0x199c in Object.wait() [520
              f000..520fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11812878> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11812878> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-15" daemon prio=5 tid=0x03931008 nid=0x2fac in Object.wait() [51cf0
              00..51cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10f110a8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x10f110a8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2114" daemon prio=5 tid=0x03851758 nid=0x2f6c in Object.wait() [518
              f000..518fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x117e0720> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x117e0720> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-2000" daemon prio=5 tid=0x03920648 nid=0x36b8 in Object.wait() [514
              f000..514fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11766990> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11766990> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1992" daemon prio=5 tid=0x039203e8 nid=0x4d8 in Object.wait() [510f
              000..510fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1175de38> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x1175de38> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1894" daemon prio=5 tid=0x0384d230 nid=0x3028 in Object.wait() [50c
              f000..50cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1170a5b0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x1170a5b0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1829" daemon prio=5 tid=0x0389f6f8 nid=0x6c4 in Object.wait() [500f
              000..500fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x116d56c0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x116d56c0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1817" daemon prio=5 tid=0x038a2608 nid=0x9d0 in Object.wait() [4f8f
              000..4f8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x116ca668> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x116ca668> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1650" daemon prio=5 tid=0x038fdb90 nid=0x10ec in Object.wait() [508
              f000..508fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x115ca920> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x115ca920> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1632" daemon prio=5 tid=0x038a3028 nid=0x3380 in Object.wait() [504
              f000..504fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x115b8d18> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x115b8d18> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1619" daemon prio=5 tid=0x03898650 nid=0x243c in Object.wait() [4f4
              f000..4f4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x115b1e38> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x115b1e38> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1596" daemon prio=5 tid=0x03897680 nid=0xe0 in Object.wait() [4fcf0
              00..4fcfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11595280> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11595280> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1428" daemon prio=5 tid=0x0388c638 nid=0x32f8 in Object.wait() [4f0
              f000..4f0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x114e6550> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x114e6550> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1296" daemon prio=5 tid=0x02d399e0 nid=0x34d4 in Object.wait() [4ec
              f000..4ecfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x114105c0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x114105c0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1182" daemon prio=5 tid=0x02d379c0 nid=0x2240 in Object.wait() [4e8
              f000..4e8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x113a0ec0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x113a0ec0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-1101" daemon prio=5 tid=0x02e13e58 nid=0x87c in Object.wait() [4e4f
              000..4e4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1135d0b8> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x1135d0b8> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-930" daemon prio=5 tid=0x02df99f8 nid=0xd78 in Object.wait() [4e0f0
              00..4e0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x112b1650> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x112b1650> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-824" daemon prio=5 tid=0x03892008 nid=0x2738 in Object.wait() [4dcf
              000..4dcfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1125bc60> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x1125bc60> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-771" daemon prio=5 tid=0x0392bff8 nid=0x2a34 in Object.wait() [4d8f
              000..4d8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11229348> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11229348> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-768" daemon prio=5 tid=0x0392b448 nid=0x1f2c in Object.wait() [4d4f
              000..4d4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x112214a0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x112214a0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-759" daemon prio=5 tid=0x02e1ce98 nid=0x3470 in Object.wait() [470f
              000..470fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x11210c88> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x11210c88> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-543" daemon prio=5 tid=0x036e1398 nid=0x2e64 in Object.wait() [438f
              000..438fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1114d400> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x1114d400> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-116" daemon prio=5 tid=0x0385ee78 nid=0x2030 in Object.wait() [4d0f
              000..4d0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10fa4190> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x10fa4190> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-78" daemon prio=5 tid=0x038447f0 nid=0x1eb4 in Object.wait() [4ccf0
              00..4ccfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10f81c88> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x10f81c88> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-11" daemon prio=5 tid=0x02d90330 nid=0x206c in Object.wait() [4c8f0
              00..4c8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10c68cf0> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x10c68cf0> (a org.jboss.mq.server.SimpleTimer)

              "SimpleTimer-51" daemon prio=5 tid=0x02d89948 nid=0xc6c in Object.wait() [4c4f00
              0..4c4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10f6c770> (a org.jboss.mq.server.SimpleTimer)
              at org.jboss.mq.server.SimpleTimer.run(SimpleTimer.java:107)
              - locked <0x10f6c770> (a org.jboss.mq.server.SimpleTimer)

              "OILClientILService-3" daemon prio=5 tid=0x02e923c0 nid=0x2fd0 runnable [4c0f000
              ..4c0fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10f4d780> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILClientILService.run(OILClientILService.java:18
              3)
              at java.lang.Thread.run(Thread.java:534)

              "OIL Worker-5" prio=5 tid=0x02e91e08 nid=0x3730 runnable [4bcf000..4bcfd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10f4e0d8> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILServerILService$Client.run(OILServerILService.
              java:210)
              at java.lang.Thread.run(Thread.java:534)

              "OILClientILService-2" daemon prio=5 tid=0x00a61610 nid=0x2350 runnable [4b4f000
              ..4b4fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10f4ea20> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILClientILService.run(OILClientILService.java:18
              3)
              at java.lang.Thread.run(Thread.java:534)

              "OIL Worker-4" prio=5 tid=0x00a5f6b0 nid=0x1434 runnable [4b0f000..4b0fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10f472c0> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILServerILService$Client.run(OILServerILService.
              java:210)
              at java.lang.Thread.run(Thread.java:534)

              "Message Pushers-2" daemon prio=5 tid=0x02d91dc8 nid=0x27b4 in Object.wait() [4a
              8f000..4a8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10d223c0> (a java.util.LinkedList)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.mq.threadpool.ThreadPool$WorkerThread.idle(ThreadPool.java:
              205)
              at org.jboss.mq.threadpool.ThreadPool$WorkerThread.run(ThreadPool.java:2
              24)
              - locked <0x10d223c0> (a java.util.LinkedList)

              "OIL Worker-3" prio=5 tid=0x038229e8 nid=0x944 runnable [4a4f000..4a4fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10f3a3f8> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILServerILService$Client.run(OILServerILService.
              java:210)
              at java.lang.Thread.run(Thread.java:534)

              "JNP Server" prio=5 tid=0x03822ee0 nid=0x21c0 runnable [4a0f000..4a0fd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x105ef048> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.jnp.server.Main.run(Main.java:281)
              at java.lang.Thread.run(Thread.java:534)

              "OIL Worker-2" prio=5 tid=0x0374e550 nid=0x322c runnable [49cf000..49cfd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10f2ff48> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILServerILService$Client.run(OILServerILService.
              java:210)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-49" prio=5 tid=0x03824dc8 nid=0x918 in Object.wait() [498f000..498fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10f30058> (a java.lang.Object)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.system.server.ServerImpl$LifeThread.run(ServerImpl.java:772
              )
              - locked <0x10f30058> (a java.lang.Object)

              "StandardManager[/web-console]" daemon prio=5 tid=0x02dab5e8 nid=0x1770 waiting
              on condition [494f000..494fd94]
              at java.lang.Thread.sleep(Native Method)
              at org.apache.catalina.session.StandardManager.threadSleep(StandardManag
              er.java:810)
              at org.apache.catalina.session.StandardManager.run(StandardManager.java:
              869)
              at java.lang.Thread.run(Thread.java:534)

              "StandardManager[/jmx-console]" daemon prio=5 tid=0x02d6cb18 nid=0x277c waiting
              on condition [490f000..490fd94]
              at java.lang.Thread.sleep(Native Method)
              at org.apache.catalina.session.StandardManager.threadSleep(StandardManag
              er.java:810)
              at org.apache.catalina.session.StandardManager.run(StandardManager.java:
              869)
              at java.lang.Thread.run(Thread.java:534)

              "OILClientILService-1" daemon prio=5 tid=0x02d6b798 nid=0x92c runnable [48cf000.
              .48cfd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10e09098> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILClientILService.run(OILClientILService.java:18
              3)
              at java.lang.Thread.run(Thread.java:534)

              "OIL Worker-1" prio=5 tid=0x0372c938 nid=0x1b8c runnable [488f000..488fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10e099a8> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILServerILService$Client.run(OILServerILService.
              java:210)
              at java.lang.Thread.run(Thread.java:534)

              "Message Pushers-1" daemon prio=5 tid=0x02de6b88 nid=0x1fe0 in Object.wait() [48
              0f000..480fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10d223c0> (a java.util.LinkedList)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.mq.threadpool.ThreadPool$WorkerThread.idle(ThreadPool.java:
              205)
              at org.jboss.mq.threadpool.ThreadPool$WorkerThread.run(ThreadPool.java:2
              24)
              - locked <0x10d223c0> (a java.util.LinkedList)

              "Connection Monitor Thread" daemon prio=5 tid=0x00a3c9f0 nid=0x218c in Object.wa
              it() [47cf000..47cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10d19810> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemo
              n)
              at EDU.oswego.cs.dl.util.concurrent.ClockDaemon.nextTask(ClockDaemon.jav
              a:328)
              - locked <0x10d19810> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemon)
              at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(ClockDaemon.
              java:362)
              at java.lang.Thread.run(Thread.java:534)

              "OILClientILService-0" daemon prio=5 tid=0x02df5360 nid=0x1c68 runnable [478f000
              ..478fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10dec510> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILClientILService.run(OILClientILService.java:18
              3)
              at java.lang.Thread.run(Thread.java:534)

              "OIL Worker-0" prio=5 tid=0x0372dea8 nid=0x1610 runnable [474f000..474fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10de0768> (a java.io.BufferedInputStream)
              at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
              :2133)
              at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
              InputStream.java:2313)
              at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
              am.java:2380)
              at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
              .java:2452)
              at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
              ream.java:2601)
              at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
              at org.jboss.mq.il.oil.OILServerILService$Client.run(OILServerILService.
              java:210)
              at java.lang.Thread.run(Thread.java:534)

              "RMI LeaseChecker" daemon prio=5 tid=0x03748d68 nid=0x520 waiting on condition [
              43cf000..43cfd94]
              at java.lang.Thread.sleep(Native Method)
              at sun.rmi.transport.DGCImpl$LeaseChecker.run(DGCImpl.java:307)
              at java.lang.Thread.run(Thread.java:534)

              "RMI RenewClean-[192.168.1.19:3028]" daemon prio=5 tid=0x0311d7d8 nid=0x938 in O
              bject.wait() [434f000..434fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10ddef60> (a java.lang.ref.ReferenceQueue$Lock)
              at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
              - locked <0x10ddef60> (a java.lang.ref.ReferenceQueue$Lock)
              at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCCli
              ent.java:500)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-44" prio=5 tid=0x03760ab0 nid=0x1fc0 runnable [46cf000..46cfd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10d9f0f8> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-43" prio=5 tid=0x02d9b210 nid=0x1d08 runnable [468f000..468fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10d9f9e0> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-42" prio=5 tid=0x02db57d0 nid=0x1db0 runnable [464f000..464fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10da02c8> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-41" prio=5 tid=0x02dadbd0 nid=0x1e5c runnable [460f000..460fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10da0ba0> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-39" daemon prio=5 tid=0x02db59e8 nid=0x361c in Object.wait() [458f000..4
              58fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10d8bc80> (a org.jboss.mx.util.ThreadPool$Worker)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.mx.util.ThreadPool$Worker.run(ThreadPool.java:243)
              - locked <0x10d8bc80> (a org.jboss.mx.util.ThreadPool$Worker)

              "Connection Consumer for dest QUEUE.localhost" prio=5 tid=0x02d369c0 nid=0x1c20
              in Object.wait() [454f000..454fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10d201c0> (a java.util.LinkedList)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.mq.SpyConnectionConsumer.run(SpyConnectionConsumer.java:202
              )
              - locked <0x10d201c0> (a java.util.LinkedList)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-38" prio=5 tid=0x036e4a70 nid=0x1668 in Object.wait() [450f000..450fd94]

              at java.lang.Object.wait(Native Method)
              - waiting on <0x10d10880> (a org.jboss.mx.util.RunnableScheduler)
              at org.jboss.mx.util.RunnableScheduler.waitOutstanding(RunnableScheduler
              .java:188)
              - locked <0x10d10880> (a org.jboss.mx.util.RunnableScheduler)
              at org.jboss.mx.util.RunnableScheduler.run(RunnableScheduler.java:93)
              at java.lang.Thread.run(Thread.java:534)

              "UILServerILService Accept Thread" prio=5 tid=0x036bbda0 nid=0x11b4 runnable [44
              cf000..44cfd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10c775a8> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.jboss.mq.il.uil2.UILServerILService.run(UILServerILService.java:1
              18)
              at java.lang.Thread.run(Thread.java:534)

              "UIL Worker" prio=5 tid=0x036e9180 nid=0xbdc runnable [448f000..448fd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10c776d0> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.jboss.mq.il.uil.UILServerILService.run(UILServerILService.java:18
              4)
              at java.lang.Thread.run(Thread.java:534)

              "OIL2 Worker Server" prio=5 tid=0x0369ab30 nid=0x329c runnable [444f000..444fd94
              ]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10c72968> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.jboss.mq.il.oil2.OIL2ServerILService.run(OIL2ServerILService.java
              :366)
              at java.lang.Thread.run(Thread.java:534)

              "OIL Worker Server" prio=5 tid=0x0369b040 nid=0x3400 runnable [440f000..440fd94]

              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10c72a38> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.jboss.mq.il.oil.OILServerILService.run(OILServerILService.java:47
              6)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-20" prio=5 tid=0x037a08a8 nid=0x240 in Object.wait() [42cf000..42cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10c5a0c8> (a java.util.LinkedList)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.resource.connectionmanager.PoolFiller$1.run(PoolFiller.java
              :75)
              - locked <0x10c5a0c8> (a java.util.LinkedList)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-19" prio=5 tid=0x036b5b20 nid=0x184 runnable [428f000..428fd94]
              at java.net.SocketInputStream.socketRead0(Native Method)
              at java.net.SocketInputStream.read(SocketInputStream.java:129)
              at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
              at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
              - locked <0x10c5a968> (a java.io.BufferedInputStream)
              at java.io.DataInputStream.readInt(DataInputStream.java:443)
              at org.hsqldb.ServerConnection.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-18" prio=5 tid=0x0379a9e8 nid=0x16c4 in Object.wait() [424f000..424fd94]

              at java.lang.Object.wait(Native Method)
              - waiting on <0x10c5aa10> (a java.util.ArrayList)
              at org.jboss.resource.connectionmanager.IdleRemover$1.run(IdleRemover.ja
              va:66)
              - locked <0x10c5aa10> (a java.util.ArrayList)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-17" daemon prio=5 tid=0x03749b20 nid=0x924 in Object.wait() [420f000..42
              0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10c5aa80> (a org.jboss.util.timeout.TimeoutFactory)
              at java.lang.Object.wait(Object.java:429)
              at org.jboss.util.timeout.TimeoutFactory.doWork(TimeoutFactory.java:497)

              - locked <0x10c5aa80> (a org.jboss.util.timeout.TimeoutFactory)
              at org.jboss.util.timeout.TimeoutFactory.access$300(TimeoutFactory.java:
              27)
              at org.jboss.util.timeout.TimeoutFactory$1.run(TimeoutFactory.java:542)

              "Thread-16" daemon prio=5 tid=0x0378bc48 nid=0x2248 in Object.wait() [41cf000..4
              1cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10c5aae8> (a java.util.TaskQueue)
              at java.util.TimerThread.mainLoop(Timer.java:429)
              - locked <0x10c5aae8> (a java.util.TaskQueue)
              at java.util.TimerThread.run(Timer.java:382)

              "JBossMQ Cache Reference Softner" daemon prio=5 tid=0x037a0e68 nid=0x1c24 runnab
              le [418f000..418fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10a919f8> (a java.lang.ref.ReferenceQueue$Lock)
              at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
              - locked <0x10a919f8> (a java.lang.ref.ReferenceQueue$Lock)
              at org.jboss.mq.server.MessageCache.run(MessageCache.java:233)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-15" prio=5 tid=0x03783b90 nid=0x1da8 waiting on condition [414f000..414f
              d94]
              at java.lang.Thread.sleep(Native Method)
              at org.hsqldb.Log.run(Unknown Source)
              at java.lang.Thread.run(Thread.java:534)

              "hypersonic-default" prio=5 tid=0x0367df88 nid=0x325c runnable [410f000..410fd94
              ]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10a6db60> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.hsqldb.Server.run(Unknown Source)
              at org.hsqldb.Server.main(Unknown Source)
              at org.jboss.jdbc.HypersonicDatabase$2.run(HypersonicDatabase.java:250)

              "RMI TCP Accept-0" daemon prio=5 tid=0x03236008 nid=0x1d60 runnable [40cf000..40
              cfd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10890d58> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
              at java.lang.Thread.run(Thread.java:534)

              "StandardManager[/jbossmq-httpil]" daemon prio=5 tid=0x02d401b0 nid=0x9c waiting
              on condition [408f000..408fd94]
              at java.lang.Thread.sleep(Native Method)
              at org.apache.catalina.session.StandardManager.threadSleep(StandardManag
              er.java:810)
              at org.apache.catalina.session.StandardManager.run(StandardManager.java:
              869)
              at java.lang.Thread.run(Thread.java:534)

              "StandardManager[/invoker]" daemon prio=5 tid=0x031cf758 nid=0x1af0 waiting on c
              ondition [404f000..404fd94]
              at java.lang.Thread.sleep(Native Method)
              at org.apache.catalina.session.StandardManager.threadSleep(StandardManag
              er.java:810)
              at org.apache.catalina.session.StandardManager.run(StandardManager.java:
              869)
              at java.lang.Thread.run(Thread.java:534)

              "MonitorRunnable" daemon prio=5 tid=0x031c5568 nid=0x360c in Object.wait() [400f
              000..400fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10747fe0> (a org.apache.tomcat.util.threads.ThreadPool$M
              onitorRunnable)
              at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadP
              ool.java:503)
              - locked <0x10747fe0> (a org.apache.tomcat.util.threads.ThreadPool$Monit
              orRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-13" daemon prio=5 tid=0x031c5408 nid=0x1530 runnable [3fcf000..3fcfd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10748088> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:268)
              at org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.ja
              va:531)
              at org.apache.jk.common.SocketAcceptor.runIt(ChannelSocket.java:660)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:619)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-12" daemon prio=5 tid=0x031c5940 nid=0x2ec4 in Object.wait() [3f8f000..3
              f8fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10748280> (a org.apache.tomcat.util.threads.ThreadPool$C
              ontrolRunnable)
              at java.lang.Object.wait(Object.java:429)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:595)
              - locked <0x10748280> (a org.apache.tomcat.util.threads.ThreadPool$Contr
              olRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-11" daemon prio=5 tid=0x03119670 nid=0x1280 in Object.wait() [3f4f000..3
              f4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x107482f8> (a org.apache.tomcat.util.threads.ThreadPool$C
              ontrolRunnable)
              at java.lang.Object.wait(Object.java:429)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:595)
              - locked <0x107482f8> (a org.apache.tomcat.util.threads.ThreadPool$Contr
              olRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-10" daemon prio=5 tid=0x032242a8 nid=0x17e4 in Object.wait() [3f0f000..3
              f0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x10748370> (a org.apache.tomcat.util.threads.ThreadPool$C
              ontrolRunnable)
              at java.lang.Object.wait(Object.java:429)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:595)
              - locked <0x10748370> (a org.apache.tomcat.util.threads.ThreadPool$Contr
              olRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "MonitorRunnable" daemon prio=5 tid=0x03224008 nid=0x1248 in Object.wait() [3ecf
              000..3ecfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x106f5b20> (a org.apache.tomcat.util.threads.ThreadPool$M
              onitorRunnable)
              at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadP
              ool.java:503)
              - locked <0x106f5b20> (a org.apache.tomcat.util.threads.ThreadPool$Monit
              orRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-8" daemon prio=5 tid=0x03267988 nid=0x173c runnable [3e8f000..3e8fd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x10726e48> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(De
              faultServerSocketFactory.java:107)
              at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoi
              nt.java:356)
              at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java
              :529)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:619)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-7" daemon prio=5 tid=0x03297978 nid=0x1dd8 in Object.wait() [3e4f000..3e
              4fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x106f5cc8> (a org.apache.tomcat.util.threads.ThreadPool$C
              ontrolRunnable)
              at java.lang.Object.wait(Object.java:429)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:595)
              - locked <0x106f5cc8> (a org.apache.tomcat.util.threads.ThreadPool$Contr
              olRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-6" daemon prio=5 tid=0x03297418 nid=0x2020 in Object.wait() [3e0f000..3e
              0fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x106f5d40> (a org.apache.tomcat.util.threads.ThreadPool$C
              ontrolRunnable)
              at java.lang.Object.wait(Object.java:429)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:595)
              - locked <0x106f5d40> (a org.apache.tomcat.util.threads.ThreadPool$Contr
              olRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-5" daemon prio=5 tid=0x030a3588 nid=0x2444 in Object.wait() [3dcf000..3d
              cfd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x106f5db8> (a org.apache.tomcat.util.threads.ThreadPool$C
              ontrolRunnable)
              at java.lang.Object.wait(Object.java:429)
              at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
              ool.java:595)
              - locked <0x106f5db8> (a org.apache.tomcat.util.threads.ThreadPool$Contr
              olRunnable)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-4" prio=5 tid=0x030a2318 nid=0x159c runnable [357f000..357fd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x105fc168> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.jboss.invocation.pooled.server.PooledInvoker.run(PooledInvoker.ja
              va:211)
              at java.lang.Thread.run(Thread.java:534)

              "GC Daemon" daemon prio=2 tid=0x02e72008 nid=0x3580 in Object.wait() [34ff000..3
              4ffd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x105ecda8> (a sun.misc.GC$LatencyLock)
              at sun.misc.GC$Daemon.run(GC.java:100)
              - locked <0x105ecda8> (a sun.misc.GC$LatencyLock)

              "RMI Reaper" prio=5 tid=0x03113008 nid=0x13d4 in Object.wait() [34bf000..34bfd94
              ]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x105ec3c0> (a java.lang.ref.ReferenceQueue$Lock)
              at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
              - locked <0x105ec3c0> (a java.lang.ref.ReferenceQueue$Lock)
              at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
              at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:330)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-3" daemon prio=5 tid=0x0310ec30 nid=0x33ac in Object.wait() [347f000..34
              7fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x105ec6c0> (a java.util.TaskQueue)
              at java.lang.Object.wait(Object.java:429)
              at java.util.TimerThread.mainLoop(Timer.java:403)
              - locked <0x105ec6c0> (a java.util.TaskQueue)
              at java.util.TimerThread.run(Timer.java:382)

              "RMI TCP Accept-0" daemon prio=5 tid=0x03126fb0 nid=0x66c runnable [343f000..343
              fd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x105ec420> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
              at java.lang.Thread.run(Thread.java:534)

              "Thread-2" daemon prio=5 tid=0x03110578 nid=0x1fa8 runnable [33ff000..33ffd94]
              at java.net.PlainSocketImpl.socketAccept(Native Method)
              at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
              - locked <0x105ed198> (a java.net.PlainSocketImpl)
              at java.net.ServerSocket.implAccept(ServerSocket.java:448)
              at java.net.ServerSocket.accept(ServerSocket.java:419)
              at org.jboss.web.WebServer.run(WebServer.java:258)
              at org.jboss.web.ThreadPool$Worker.run(ThreadPool.java:163)

              "ScannerThread" daemon prio=5 tid=0x030f9fb8 nid=0x1e0c waiting on condition [33
              bf000..33bfd94]
              at java.lang.Thread.sleep(Native Method)
              at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.
              loop(AbstractDeploymentScanner.java:218)
              at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.
              run(AbstractDeploymentScanner.java:191)

              "Thread-0" daemon prio=5 tid=0x030f1e28 nid=0x3d0 in Object.wait() [337f000..337
              fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x1058f858> (a java.util.TaskQueue)
              at java.util.TimerThread.mainLoop(Timer.java:429)
              - locked <0x1058f858> (a java.util.TaskQueue)
              at java.util.TimerThread.run(Timer.java:382)

              "DestroyJavaVM" prio=5 tid=0x00034eb0 nid=0x28ac waiting on condition [0..7fae0]


              "Signal Dispatcher" daemon prio=10 tid=0x0003d098 nid=0x2c54 waiting on conditio
              n [0..0]

              "Finalizer" daemon prio=9 tid=0x009c0010 nid=0x17c8 in Object.wait() [2b5f000..2
              b5fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x104fe210> (a java.lang.ref.ReferenceQueue$Lock)
              at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
              - locked <0x104fe210> (a java.lang.ref.ReferenceQueue$Lock)
              at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
              at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

              "Reference Handler" daemon prio=10 tid=0x009bebe0 nid=0x260c in Object.wait() [2
              b1f000..2b1fd94]
              at java.lang.Object.wait(Native Method)
              - waiting on <0x104fe050> (a java.lang.ref.Reference$Lock)
              at java.lang.Object.wait(Object.java:429)
              at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
              - locked <0x104fe050> (a java.lang.ref.Reference$Lock)

              "VM Thread" prio=5 tid=0x009fb6e8 nid=0xf3c runnable

              "VM Periodic Task Thread" prio=10 tid=0x0003f880 nid=0x1dfc waiting on condition

              "Suspend Checker Thread" prio=10 tid=0x009c23e8 nid=0x1f08 runnable

              • 4. Re: JBoss MQ hangs
                arabin

                C:\teamworks\run>exampleMultipleLocalSenderAnsAsynchWaiter.bat


                Callback Handler caught call # 1 on time 01:30:13,034
                Full thread dump Java HotSpot(TM) Client VM (1.4.2_01-b06 mixed mode):

                "MessageListenerThread - 1066671012909" prio=5 tid=0x0a97dfa0 nid=0x3f0 in Objec
                t.wait() [1c68f000..1c68fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108123a8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012816" prio=5 tid=0x0a97d380 nid=0x1b24 in Obje
                ct.wait() [1c64f000..1c64fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fab0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012706" prio=5 tid=0x0a97c760 nid=0x1de8 in Obje
                ct.wait() [1c60f000..1c60fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fb40> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012597" prio=5 tid=0x0a97bb40 nid=0x1ecc in Obje
                ct.wait() [1c5cf000..1c5cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fbd0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012503" prio=5 tid=0x0a97af20 nid=0x1f20 in Obje
                ct.wait() [1c58f000..1c58fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fc60> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012394" prio=5 tid=0x0a97a338 nid=0x2ad8 in Obje
                ct.wait() [1c54f000..1c54fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fcf0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012284" prio=5 tid=0x0a979808 nid=0x17f0 in Obje
                ct.wait() [1c50f000..1c50fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fd80> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012191" prio=5 tid=0x0a92cab0 nid=0x1a84 in Obje
                ct.wait() [1c4cf000..1c4cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fe10> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671012081" prio=5 tid=0x0a92be90 nid=0x2018 in Obje
                ct.wait() [1c48f000..1c48fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082fea0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011972" prio=5 tid=0x0a92b270 nid=0x34ac in Obje
                ct.wait() [1c44f000..1c44fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082ff30> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011878" prio=5 tid=0x0a92a648 nid=0x1078 in Obje
                ct.wait() [1c40f000..1c40fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1082ffc0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011753" prio=5 tid=0x0a929a28 nid=0x2c24 in Obje
                ct.wait() [1c3cf000..1c3cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10830050> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011659" prio=5 tid=0x0a928e08 nid=0xeec in Objec
                t.wait() [1c38f000..1c38fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108300e0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011566" prio=5 tid=0x0a9281e8 nid=0x1cbc in Obje
                ct.wait() [1c34f000..1c34fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10830170> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011441" prio=5 tid=0x0a9275c8 nid=0x1538 in Obje
                ct.wait() [1c30f000..1c30fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10830200> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011347" prio=5 tid=0x0a9269a8 nid=0x238 in Objec
                t.wait() [1c2cf000..1c2cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10830290> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011253" prio=5 tid=0x0a925d88 nid=0x3574 in Obje
                ct.wait() [1c28f000..1c28fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10830320> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011128" prio=5 tid=0x0a925168 nid=0x35e4 in Obje
                ct.wait() [1c24f000..1c24fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108303b0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671011034" prio=5 tid=0x0a924548 nid=0xa78 in Objec
                t.wait() [1c20f000..1c20fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10830440> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010909" prio=5 tid=0x0a923928 nid=0xd0 in Object
                .wait() [1c1cf000..1c1cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108304d0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010769" prio=5 tid=0x0a922d08 nid=0x17f8 in Obje
                ct.wait() [1c18f000..1c18fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10830560> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010628" prio=5 tid=0x0a9220e8 nid=0x22dc in Obje
                ct.wait() [1c14f000..1c14fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108305f0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010487" prio=5 tid=0x0a9214c8 nid=0x1868 in Obje
                ct.wait() [1c10f000..1c10fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1080ff78> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010331" prio=5 tid=0x0a9210c0 nid=0x289c in Obje
                ct.wait() [1c0cf000..1c0cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10810008> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010191" prio=5 tid=0x0a91fb68 nid=0x3658 in Obje
                ct.wait() [1c08f000..1c08fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10810098> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010081" prio=5 tid=0x0a91ef60 nid=0x2d80 in Obje
                ct.wait() [1c04f000..1c04fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108082f8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671010003" prio=5 tid=0x0a91e408 nid=0x1fb4 in Obje
                ct.wait() [1c00f000..1c00fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808388> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009878" prio=5 tid=0x0a914708 nid=0x185c in Obje
                ct.wait() [1bfcf000..1bfcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808418> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009784" prio=5 tid=0x0a913ae8 nid=0x2724 in Obje
                ct.wait() [1bf8f000..1bf8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108084a8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009691" prio=5 tid=0x0a912ec8 nid=0x7dc in Objec
                t.wait() [1bf4f000..1bf4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808538> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009566" prio=5 tid=0x0a9122a8 nid=0x2cf4 in Obje
                ct.wait() [1bf0f000..1bf0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108085c8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009472" prio=5 tid=0x0a911688 nid=0x12d8 in Obje
                ct.wait() [1becf000..1becfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808658> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009378" prio=5 tid=0x0a910258 nid=0xfdc in Objec
                t.wait() [1be8f000..1be8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x108086e8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009222" prio=5 tid=0x0a90f638 nid=0xe04 in Objec
                t.wait() [1be4f000..1be4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808778> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009159" prio=5 tid=0x0a90ea18 nid=0x2748 in Obje
                ct.wait() [1be0f000..1be0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808808> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671009066" prio=5 tid=0x0a8d3de8 nid=0x2110 in Obje
                ct.wait() [1bdcf000..1bdcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808898> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008956" prio=5 tid=0x0a8d31c8 nid=0x2598 in Obje
                ct.wait() [1bd8f000..1bd8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10808928> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008847" prio=5 tid=0x0a8d25a8 nid=0x160 in Objec
                t.wait() [1bd4f000..1bd4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6850> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008769" prio=5 tid=0x0a8d1988 nid=0xad4 in Objec
                t.wait() [1bd0f000..1bd0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f68e0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008644" prio=5 tid=0x0a8d0d68 nid=0x2300 in Obje
                ct.wait() [1bccf000..1bccfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6970> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008566" prio=5 tid=0x0a8d0148 nid=0xb24 in Objec
                t.wait() [1bc8f000..1bc8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6a00> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008456" prio=5 tid=0x0a8cf520 nid=0x2794 in Obje
                ct.wait() [1bc4f000..1bc4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6a90> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008331" prio=5 tid=0x0a8ce900 nid=0x814 in Objec
                t.wait() [1bc0f000..1bc0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6b20> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008253" prio=5 tid=0x0a8cdce0 nid=0x1430 in Obje
                ct.wait() [1bbcf000..1bbcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6bb0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008144" prio=5 tid=0x0a8cd148 nid=0x20ac in Obje
                ct.wait() [1bb8f000..1bb8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6c40> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671008034" prio=5 tid=0x02d914a0 nid=0xb30 in Objec
                t.wait() [1bb4f000..1bb4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6cd0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007956" prio=5 tid=0x02d90880 nid=0xc78 in Objec
                t.wait() [1bb0f000..1bb0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6d60> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007847" prio=5 tid=0x02d8fc60 nid=0x27d0 in Obje
                ct.wait() [1bacf000..1bacfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6df0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007737" prio=5 tid=0x02d8f040 nid=0x23f0 in Obje
                ct.wait() [1ba8f000..1ba8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6e80> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007409" prio=5 tid=0x02d8e4b0 nid=0x115c in Obje
                ct.wait() [1ba4f000..1ba4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6f10> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007362" prio=5 tid=0x02d8d3b0 nid=0x2484 in Obje
                ct.wait() [1ba0f000..1ba0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f6fa0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007300" prio=5 tid=0x02d8c8d0 nid=0x2f70 in Obje
                ct.wait() [1b9cf000..1b9cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7030> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007237" prio=5 tid=0x02d8bdf0 nid=0x3154 in Obje
                ct.wait() [1b98f000..1b98fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f70c0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007144" prio=5 tid=0x02d8b3a0 nid=0x2740 in Obje
                ct.wait() [1b94f000..1b94fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7150> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671007034" prio=5 tid=0x02d8a808 nid=0x2a14 in Obje
                ct.wait() [1b90f000..1b90fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f71e0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006956" prio=5 tid=0x0a9bd700 nid=0x1e8c in Obje
                ct.wait() [1b8cf000..1b8cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7270> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006847" prio=5 tid=0x0a9bcae0 nid=0x3538 in Obje
                ct.wait() [1b88f000..1b88fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7300> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006737" prio=5 tid=0x0a9bc6d8 nid=0x2a38 in Obje
                ct.wait() [1b84f000..1b84fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7390> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006644" prio=5 tid=0x0a9bae28 nid=0x12e8 in Obje
                ct.wait() [1b80f000..1b80fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7420> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006534" prio=5 tid=0x0a9ba208 nid=0x14a8 in Obje
                ct.wait() [1b7cf000..1b7cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f74b0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006425" prio=5 tid=0x0a9b95e8 nid=0x11a8 in Obje
                ct.wait() [1b78f000..1b78fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7540> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006331" prio=5 tid=0x0a9b89c8 nid=0x3a4 in Objec
                t.wait() [1b74f000..1b74fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f75d0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006237" prio=5 tid=0x0a9b7da8 nid=0x15c0 in Obje
                ct.wait() [1b70f000..1b70fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f7660> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006112" prio=5 tid=0x0a9b7188 nid=0x1988 in Obje
                ct.wait() [1b6cf000..1b6cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107f76f0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671006034" prio=5 tid=0x0a9b6568 nid=0x1b1c in Obje
                ct.wait() [1b68f000..1b68fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107e4b98> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005925" prio=5 tid=0x0a9b5948 nid=0x3558 in Obje
                ct.wait() [1b64f000..1b64fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107e4c28> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005831" prio=5 tid=0x0aa25d60 nid=0x3290 in Obje
                ct.wait() [1b60f000..1b60fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107e4cb8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005722" prio=5 tid=0x0a9159d8 nid=0x333c in Obje
                ct.wait() [1b5cf000..1b5cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d04f0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005644" prio=5 tid=0x0a92d9d8 nid=0xc54 in Objec
                t.wait() [1b58f000..1b58fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0580> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005519" prio=5 tid=0x0a9fd9d8 nid=0x1864 in Obje
                ct.wait() [1b54f000..1b54fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0610> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005409" prio=5 tid=0x0a9bde18 nid=0x1b50 in Obje
                ct.wait() [1b50f000..1b50fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d06a0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005300" prio=5 tid=0x0a988808 nid=0x2404 in Obje
                ct.wait() [1b4cf000..1b4cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0730> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005206" prio=5 tid=0x0a9edc48 nid=0x280 in Objec
                t.wait() [1b48f000..1b48fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d07c0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005097" prio=5 tid=0x0a8d4408 nid=0x1230 in Obje
                ct.wait() [1b44f000..1b44fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0850> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671005019" prio=5 tid=0x0a90dc80 nid=0x188c in Obje
                ct.wait() [1b40f000..1b40fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d08e0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004894" prio=5 tid=0x0a91dc80 nid=0x1268 in Obje
                ct.wait() [1b3cf000..1b3cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0970> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004784" prio=5 tid=0x0aa24eb8 nid=0x3238 in Obje
                ct.wait() [1b38f000..1b38fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0a00> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004441" prio=5 tid=0x0aa236c8 nid=0x4ac in Objec
                t.wait() [1b34f000..1b34fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0a90> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004394" prio=5 tid=0x0aa22848 nid=0x16a4 in Obje
                ct.wait() [1b30f000..1b30fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0b20> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004331" prio=5 tid=0x0aa21d68 nid=0x2334 in Obje
                ct.wait() [1b2cf000..1b2cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0bb0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004237" prio=5 tid=0x0aa21318 nid=0x28e4 in Obje
                ct.wait() [1b28f000..1b28fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0c40> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004112" prio=5 tid=0x0aa21050 nid=0x9f4 in Objec
                t.wait() [1b24f000..1b24fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0cd0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671004019" prio=5 tid=0x0a9a4590 nid=0x2c50 in Obje
                ct.wait() [1b20f000..1b20fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0d60> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003925" prio=5 tid=0x0a9a3970 nid=0x34a0 in Obje
                ct.wait() [1b1cf000..1b1cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0df0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003816" prio=5 tid=0x0a9a2d50 nid=0x1834 in Obje
                ct.wait() [1b18f000..1b18fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0e80> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003706" prio=5 tid=0x0a9a2130 nid=0x1968 in Obje
                ct.wait() [1b14f000..1b14fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0f10> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003612" prio=5 tid=0x0a9a1510 nid=0xac in Object
                .wait() [1b10f000..1b10fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d0fa0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003519" prio=5 tid=0x0a9a08f0 nid=0x338c in Obje
                ct.wait() [1b0cf000..1b0cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d1030> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003425" prio=5 tid=0x0a99fcd0 nid=0xb2c in Objec
                t.wait() [1b08f000..1b08fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d10c0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003316" prio=5 tid=0x0a99f0b0 nid=0x1778 in Obje
                ct.wait() [1b04f000..1b04fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d1150> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003206" prio=5 tid=0x0a99e490 nid=0x3604 in Obje
                ct.wait() [1b00f000..1b00fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d11e0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671003128" prio=5 tid=0x0a99d870 nid=0x848 in Objec
                t.wait() [1afcf000..1afcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d1270> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002987" prio=5 tid=0x0a99cc50 nid=0x25d4 in Obje
                ct.wait() [1af8f000..1af8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d1300> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002878" prio=5 tid=0x0a99c030 nid=0x3614 in Obje
                ct.wait() [1af4f000..1af4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d1390> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002769" prio=5 tid=0x0a99b410 nid=0x2ff8 in Obje
                ct.wait() [1af0f000..1af0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107d1420> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002691" prio=5 tid=0x0a999fe0 nid=0xc48 in Objec
                t.wait() [1aecf000..1aecfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8640> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002566" prio=5 tid=0x0a9993c0 nid=0x2540 in Obje
                ct.wait() [1ae8f000..1ae8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c86d0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002487" prio=5 tid=0x0a9987a0 nid=0xe98 in Objec
                t.wait() [1ae4f000..1ae4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8760> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002378" prio=5 tid=0x0a997b80 nid=0x1110 in Obje
                ct.wait() [1ae0f000..1ae0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c87f0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002269" prio=5 tid=0x0a996f60 nid=0x7e0 in Objec
                t.wait() [1adcf000..1adcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8880> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002175" prio=5 tid=0x0a996340 nid=0x26b8 in Obje
                ct.wait() [1ad8f000..1ad8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8910> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671002066" prio=5 tid=0x0a995720 nid=0x15f0 in Obje
                ct.wait() [1ad4f000..1ad4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c89a0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001972" prio=5 tid=0x0a994b00 nid=0x27a4 in Obje
                ct.wait() [1ad0f000..1ad0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8a30> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001862" prio=5 tid=0x0a993ee0 nid=0x1240 in Obje
                ct.wait() [1accf000..1accfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8ac0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001753" prio=5 tid=0x0a9932c0 nid=0x2dd0 in Obje
                ct.wait() [1ac8f000..1ac8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8b50> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001675" prio=5 tid=0x0a9926a0 nid=0x2538 in Obje
                ct.wait() [1ac4f000..1ac4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8be0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001566" prio=5 tid=0x0a991a80 nid=0x9ec in Objec
                t.wait() [1ac0f000..1ac0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8c70> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001269" prio=5 tid=0x0a990e60 nid=0x1020 in Obje
                ct.wait() [1abcf000..1abcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107c8d00> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001175" prio=5 tid=0x0a990240 nid=0xecc in Objec
                t.wait() [1ab8f000..1ab8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bd960> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001097" prio=5 tid=0x0a98f618 nid=0x1944 in Obje
                ct.wait() [1ab4f000..1ab4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bd9f0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671001034" prio=5 tid=0x0a98e9f8 nid=0x1638 in Obje
                ct.wait() [1ab0f000..1ab0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bda80> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671000956" prio=5 tid=0x0a98ddd8 nid=0x1fd0 in Obje
                ct.wait() [1aacf000..1aacfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdb10> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671000831" prio=5 tid=0x0a98da70 nid=0x31d0 in Obje
                ct.wait() [1aa8f000..1aa8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdba0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671000659" prio=5 tid=0x0a98c180 nid=0x1050 in Obje
                ct.wait() [1aa4f000..1aa4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdc30> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671000487" prio=5 tid=0x0a98b560 nid=0x2204 in Obje
                ct.wait() [1aa0f000..1aa0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdcc0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671000347" prio=5 tid=0x0a98a940 nid=0x3568 in Obje
                ct.wait() [1a9cf000..1a9cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdd50> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671000175" prio=5 tid=0x0a98a678 nid=0x648 in Objec
                t.wait() [1a98f000..1a98fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdde0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066671000081" prio=5 tid=0x0a9897b0 nid=0xdcc in Objec
                t.wait() [1a94f000..1a94fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bde70> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999972" prio=5 tid=0x0a9773c0 nid=0x16b8 in Obje
                ct.wait() [1a90f000..1a90fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdf00> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999862" prio=5 tid=0x0a9767a0 nid=0xcc8 in Objec
                t.wait() [1a8cf000..1a8cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107bdf90> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999769" prio=5 tid=0x0a975b80 nid=0x23fc in Obje
                ct.wait() [1a88f000..1a88fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107be020> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999659" prio=5 tid=0x0a974f60 nid=0x23c4 in Obje
                ct.wait() [1a84f000..1a84fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107be0b0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999534" prio=5 tid=0x0a974340 nid=0xa20 in Objec
                t.wait() [1a80f000..1a80fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107be140> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999425" prio=5 tid=0x0a973720 nid=0x3060 in Obje
                ct.wait() [1a7cf000..1a7cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107be1d0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999331" prio=5 tid=0x0a972b38 nid=0x362c in Obje
                ct.wait() [1a78f000..1a78fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1298> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999222" prio=5 tid=0x0a972008 nid=0x221c in Obje
                ct.wait() [1a74f000..1a74fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1328> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999144" prio=5 tid=0x0a970c00 nid=0x1ba8 in Obje
                ct.wait() [1a70f000..1a70fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b13b8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670999019" prio=5 tid=0x0a96ffe0 nid=0x2f88 in Obje
                ct.wait() [1a6cf000..1a6cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1448> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998800" prio=5 tid=0x0a96f3c0 nid=0x1208 in Obje
                ct.wait() [1a68f000..1a68fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b14d8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998644" prio=5 tid=0x0a96e578 nid=0x3694 in Obje
                ct.wait() [1a64f000..1a64fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1568> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998566" prio=5 tid=0x0a96d958 nid=0x2cd8 in Obje
                ct.wait() [1a60f000..1a60fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b15f8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998519" prio=5 tid=0x0a96cd38 nid=0x26a4 in Obje
                ct.wait() [1a5cf000..1a5cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1688> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998456" prio=5 tid=0x0a96c118 nid=0x2978 in Obje
                ct.wait() [1a58f000..1a58fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1718> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998347" prio=5 tid=0x0a96b4f8 nid=0x1570 in Obje
                ct.wait() [1a54f000..1a54fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b17a8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998269" prio=5 tid=0x0a96a8d8 nid=0x2264 in Obje
                ct.wait() [1a50f000..1a50fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1838> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998159" prio=5 tid=0x0a969cb8 nid=0xea0 in Objec
                t.wait() [1a4cf000..1a4cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b18c8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670998050" prio=5 tid=0x0a969098 nid=0x184c in Obje
                ct.wait() [1a48f000..1a48fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1958> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997972" prio=5 tid=0x0a968478 nid=0x2f54 in Obje
                ct.wait() [1a44f000..1a44fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b19e8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997862" prio=5 tid=0x0a967858 nid=0x3540 in Obje
                ct.wait() [1a40f000..1a40fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1a78> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997737" prio=5 tid=0x0a966c38 nid=0x121c in Obje
                ct.wait() [1a3cf000..1a3cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1b08> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997644" prio=5 tid=0x0a966018 nid=0x2770 in Obje
                ct.wait() [1a38f000..1a38fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1b98> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997519" prio=5 tid=0x0a965cb0 nid=0x970 in Objec
                t.wait() [1a34f000..1a34fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1c28> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997409" prio=5 tid=0x0a971be0 nid=0xdf0 in Objec
                t.wait() [1a30f000..1a30fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107b1cb8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997222" prio=5 tid=0x0a963ef0 nid=0x2320 in Obje
                ct.wait() [1a2cf000..1a2cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10799fb0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997112" prio=5 tid=0x0a9626a0 nid=0x83c in Objec
                t.wait() [1a28f000..1a28fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10799e80> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670997019" prio=5 tid=0x0a9623d8 nid=0x1338 in Obje
                ct.wait() [1a24f000..1a24fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10796be0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996925" prio=5 tid=0x0a960780 nid=0xdd0 in Objec
                t.wait() [1a20f000..1a20fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10796c70> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996831" prio=5 tid=0x0a95fb60 nid=0x1c4c in Obje
                ct.wait() [1a1cf000..1a1cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10796d00> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996706" prio=5 tid=0x0a95f808 nid=0x980 in Objec
                t.wait() [1a18f000..1a18fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10796d90> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996597" prio=5 tid=0x0a91c1d0 nid=0x368c in Obje
                ct.wait() [1a14f000..1a14fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10795728> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996487" prio=5 tid=0x0a91b5b0 nid=0x2650 in Obje
                ct.wait() [1a10f000..1a10fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107957b8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996394" prio=5 tid=0x0a91a990 nid=0x1d04 in Obje
                ct.wait() [1a0cf000..1a0cfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107942e8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996269" prio=5 tid=0x0a91a588 nid=0x1df8 in Obje
                ct.wait() [1a08f000..1a08fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10794378> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996159" prio=5 tid=0x0a9197b8 nid=0x99c in Objec
                t.wait() [1a04f000..1a04fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10792e28> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670996034" prio=5 tid=0x0a918810 nid=0x3fc in Objec
                t.wait() [1a00f000..1a00fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10792eb8> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995956" prio=5 tid=0x0a917018 nid=0x36e8 in Obje
                ct.wait() [19fcf000..19fcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10791a20> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995847" prio=5 tid=0x0a8e3ad0 nid=0x340c in Obje
                ct.wait() [19f8f000..19f8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10791ab0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995722" prio=5 tid=0x0a8e2eb0 nid=0x220 in Objec
                t.wait() [19f4f000..19f4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x107905b0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995612" prio=5 tid=0x0a8e22a8 nid=0x2b30 in Obje
                ct.wait() [19f0f000..19f0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x10790640> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995534" prio=5 tid=0x0a8e1670 nid=0xd64 in Objec
                t.wait() [19ecf000..19ecfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1078f0f0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995394" prio=5 tid=0x0a8e0a50 nid=0x2e7c in Obje
                ct.wait() [19e8f000..19e8fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1078f180> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995284" prio=5 tid=0x0a8dfe30 nid=0x30c8 in Obje
                ct.wait() [19e4f000..19e4fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1078df40> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995206" prio=5 tid=0x0a8dfac8 nid=0x2afc in Obje
                ct.wait() [19e0f000..19e0fd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1078dfd0> (a java.util.LinkedList)
                at java.lang.Thread.run(Thread.java:534)

                "MessageListenerThread - 1066670995081" prio=5 tid=0x0a8de410 nid=0x19fc in Obje
                ct.wait() [19dcf000..19dcfd94]
                at java.lang.Object.wait(Native Method)
                at java.lang.Object.wait(Object.java:429)
                at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                - locked <0x1078c9f8> (a java.util.LinkedList

                • 5. Re: JBoss MQ hangs
                  arabin

                  Unfortunately , the last thread dump did not come through.

                  There are similar threads, but there are also different ones at the end:

                  "MessageListenerThread - 1066670893081" prio=5 tid=0x02ca17f0 nid=0x220c in Obje
                  ct.wait() [307f000..307fd94]
                  at java.lang.Object.wait(Native Method)
                  - waiting on <0x1051cea8> (a java.util.LinkedList)
                  at java.lang.Object.wait(Object.java:429)
                  at org.jboss.mq.SpyMessageConsumer.run(SpyMessageConsumer.java:488)
                  - locked <0x1051cea8> (a java.util.LinkedList)
                  at java.lang.Thread.run(Thread.java:534)

                  "Connection Monitor Thread" daemon prio=5 tid=0x02c9ce80 nid=0x2c04 runnable [30
                  3f000..303fd94]
                  at java.lang.Object.wait(Native Method)
                  - waiting on <0x105155d8> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemo
                  n)
                  at EDU.oswego.cs.dl.util.concurrent.ClockDaemon.nextTask(ClockDaemon.jav
                  a:328)
                  - locked <0x105155d8> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemon)
                  at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(ClockDaemon.
                  java:362)
                  at java.lang.Thread.run(Thread.java:534)

                  "OILClientILService-0" daemon prio=5 tid=0x02c9bac0 nid=0x1980 runnable [2fff000
                  ..2fffd94]
                  at java.net.SocketInputStream.socketRead0(Native Method)
                  at java.net.SocketInputStream.read(SocketInputStream.java:129)
                  at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
                  at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
                  - locked <0x10515ea8> (a java.io.BufferedInputStream)
                  at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java
                  :2133)
                  at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Object
                  InputStream.java:2313)
                  at java.io.ObjectInputStream$BlockDataInputStream.refill(ObjectInputStre
                  am.java:2380)
                  at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream
                  .java:2452)
                  at java.io.ObjectInputStream$BlockDataInputStream.readByte(ObjectInputSt
                  ream.java:2601)
                  at java.io.ObjectInputStream.readByte(ObjectInputStream.java:845)
                  at org.jboss.mq.il.oil.OILClientILService.run(OILClientILService.java:18
                  3)
                  at java.lang.Thread.run(Thread.java:534)

                  "GC Daemon" daemon prio=2 tid=0x00a633f0 nid=0x175c in Object.wait() [2f7f000..2
                  f7fd94]
                  at java.lang.Object.wait(Native Method)
                  - waiting on <0x1050c760> (a sun.misc.GC$LatencyLock)
                  at sun.misc.GC$Daemon.run(GC.java:100)
                  - locked <0x1050c760> (a sun.misc.GC$LatencyLock)

                  "RMI RenewClean-[192.168.1.19:3028]" daemon prio=5 tid=0x00a631e8 nid=0x1ef4 in
                  Object.wait() [2f3f000..2f3fd94]
                  at java.lang.Object.wait(Native Method)
                  - waiting on <0x1050c530> (a java.lang.ref.ReferenceQueue$Lock)
                  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
                  - locked <0x1050c530> (a java.lang.ref.ReferenceQueue$Lock)
                  at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCCli
                  ent.java:500)
                  at java.lang.Thread.run(Thread.java:534)

                  "Signal Dispatcher" daemon prio=10 tid=0x009f8f28 nid=0x26fc waiting on conditio
                  n [0..0]

                  "Finalizer" daemon prio=9 tid=0x009bf100 nid=0xea4 in Object.wait() [2b5f000..2b
                  5fd94]
                  at java.lang.Object.wait(Native Method)
                  - waiting on <0x104f8168> (a java.lang.ref.ReferenceQueue$Lock)
                  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
                  - locked <0x104f8168> (a java.lang.ref.ReferenceQueue$Lock)
                  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
                  at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

                  "Reference Handler" daemon prio=10 tid=0x009bdcd0 nid=0x2948 in Object.wait() [2
                  b1f000..2b1fd94]
                  at java.lang.Object.wait(Native Method)
                  - waiting on <0x104f81d0> (a java.lang.ref.Reference$Lock)
                  at java.lang.Object.wait(Object.java:429)
                  at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
                  - locked <0x104f81d0> (a java.lang.ref.Reference$Lock)

                  "main" prio=5 tid=0x00034d20 nid=0x1be8 in Object.wait() [7f000..7fc3c]
                  at java.lang.Object.wait(Native Method)
                  at java.lang.Object.wait(Object.java:429)
                  at org.jboss.mq.SpyMessageConsumer.receive(SpyMessageConsumer.java:197)
                  - locked <0x10812d88> (a java.util.LinkedList)
                  at com.wrn.teamworks.cms.cms.MessageServiceObjectSender.finallySendLocal
                  lyAndWait(MessageServiceObjectSender.java:326)
                  at com.wrn.teamworks.cms.cms.MessageServiceObjectHighSender.sendAndWaitR
                  esponse(MessageServiceObjectHighSender.java:296)
                  at com.wrn.teamworks.cms.cms.MessageServiceObjectHighSender.sendAndWaitR
                  esponse(MessageServiceObjectHighSender.java:234)
                  at com.wrn.teamworks.cms.cms.MessageServiceObject.invoke(MessageServiceO
                  bject.java:116)
                  at com.wrn.teamworks.cms.cms.MessageServiceObject.invoke(MessageServiceO
                  bject.java:85)
                  at com.wrn.teamworks.cms.cms.MessageServiceObjectHighSender.sendAndWaitR
                  esponse(MessageServiceObjectHighSender.java:402)
                  at com.wrn.teamworks.cms.cms.MessageServiceObject.sendAndReceive(Message
                  ServiceObject.java:661)
                  at com.wrn.teamworks.cms.client.ExampleMultipleLocalSenderAndAsynchWaite
                  r.main(ExampleMultipleLocalSenderAndAsynchWaiter.java:61)

                  "VM Thread" prio=5 tid=0x009f76e8 nid=0x2068 runnable

                  "VM Periodic Task Thread" prio=10 tid=0x009fb730 nid=0x20b0 waiting on condition

                  "Suspend Checker Thread" prio=10 tid=0x009f85e0 nid=0x964 runnable

                  • 6. Re: JBoss MQ hangs
                    arabin

                    Yeah, I managed to attach the files. It was not easy.

                    • 7. Re: JBoss MQ hangs
                      pants

                      Did you find a fix for this, I'm seeing the same behaviour. Thanks in advance.

                      • 8. Re: JBoss MQ hangs
                        starksm64

                        Try indicating what version of jboss is being used.
                        Try the using the more stable UIL2 transport protocol available under the connection factory JNDI name 'UIL2ConnectionFactory'