1 2 Previous Next 22 Replies Latest reply on Sep 12, 2018 7:11 AM by george.labuschagne Go to original post
      • 15. Re: Cannot connect to remote WildFly management console.
        dlofthouse

        To get those log messages it would suggest to me the Remoting connection has been successfully established as the authentication exchange has completed.

         

        I assume as the message is a connection timed out message there is a delay.

         

        I would suggest doing 'kill -3 <pid>' against both the app server process and the CLI process during this delay to get some thread dumps to see if any hanging threads can be spotted.

        • 16. Re: Cannot connect to remote WildFly management console.
          george.labuschagne

          Good day Darran dlofthouse

           

          Below is the stack dump from the client. Both were done in the time period between pressing enter after entering the password and waiting for the timeout to display.

           

          [georgel@devbox bin]$ ./jboss-cli.sh --connect --controller=192.168.0.80:9990
          Authenticating against security realm: ManagementRealm
          Username: edsadmin
          Password: 
          2018-09-12 12:23:00
          Full thread dump OpenJDK 64-Bit Server VM (25.181-b13 mixed mode):
          
          
          "process reaper" #20 daemon prio=10 os_prio=0 tid=0x00007fd708025000 nid=0x6cd4 waiting on condition [0x00007fd75c038000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x0000000085f8a1a8> (a java.util.concurrent.SynchronousQueue$TransferStack)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
          at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
          at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "process reaper" #19 daemon prio=10 os_prio=0 tid=0x00007fd700001800 nid=0x6cd2 waiting on condition [0x00007fd75c1e1000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x0000000085f8a1a8> (a java.util.concurrent.SynchronousQueue$TransferStack)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
          at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
          at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "Remoting "cli-client" task-1" #15 daemon prio=5 os_prio=0 tid=0x00007fd71000d800 nid=0x6c6c runnable [0x00007fd7576fc000]
             java.lang.Thread.State: RUNNABLE
          at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
          at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
          at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
          at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
          at java.net.InetAddress.getAllByName0(InetAddress.java:1253)
          at java.net.InetAddress.getHostFromNameService(InetAddress.java:634)
          at java.net.InetAddress.getHostName(InetAddress.java:559)
          at java.net.InetAddress.getHostName(InetAddress.java:531)
          at java.net.InetSocketAddress$InetSocketAddressHolder.getHostName(InetSocketAddress.java:82)
          at java.net.InetSocketAddress$InetSocketAddressHolder.access$600(InetSocketAddress.java:56)
          at java.net.InetSocketAddress.getHostName(InetSocketAddress.java:345)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication.lambda$null$1(ClientConnectionOpenListener.java:717)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication$$Lambda$150/72663867.createInstance(Unknown Source)
          at org.jboss.remoting3.ConnectionImpl.(ConnectionImpl.java:71)
          at org.jboss.remoting3.EndpointImpl$4.setResult(EndpointImpl.java:602)
          - locked <0x0000000086083fd8> (a java.lang.Object)
          at org.jboss.remoting3.EndpointImpl$4.setResult(EndpointImpl.java:573)
          at org.xnio.IoUtils$ResultNotifier.handleDone(IoUtils.java:725)
          at org.xnio.IoUtils$ResultNotifier.handleDone(IoUtils.java:714)
          at org.xnio.IoFuture$HandlingNotifier.notify(IoFuture.java:208)
          at org.xnio.AbstractIoFuture$NotifierRunnable.run(AbstractIoFuture.java:720)
          at org.xnio.IoUtils$2.execute(IoUtils.java:71)
          at org.xnio.AbstractIoFuture.runNotifier(AbstractIoFuture.java:693)
          at org.xnio.AbstractIoFuture$NotifierState.doNotify(AbstractIoFuture.java:267)
          at org.xnio.AbstractIoFuture$NotifierState.notifyDone(AbstractIoFuture.java:248)
          at org.xnio.AbstractIoFuture$NotifierState.notifyDone(AbstractIoFuture.java:249)
          at org.xnio.AbstractIoFuture$CancellableState.notifyDone(AbstractIoFuture.java:326)
          at org.xnio.AbstractIoFuture.setResult(AbstractIoFuture.java:619)
          at org.xnio.FutureResult.setResult(FutureResult.java:79)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication.lambda$handleEvent$2(ClientConnectionOpenListener.java:723)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication$$Lambda$149/1401298515.run(Unknown Source)
          at org.jboss.remoting3.EndpointImpl$TrackingExecutor.lambda$execute$0(EndpointImpl.java:949)
          at org.jboss.remoting3.EndpointImpl$TrackingExecutor$$Lambda$107/1604279766.run(Unknown Source)
          at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
          at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "Remoting "cli-client" Accept" #14 daemon prio=5 os_prio=0 tid=0x00007fd774bb8000 nid=0x6c6b runnable [0x00007fd7579fe000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x0000000085f7a160> (a sun.nio.ch.Util$3)
          - locked <0x0000000085f7a170> (a java.util.Collections$UnmodifiableSet)
          - locked <0x0000000085f7a118> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "Remoting "cli-client" I/O-1" #13 daemon prio=5 os_prio=0 tid=0x00007fd774999800 nid=0x6c6a runnable [0x00007fd75c158000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x0000000086442d00> (a sun.nio.ch.Util$3)
          - locked <0x0000000086442cf0> (a java.util.Collections$UnmodifiableSet)
          - locked <0x0000000086442bc8> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "Reference Reaper" #9 daemon prio=5 os_prio=0 tid=0x00007fd7742e0000 nid=0x6c66 in Object.wait() [0x00007fd75e2c2000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x0000000085f8a408> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
          - locked <0x0000000085f8a408> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
          at org.jboss.modules.ref.References$ReaperThread.run(References.java:64)
          
          
          "Service Thread" #8 daemon prio=9 os_prio=0 tid=0x00007fd7741f5800 nid=0x6c64 runnable [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C1 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007fd7741e8000 nid=0x6c63 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007fd7741e6000 nid=0x6c62 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007fd7741e3800 nid=0x6c61 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007fd7741d7000 nid=0x6c60 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007fd7741ab000 nid=0x6c5f in Object.wait() [0x00007fd75e9c9000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x0000000085f82208> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
          - locked <0x0000000085f82208> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
          at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)
          
          
          "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007fd7741a6000 nid=0x6c5e in Object.wait() [0x00007fd75eaca000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x0000000085f8b188> (a java.lang.ref.Reference$Lock)
          at java.lang.Object.wait(Object.java:502)
          at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
          - locked <0x0000000085f8b188> (a java.lang.ref.Reference$Lock)
          at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
          
          
          "main" #1 prio=5 os_prio=0 tid=0x00007fd77404b800 nid=0x6c58 waiting on condition [0x00007fd77b50c000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000d7785028> (a org.xnio.FutureResult$1)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at org.xnio.AbstractIoFuture.await(AbstractIoFuture.java:455)
          at org.jboss.as.protocol.GeneralTimeoutHandler.await(GeneralTimeoutHandler.java:60)
          at org.jboss.as.protocol.ProtocolConnectionUtils.connectSync(ProtocolConnectionUtils.java:122)
          at org.jboss.as.protocol.ProtocolConnectionManager$EstablishingConnection.connect(ProtocolConnectionManager.java:259)
          at org.jboss.as.protocol.ProtocolConnectionManager.connect(ProtocolConnectionManager.java:70)
          - locked <0x00000000d7686990> (a org.jboss.as.protocol.ProtocolConnectionManager)
          at org.jboss.as.protocol.mgmt.ManagementClientChannelStrategy$Establishing.getChannel(ManagementClientChannelStrategy.java:167)
          - locked <0x00000000d7686990> (a org.jboss.as.protocol.ProtocolConnectionManager)
          at org.jboss.as.cli.impl.CLIModelControllerClient.getOrCreateChannel(CLIModelControllerClient.java:192)
          at org.jboss.as.cli.impl.CLIModelControllerClient$2.getChannel(CLIModelControllerClient.java:126)
          at org.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:135)
          at org.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:110)
          at org.jboss.as.controller.client.impl.AbstractModelControllerClient.executeRequest(AbstractModelControllerClient.java:263)
          at org.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:168)
          at org.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:147)
          at org.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:75)
          at org.jboss.as.cli.impl.CommandContextImpl.tryConnection(CommandContextImpl.java:1403)
          at org.jboss.as.cli.impl.CommandContextImpl.connectController(CommandContextImpl.java:1235)
          at org.jboss.as.cli.impl.CommandContextImpl.connectController(CommandContextImpl.java:1212)
          at org.jboss.as.cli.impl.CommandContextImpl.connectController(CommandContextImpl.java:1207)
          at org.jboss.as.cli.impl.CliLauncher.initCommandContext(CliLauncher.java:328)
          at org.jboss.as.cli.impl.CliLauncher.main(CliLauncher.java:304)
          at org.jboss.as.cli.CommandLineMain.main(CommandLineMain.java:45)
          at java.lang.invoke.LambdaForm$DMH/455659002.invokeStatic_L_V(LambdaForm$DMH)
          at java.lang.invoke.LambdaForm$MH/222624801.invokeExact_MT(LambdaForm$MH)
          at org.jboss.modules.Module.run(Module.java:352)
          at org.jboss.modules.Module.run(Module.java:320)
          at org.jboss.modules.Main.main(Main.java:593)
          
          
          "VM Thread" os_prio=0 tid=0x00007fd77419c800 nid=0x6c5d runnable 
          
          
          "GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007fd77405e000 nid=0x6c59 runnable 
          
          
          "GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007fd774060000 nid=0x6c5a runnable 
          
          
          "GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007fd774062000 nid=0x6c5b runnable 
          
          
          "GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007fd774063800 nid=0x6c5c runnable 
          
          
          "VM Periodic Task Thread" os_prio=0 tid=0x00007fd7741f7800 nid=0x6c65 waiting on condition 
          
          
          JNI global references: 555
          
          
          Heap
           PSYoungGen      total 68608K, used 13693K [0x00000000d7400000, 0x00000000dbc00000, 0x0000000100000000)
            eden space 63488K, 21% used [0x00000000d7400000,0x00000000d815f740,0x00000000db200000)
            from space 5120K, 0% used [0x00000000db700000,0x00000000db700000,0x00000000dbc00000)
            to   space 5120K, 0% used [0x00000000db200000,0x00000000db200000,0x00000000db700000)
           ParOldGen       total 59904K, used 8588K [0x0000000085c00000, 0x0000000089680000, 0x00000000d7400000)
            object space 59904K, 14% used [0x0000000085c00000,0x0000000086463188,0x0000000089680000)
           Metaspace       used 22970K, capacity 24628K, committed 24704K, reserved 1071104K
            class space    used 2694K, capacity 3185K, committed 3200K, reserved 1048576K
          
          
          Failed to connect to the controller: The controller is not available at 192.168.0.80:9990: java.net.ConnectException: WFLYPRT0023: Could not connect to remote+http://192.168.0.80:9990. The connection timed out: WFLYPRT0023: Could not connect to remote+http://192.168.0.80:9990. The connection timed out
          2018-09-12 12:23:09
          Full thread dump OpenJDK 64-Bit Server VM (25.181-b13 mixed mode):
          
          
          "CLI Shutdown Hook" #12 prio=5 os_prio=0 tid=0x00007fd774429800 nid=0x6ceb waiting for monitor entry [0x00007fd755cfa000]
             java.lang.Thread.State: BLOCKED (on object monitor)
          at org.jboss.remoting3.EndpointImpl.closeAction(EndpointImpl.java:391)
          - waiting to lock <0x0000000086083fd8> (a java.lang.Object)
          at org.jboss.remoting3.spi.AbstractHandleableCloseable.close(AbstractHandleableCloseable.java:150)
          at org.jboss.as.cli.impl.CLIModelControllerClient$1.shutdown(CLIModelControllerClient.java:92)
          at org.jboss.as.cli.impl.CliShutdownHook$1.run(CliShutdownHook.java:50)
          - locked <0x0000000085c7baa8> (a java.util.ArrayList)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "process reaper" #20 daemon prio=10 os_prio=0 tid=0x00007fd708025000 nid=0x6cd4 waiting on condition [0x00007fd75c038000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x0000000085f8a1a8> (a java.util.concurrent.SynchronousQueue$TransferStack)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
          at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
          at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "process reaper" #19 daemon prio=10 os_prio=0 tid=0x00007fd700001800 nid=0x6cd2 waiting on condition [0x00007fd75c1e1000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x0000000085f8a1a8> (a java.util.concurrent.SynchronousQueue$TransferStack)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
          at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
          at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "Remoting "cli-client" task-1" #15 daemon prio=5 os_prio=0 tid=0x00007fd71000d800 nid=0x6c6c runnable [0x00007fd7576fc000]
             java.lang.Thread.State: RUNNABLE
          at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
          at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
          at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
          at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
          at java.net.InetAddress.getAllByName0(InetAddress.java:1253)
          at java.net.InetAddress.getHostFromNameService(InetAddress.java:634)
          at java.net.InetAddress.getHostName(InetAddress.java:559)
          at java.net.InetAddress.getHostName(InetAddress.java:531)
          at java.net.InetSocketAddress$InetSocketAddressHolder.getHostName(InetSocketAddress.java:82)
          at java.net.InetSocketAddress$InetSocketAddressHolder.access$600(InetSocketAddress.java:56)
          at java.net.InetSocketAddress.getHostName(InetSocketAddress.java:345)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication.lambda$null$1(ClientConnectionOpenListener.java:717)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication$$Lambda$150/72663867.createInstance(Unknown Source)
          at org.jboss.remoting3.ConnectionImpl.(ConnectionImpl.java:71)
          at org.jboss.remoting3.EndpointImpl$4.setResult(EndpointImpl.java:602)
          - locked <0x0000000086083fd8> (a java.lang.Object)
          at org.jboss.remoting3.EndpointImpl$4.setResult(EndpointImpl.java:573)
          at org.xnio.IoUtils$ResultNotifier.handleDone(IoUtils.java:725)
          at org.xnio.IoUtils$ResultNotifier.handleDone(IoUtils.java:714)
          at org.xnio.IoFuture$HandlingNotifier.notify(IoFuture.java:208)
          at org.xnio.AbstractIoFuture$NotifierRunnable.run(AbstractIoFuture.java:720)
          at org.xnio.IoUtils$2.execute(IoUtils.java:71)
          at org.xnio.AbstractIoFuture.runNotifier(AbstractIoFuture.java:693)
          at org.xnio.AbstractIoFuture$NotifierState.doNotify(AbstractIoFuture.java:267)
          at org.xnio.AbstractIoFuture$NotifierState.notifyDone(AbstractIoFuture.java:248)
          at org.xnio.AbstractIoFuture$NotifierState.notifyDone(AbstractIoFuture.java:249)
          at org.xnio.AbstractIoFuture$CancellableState.notifyDone(AbstractIoFuture.java:326)
          at org.xnio.AbstractIoFuture.setResult(AbstractIoFuture.java:619)
          at org.xnio.FutureResult.setResult(FutureResult.java:79)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication.lambda$handleEvent$2(ClientConnectionOpenListener.java:723)
          at org.jboss.remoting3.remote.ClientConnectionOpenListener$Authentication$$Lambda$149/1401298515.run(Unknown Source)
          at org.jboss.remoting3.EndpointImpl$TrackingExecutor.lambda$execute$0(EndpointImpl.java:949)
          at org.jboss.remoting3.EndpointImpl$TrackingExecutor$$Lambda$107/1604279766.run(Unknown Source)
          at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
          at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "Remoting "cli-client" Accept" #14 daemon prio=5 os_prio=0 tid=0x00007fd774bb8000 nid=0x6c6b runnable [0x00007fd7579fe000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x0000000085f7a160> (a sun.nio.ch.Util$3)
          - locked <0x0000000085f7a170> (a java.util.Collections$UnmodifiableSet)
          - locked <0x0000000085f7a118> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "Remoting "cli-client" I/O-1" #13 daemon prio=5 os_prio=0 tid=0x00007fd774999800 nid=0x6c6a runnable [0x00007fd75c158000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x0000000086442d00> (a sun.nio.ch.Util$3)
          - locked <0x0000000086442cf0> (a java.util.Collections$UnmodifiableSet)
          - locked <0x0000000086442bc8> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "Reference Reaper" #9 daemon prio=5 os_prio=0 tid=0x00007fd7742e0000 nid=0x6c66 in Object.wait() [0x00007fd75e2c2000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x0000000085f8a408> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
          - locked <0x0000000085f8a408> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
          at org.jboss.modules.ref.References$ReaperThread.run(References.java:64)
          
          
          "Service Thread" #8 daemon prio=9 os_prio=0 tid=0x00007fd7741f5800 nid=0x6c64 runnable [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C1 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007fd7741e8000 nid=0x6c63 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007fd7741e6000 nid=0x6c62 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007fd7741e3800 nid=0x6c61 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007fd7741d7000 nid=0x6c60 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007fd7741ab000 nid=0x6c5f in Object.wait() [0x00007fd75e9c9000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x0000000085f82208> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
          - locked <0x0000000085f82208> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
          at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)
          
          
          "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007fd7741a6000 nid=0x6c5e in Object.wait() [0x00007fd75eaca000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x0000000085f8b188> (a java.lang.ref.Reference$Lock)
          at java.lang.Object.wait(Object.java:502)
          at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
          - locked <0x0000000085f8b188> (a java.lang.ref.Reference$Lock)
          at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
          
          
          "main" #1 prio=5 os_prio=0 tid=0x00007fd77404b800 nid=0x6c58 in Object.wait() [0x00007fd77b50d000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x000000008626fca0> (a java.lang.Thread)
          at java.lang.Thread.join(Thread.java:1252)
          - locked <0x000000008626fca0> (a java.lang.Thread)
          at java.lang.Thread.join(Thread.java:1326)
          at java.lang.ApplicationShutdownHooks.runHooks(ApplicationShutdownHooks.java:107)
          at java.lang.ApplicationShutdownHooks$1.run(ApplicationShutdownHooks.java:46)
          at java.lang.Shutdown.runHooks(Shutdown.java:123)
          at java.lang.Shutdown.sequence(Shutdown.java:167)
          at java.lang.Shutdown.exit(Shutdown.java:212)
          - locked <0x00000000861a3910> (a java.lang.Class for java.lang.Shutdown)
          at java.lang.Runtime.exit(Runtime.java:109)
          at java.lang.System.exit(System.java:971)
          at org.jboss.as.cli.impl.CliLauncher.main(CliLauncher.java:318)
          at org.jboss.as.cli.CommandLineMain.main(CommandLineMain.java:45)
          at java.lang.invoke.LambdaForm$DMH/455659002.invokeStatic_L_V(LambdaForm$DMH)
          at java.lang.invoke.LambdaForm$MH/222624801.invokeExact_MT(LambdaForm$MH)
          at org.jboss.modules.Module.run(Module.java:352)
          at org.jboss.modules.Module.run(Module.java:320)
          at org.jboss.modules.Main.main(Main.java:593)
          
          
          "VM Thread" os_prio=0 tid=0x00007fd77419c800 nid=0x6c5d runnable 
          
          
          "GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007fd77405e000 nid=0x6c59 runnable 
          
          
          "GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007fd774060000 nid=0x6c5a runnable 
          
          
          "GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007fd774062000 nid=0x6c5b runnable 
          
          
          "GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007fd774063800 nid=0x6c5c runnable 
          
          
          "VM Periodic Task Thread" os_prio=0 tid=0x00007fd7741f7800 nid=0x6c65 waiting on condition 
          
          
          JNI global references: 555
          
          
          Heap
           PSYoungGen      total 68608K, used 14540K [0x00000000d7400000, 0x00000000dbc00000, 0x0000000100000000)
            eden space 63488K, 22% used [0x00000000d7400000,0x00000000d8233248,0x00000000db200000)
            from space 5120K, 0% used [0x00000000db700000,0x00000000db700000,0x00000000dbc00000)
            to   space 5120K, 0% used [0x00000000db200000,0x00000000db200000,0x00000000db700000)
           ParOldGen       total 59904K, used 8588K [0x0000000085c00000, 0x0000000089680000, 0x00000000d7400000)
            object space 59904K, 14% used [0x0000000085c00000,0x0000000086463188,0x0000000089680000)
           Metaspace       used 22991K, capacity 24628K, committed 24704K, reserved 1071104K
            class space    used 2698K, capacity 3185K, committed 3200K, reserved 1048576K
          
          
          [georgel@devbox bin]$ 

           

          And then the stack dump from server:

           

          Full thread dump OpenJDK 64-Bit Server VM (25.181-b13 mixed mode):
          
          
          "EJB default - 2" #192 prio=5 os_prio=0 tid=0x000000000922b000 nid=0x1eac waiting on condition [0x00007f7874c77000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e175c5a8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "EJB default - 1" #191 prio=5 os_prio=0 tid=0x000000000dc81000 nid=0x1eab waiting on condition [0x00007f78756e3000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e175c5a8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "management task-1" #190 prio=5 os_prio=0 tid=0x0000000006357800 nid=0x1e98 waiting on condition [0x00007f786d927000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e0b968f0> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1422)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "SecurityDomain ThreadGroup - 1" #189 prio=5 os_prio=0 tid=0x00000000049f2800 nid=0x1e97 waiting on condition [0x00007f78658e7000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e12bfa50> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "default task-2" #187 prio=5 os_prio=0 tid=0x000000000c61b000 nid=0x1e62 waiting on condition [0x00007f78659e8000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e0b88a08> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "default task-1" #186 prio=5 os_prio=0 tid=0x00000000025ff800 nid=0x1e61 waiting on condition [0x00007f7876342000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e0b88a08> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "Timer-2" #185 daemon prio=5 os_prio=0 tid=0x0000000004548800 nid=0x1e60 in Object.wait() [0x00007f7869d55000]
             java.lang.Thread.State: TIMED_WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          at java.util.TimerThread.mainLoop(Timer.java:552)
          - locked <0x00000000ed59dff8> (a java.util.TaskQueue)
          at java.util.TimerThread.run(Timer.java:505)
          
          
          "jaeger.RemoteReporter-FlushTimer" #184 daemon prio=5 os_prio=0 tid=0x0000000003c64800 nid=0x1e5f in Object.wait() [0x00007f7869953000]
             java.lang.Thread.State: TIMED_WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          at java.util.TimerThread.mainLoop(Timer.java:552)
          - locked <0x00000000ed59ccb8> (a java.util.TaskQueue)
          at java.util.TimerThread.run(Timer.java:505)
          
          
          "jaeger.RemoteReporter-QueueProcessor" #183 daemon prio=5 os_prio=0 tid=0x0000000002608000 nid=0x1e5e waiting on condition [0x00007f7869852000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000ed59c940> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
          at io.jaegertracing.internal.reporters.RemoteReporter$QueueProcessor.run(RemoteReporter.java:170)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "ServerService Thread Pool -- 121" #182 prio=5 os_prio=0 tid=0x000000000d906000 nid=0x1e5d waiting on condition [0x00007f786ceb3000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e034e830> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "Weld Thread Pool -- 5" #132 prio=5 os_prio=0 tid=0x000000000ceaa800 nid=0x1e2b waiting on condition [0x00007f7869c54000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e6493458> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "Weld Thread Pool -- 4" #130 prio=5 os_prio=0 tid=0x0000000002f59800 nid=0x1e29 waiting on condition [0x00007f7869e56000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e6493458> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "Weld Thread Pool -- 3" #129 prio=5 os_prio=0 tid=0x0000000007a04000 nid=0x1e28 waiting on condition [0x00007f7869f57000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e6493458> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "Weld Thread Pool -- 2" #128 prio=5 os_prio=0 tid=0x00000000027a4800 nid=0x1e27 waiting on condition [0x00007f786a058000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e6493458> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "Weld Thread Pool -- 1" #127 prio=5 os_prio=0 tid=0x0000000003d54800 nid=0x1e26 waiting on condition [0x00007f786cdb2000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e6493458> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "Log4j2-TF-2-Scheduled-1" #126 daemon prio=5 os_prio=0 tid=0x0000000005c36000 nid=0x1e23 waiting on condition [0x00007f786b559000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e640f8e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "ServerService Thread Pool -- 73" #125 prio=5 os_prio=0 tid=0x000000000b001000 nid=0x1e22 waiting on condition [0x00007f786c075000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e034e830> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "expiration-thread--p4-t1" #123 daemon prio=1 os_prio=0 tid=0x0000000008463000 nid=0x1e20 waiting on condition [0x00007f786c9b0000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e3395f78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at org.wildfly.clustering.service.concurrent.ClassLoaderThreadFactory.lambda$newThread$0(ClassLoaderThreadFactory.java:47)
          at org.wildfly.clustering.service.concurrent.ClassLoaderThreadFactory$$Lambda$618/536359953.run(Unknown Source)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "Transaction Reaper Worker 0" #118 daemon prio=5 os_prio=0 tid=0x0000000002bf8000 nid=0x1e13 in Object.wait() [0x00007f786e532000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x00000000e1b2cff0> (a java.util.LinkedList)
          at java.lang.Object.wait(Object.java:502)
          at com.arjuna.ats.arjuna.coordinator.TransactionReaper.waitForCancellations(TransactionReaper.java:328)
          - locked <0x00000000e1b2cff0> (a java.util.LinkedList)
          at com.arjuna.ats.internal.arjuna.coordinator.ReaperWorkerThread.run(ReaperWorkerThread.java:65)
          
          
          "Transaction Reaper" #117 daemon prio=5 os_prio=0 tid=0x0000000006179800 nid=0x1e12 in Object.wait() [0x00007f786e633000]
             java.lang.Thread.State: TIMED_WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          at com.arjuna.ats.internal.arjuna.coordinator.ReaperThread.run(ReaperThread.java:90)
          - locked <0x00000000e1b2cf00> (a com.arjuna.ats.arjuna.coordinator.TransactionReaper)
          
          
          "Periodic Recovery" #114 prio=5 os_prio=0 tid=0x0000000004ea3000 nid=0x1e11 in Object.wait() [0x00007f786e734000]
             java.lang.Thread.State: TIMED_WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doPeriodicWait(PeriodicRecovery.java:678)
          at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:398)
          - locked <0x00000000e176e928> (a java.lang.Object)
          
          
          "Transaction Expired Entry Monitor" #116 daemon prio=5 os_prio=0 tid=0x000000000403f000 nid=0x1e10 in Object.wait() [0x00007f786e835000]
             java.lang.Thread.State: TIMED_WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x00000000e1b2c9f0> (a com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor)
          at com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor.run(ExpiredEntryMonitor.java:190)
          - locked <0x00000000e1b2c9f0> (a com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor)
          
          
          "Timer-1" #115 prio=5 os_prio=0 tid=0x0000000002aa5000 nid=0x1e0f in Object.wait() [0x00007f786e936000]
             java.lang.Thread.State: TIMED_WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          at java.util.TimerThread.mainLoop(Timer.java:552)
          - locked <0x00000000e175d0e8> (a java.util.TaskQueue)
          at java.util.TimerThread.run(Timer.java:505)
          
          
          "IdleRemover" #113 daemon prio=5 os_prio=0 tid=0x000000000849d800 nid=0x1e0e waiting on condition [0x00007f786f0ea000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e11940b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
          at org.jboss.jca.core.connectionmanager.pool.idle.IdleRemover$IdleRemoverRunner.run(IdleRemover.java:261)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "ConnectionValidator" #112 daemon prio=5 os_prio=0 tid=0x0000000008310000 nid=0x1e0d waiting on condition [0x00007f786f1eb000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e11930a8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
          at org.jboss.jca.core.connectionmanager.pool.validator.ConnectionValidator$ConnectionValidatorRunner.run(ConnectionValidator.java:263)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "default Accept" #111 prio=5 os_prio=0 tid=0x00000000080b2000 nid=0x1e0c runnable [0x00007f786f4ec000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b946b0> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b946a0> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b94588> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-8" #110 prio=5 os_prio=0 tid=0x00000000080ae000 nid=0x1e0b runnable [0x00007f786f5ed000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b890b0> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b890a0> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b88f88> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-7" #109 prio=5 os_prio=0 tid=0x00000000080a9000 nid=0x1e0a runnable [0x00007f786f6ee000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b8a770> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b8a760> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b8a648> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-6" #108 prio=5 os_prio=0 tid=0x00000000080a6800 nid=0x1e09 runnable [0x00007f786f7ef000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b8be30> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b8be20> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b8bd08> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-5" #107 prio=5 os_prio=0 tid=0x00000000080a4000 nid=0x1e08 runnable [0x00007f786f8f0000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b8d4f0> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b8d4e0> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b8d3c8> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-4" #106 prio=5 os_prio=0 tid=0x00000000080a1800 nid=0x1e07 runnable [0x00007f786f9f1000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b8ebb0> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b8eba0> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b8ea88> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-3" #105 prio=5 os_prio=0 tid=0x00000000080a0800 nid=0x1e06 runnable [0x00007f786faf2000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b90270> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b90260> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b90148> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-2" #104 prio=5 os_prio=0 tid=0x000000000809d000 nid=0x1e05 runnable [0x00007f786fbf3000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b91930> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b91920> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b91808> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "default I/O-1" #103 prio=5 os_prio=0 tid=0x0000000008089000 nid=0x1e04 runnable [0x00007f786fcf4000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0b92ff0> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0b92fe0> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0b92ec8> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "Timer-0" #102 prio=5 os_prio=0 tid=0x00000000062da800 nid=0x1e03 in Object.wait() [0x00007f786fff5000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x00000000e1077b50> (a java.util.TaskQueue)
          at java.lang.Object.wait(Object.java:502)
          at java.util.TimerThread.mainLoop(Timer.java:526)
          - locked <0x00000000e1077b50> (a java.util.TaskQueue)
          at java.util.TimerThread.run(Timer.java:505)
          
          
          "management Accept" #101 prio=5 os_prio=0 tid=0x0000000006424800 nid=0x1e02 runnable [0x00007f78700f6000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0ba54a0> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0ba5490> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0ba5378> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "management I/O-2" #100 prio=5 os_prio=0 tid=0x00000000062c0000 nid=0x1e01 runnable [0x00007f78701f7000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0ba2718> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0ba2708> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0ba25f0> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "management I/O-1" #97 prio=5 os_prio=0 tid=0x0000000006d02000 nid=0x1e00 runnable [0x00007f78702f8000]
             java.lang.Thread.State: RUNNABLE
          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
          - locked <0x00000000e0ba3dd8> (a sun.nio.ch.Util$3)
          - locked <0x00000000e0ba3dc8> (a java.util.Collections$UnmodifiableSet)
          - locked <0x00000000e0ba3cb0> (a sun.nio.ch.EPollSelectorImpl)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
          at org.xnio.nio.WorkerThread.run(WorkerThread.java:532)
          
          
          "ServerService Thread Pool -- 38" #65 prio=5 os_prio=0 tid=0x000000000638a800 nid=0x1dde waiting on condition [0x00007f7872877000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e034e830> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "DeploymentScanner-threads - 2" #63 prio=5 os_prio=0 tid=0x0000000007776000 nid=0x1ddc waiting on condition [0x00007f7872518000]
             java.lang.Thread.State: TIMED_WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e0ef39a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "DeploymentScanner-threads - 1" #62 prio=5 os_prio=0 tid=0x0000000007358000 nid=0x1ddb waiting on condition [0x00007f7872ece000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e0ef39a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "ServerService Thread Pool -- 5" #30 prio=5 os_prio=0 tid=0x0000000003acb800 nid=0x1dbb waiting on condition [0x00007f7875e3e000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e02efea8> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "DestroyJavaVM" #26 prio=5 os_prio=0 tid=0x0000000002111800 nid=0x1d9c waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "ServerService Thread Pool -- 1" #25 prio=5 os_prio=0 tid=0x0000000004626800 nid=0x1db7 waiting on condition [0x00007f78771b7000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e034e830> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "ServerDeploymentRepository-temp-threads - 1" #23 daemon prio=5 os_prio=0 tid=0x00000000049b6800 nid=0x1db5 waiting on condition [0x00007f7876643000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e0340af0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
          at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
          at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
          at java.lang.Thread.run(Thread.java:748)
          at org.jboss.threads.JBossThread.run(JBossThread.java:485)
          
          
          "MSC service thread 1-8" #22 prio=5 os_prio=0 tid=0x0000000004778800 nid=0x1db4 waiting on condition [0x00007f7876744000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "MSC service thread 1-7" #21 prio=5 os_prio=0 tid=0x000000000487f800 nid=0x1db3 waiting on condition [0x00007f7876845000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "MSC service thread 1-6" #20 prio=5 os_prio=0 tid=0x0000000004300800 nid=0x1db2 waiting on condition [0x00007f7876946000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "MSC service thread 1-5" #19 prio=5 os_prio=0 tid=0x0000000004127000 nid=0x1db1 waiting on condition [0x00007f7876a47000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "MSC service thread 1-4" #18 prio=5 os_prio=0 tid=0x0000000004124800 nid=0x1db0 waiting on condition [0x00007f7876b48000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "MSC service thread 1-3" #17 prio=5 os_prio=0 tid=0x00000000040d7800 nid=0x1daf waiting on condition [0x00007f7876c49000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "MSC service thread 1-2" #16 prio=5 os_prio=0 tid=0x0000000003ff7800 nid=0x1dae waiting on condition [0x00007f7876f4a000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "MSC service thread 1-1" #15 prio=5 os_prio=0 tid=0x0000000003ff5800 nid=0x1dad waiting on condition [0x00007f787704b000]
             java.lang.Thread.State: WAITING (parking)
          at sun.misc.Unsafe.park(Native Method)
          - parking to wait for  <0x00000000e05a4790> (a org.jboss.threads.EnhancedQueueExecutor)
          at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1410)
          at java.lang.Thread.run(Thread.java:748)
          
          
          "Reference Reaper" #11 daemon prio=5 os_prio=0 tid=0x0000000002559000 nid=0x1dac in Object.wait() [0x00007f787998e000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          - waiting on <0x00000000e051e110> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
          - locked <0x00000000e051e110> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
          at org.jboss.modules.ref.References$ReaperThread.run(References.java:64)
          
          
          "Service Thread" #10 daemon prio=9 os_prio=0 tid=0x0000000002306000 nid=0x1daa runnable [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C1 CompilerThread2" #9 daemon prio=9 os_prio=0 tid=0x00000000022d6000 nid=0x1da9 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C2 CompilerThread1" #8 daemon prio=9 os_prio=0 tid=0x00000000022cb800 nid=0x1da8 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "C2 CompilerThread0" #7 daemon prio=9 os_prio=0 tid=0x00000000022c8800 nid=0x1da7 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "JDWP Event Helper Thread" #6 daemon prio=10 os_prio=0 tid=0x00000000022bc800 nid=0x1da6 runnable [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "JDWP Transport Listener: dt_socket" #5 daemon prio=10 os_prio=0 tid=0x00000000022b8800 nid=0x1da5 runnable [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00000000022a1800 nid=0x1da4 waiting on condition [0x0000000000000000]
             java.lang.Thread.State: RUNNABLE
          
          
          "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x0000000002276800 nid=0x1da3 in Object.wait() [0x00007f787a49c000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
          - locked <0x00000000e01d21e8> (a java.lang.ref.ReferenceQueue$Lock)
          at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
          at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)
          
          
          "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x000000000226c800 nid=0x1da2 in Object.wait() [0x00007f787a59d000]
             java.lang.Thread.State: WAITING (on object monitor)
          at java.lang.Object.wait(Native Method)
          at java.lang.Object.wait(Object.java:502)
          at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
          - locked <0x00000000e01d21b8> (a java.lang.ref.Reference$Lock)
          at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
          
          
          "VM Thread" os_prio=0 tid=0x0000000002262800 nid=0x1da1 runnable 
          
          
          "GC task thread#0 (ParallelGC)" os_prio=0 tid=0x0000000002124800 nid=0x1d9d runnable 
          
          
          "GC task thread#1 (ParallelGC)" os_prio=0 tid=0x0000000002126000 nid=0x1d9e runnable 
          
          
          "GC task thread#2 (ParallelGC)" os_prio=0 tid=0x0000000002128000 nid=0x1d9f runnable 
          
          
          "GC task thread#3 (ParallelGC)" os_prio=0 tid=0x000000000212a000 nid=0x1da0 runnable 
          
          
          "VM Periodic Task Thread" os_prio=0 tid=0x0000000002309000 nid=0x1dab waiting on condition 
          
          
          JNI global references: 24427
          
          
          Heap
           PSYoungGen      total 116736K, used 46324K [0x00000000f5580000, 0x0000000100000000, 0x0000000100000000)
            eden space 58880K, 78% used [0x00000000f5580000,0x00000000f829d0d0,0x00000000f8f00000)
            from space 57856K, 0% used [0x00000000f8f00000,0x00000000f8f20000,0x00000000fc780000)
            to   space 57856K, 0% used [0x00000000fc780000,0x00000000fc780000,0x0000000100000000)
           ParOldGen       total 297472K, used 240228K [0x00000000e0000000, 0x00000000f2280000, 0x00000000f5580000)
            object space 297472K, 80% used [0x00000000e0000000,0x00000000eea99088,0x00000000f2280000)
           Metaspace       used 138019K, capacity 149822K, committed 150016K, reserved 1177600K
            class space    used 17744K, capacity 20956K, committed 20992K, reserved 1048576K
          • 17. Re: Cannot connect to remote WildFly management console.
            dlofthouse

            It looks like it is the reverse DNS lookup from the clients IP address to a host name which is hanging - is this client using DHCP or a statically assigned address?  Mapping the address locally may help.

            • 18. Re: Cannot connect to remote WildFly management console.
              george.labuschagne

              Good day Darran dlofthouse

               

              The client address is currently obtained via DHCP, I applied for a fixed IP from IT now, should have one within the hour or so.

               

              What exactly do you imply when you say:

               

              Mapping the address locally may help.

               

              Is this on the server? Client? Both? If so, how please?

               

              Kind regards,

               

              George

              • 19. Re: Cannot connect to remote WildFly management console.
                dlofthouse

                What is the client running on?

                 

                I don't use Windows often with the app server, on Linux I would add the IP address to my local /etc/hosts

                • 20. Re: Cannot connect to remote WildFly management console.
                  george.labuschagne

                  Darran dlofthouse

                   

                  Both machines are running latest up to date CentOS 7 with firewalld and SELINUX disabled.

                   

                  Thanks, I will add the client to the server's file and vice versa.

                   

                  Will report back.

                  • 21. Re: Cannot connect to remote WildFly management console.
                    dlofthouse

                    In this case it seems the client one is the important one - at the point your client is hanging it is trying to identify it's own host name.

                    • 22. Re: Cannot connect to remote WildFly management console.
                      george.labuschagne

                      Darran, thank you very very much!!!

                       

                      Problem solved, most appreciated friend!

                      1 2 Previous Next