9 Replies Latest reply on Jan 30, 2014 10:43 AM by hindsp

    JBoss hangs during WAR Deployment

    adityan

      Hi,

           My Jboss 7.1.0 hangs while deploying the WAR. It gives the message

       

      14:23:32,845 WARN  [org.jboss.as.dependency.private] (MSC service thread 1-2) JBAS018567: Deployment "deployment.MyWar.war" is using a private module ("org.apache.openjpa:main") which may be changed or removed in future versions without notice.

       

      It then hangs up or gives the message

       

      JBAS015052: Did not receive a response to the deployment operation within the allowed timeout period [5000 seconds]. Check the server configuration file and the server logs to find more about the status of the deployment.

       

       

      I have set the deployment time to 500000 but it still hangs up and does not proceed to deploy war.

        • 1. Re: JBoss hangs during WAR Deployment
          nickarls

          I don't think the warning is related to the hanging. Use jstack to take a stack dump. You might also want to look for resource-usage (e.g. datasource access) in @PostConstruct methods or other suspect code.

          • 2. Re: JBoss hangs during WAR Deployment
            ctomc

            Hi,

             

            Can you please upgrade to 7.2.0.Final (=EAP6.1.0Alpha)

             

            As there are few known issues with deployment hanging in 7.1.0 and ware all fixed.

             

             

             

            --

            tomaz

            • 3. Re: JBoss hangs during WAR Deployment
              adityan

              Hi Nicklas,

                   Thanks for replying to my problem. I have given the jstack trace below. It seems DeploymentScanner Threads go into waiting state on object monitor and do not get recalled.

               

              The stack trace with the help of jstack is as follows:

               

              2013-04-15 17:40:25

              Full thread dump Java HotSpot(TM) Client VM (23.0-b21 mixed mode):

               

               

              "DeploymentScanner-threads - 2" prio=6 tid=0x5924ac00 nid=0x18d4 in Object.wait() [0x56f5e000]

                 java.lang.Thread.State: WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x19817468> (a org.jboss.as.controller.ContainerStateMonitor)

                      at java.lang.Object.wait(Object.java:503)

                      at org.jboss.as.controller.ContainerStateMonitor.awaitContainerStateChangeReport(ContainerStateMonitor.java:161)

                      - locked <0x19817468> (a org.jboss.as.controller.ContainerStateMonitor)

                      at org.jboss.as.controller.ModelControllerImpl.awaitContainerStateChangeReport(ModelControllerImpl.java:430)

                      at org.jboss.as.controller.OperationContextImpl.awaitModelControllerContainerMonitor(OperationContextImpl.java:147)

                      at org.jboss.as.controller.AbstractOperationContext.doCompleteStep(AbstractOperationContext.java:251)

                      at org.jboss.as.controller.AbstractOperationContext.completeStep(AbstractOperationContext.java:202)

                      at org.jboss.as.server.deployment.DeploymentHandlerUtil$1.execute(DeploymentHandlerUtil.java:118)

                      at org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:387)

                      at org.jboss.as.controller.AbstractOperationContext.doCompleteStep(AbstractOperationContext.java:274)

                      at org.jboss.as.controller.AbstractOperationContext.completeStep(AbstractOperationContext.java:202)

                      at org.jboss.as.server.deployment.DeploymentDeployHandler.execute(DeploymentDeployHandler.java:73)

                      at org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:387)

                      at org.jboss.as.controller.AbstractOperationContext.doCompleteStep(AbstractOperationContext.java:274)

                      at org.jboss.as.controller.AbstractOperationContext.completeStep(AbstractOperationContext.java:202)

                      at org.jboss.as.server.deployment.DeploymentAddHandler.execute(DeploymentAddHandler.java:174)

                      at org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:387)

                      at org.jboss.as.controller.AbstractOperationContext.doCompleteStep(AbstractOperationContext.java:274)

                      at org.jboss.as.controller.AbstractOperationContext.completeStep(AbstractOperationContext.java:202)

                      at org.jboss.as.controller.CompositeOperationHandler.execute(CompositeOperationHandler.java:85)

                      at org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:387)

                      at org.jboss.as.controller.AbstractOperationContext.doCompleteStep(AbstractOperationContext.java:274)

                      at org.jboss.as.controller.AbstractOperationContext.completeStep(AbstractOperationContext.java:202)

                      at org.jboss.as.controller.CompositeOperationHandler.execute(CompositeOperationHandler.java:85)

                      at org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:387)

                      at org.jboss.as.controller.AbstractOperationContext.doCompleteStep(AbstractOperationContext.java:274)

                      at org.jboss.as.controller.AbstractOperationContext.completeStep(AbstractOperationContext.java:202)

                      at org.jboss.as.controller.ModelControllerImpl$DefaultPrepareStepHandler.execute(ModelControllerImpl.java:461)

                      at org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:387)

                      at org.jboss.as.controller.AbstractOperationContext.doCompleteStep(AbstractOperationContext.java:274)

                      at org.jboss.as.controller.AbstractOperationContext.completeStep(AbstractOperationContext.java:202)

                      at org.jboss.as.controller.ModelControllerImpl.execute(ModelControllerImpl.java:121)

                      at org.jboss.as.controller.ModelControllerImpl$1.execute(ModelControllerImpl.java:304)

                      at org.jboss.as.controller.ModelControllerImpl$1.execute(ModelControllerImpl.java:294)

                      at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$DeploymentTask.call(FileSystemDeploymentService.java:1251)

                      at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$DeploymentTask.call(FileSystemDeploymentService.java:1241)

                      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)

                      at java.util.concurrent.FutureTask.run(FutureTask.java:166)

                      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)

                      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

                      at org.jboss.threads.JBossThread.run(JBossThread.java:122)

               

               

                 Locked ownable synchronizers:

                      - <0x1989b0c8> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

                      - <0x1a4b8a50> (a java.util.concurrent.ThreadPoolExecutor$Worker)

               

               

              "http--127.0.0.1-8443-Acceptor-0" daemon prio=6 tid=0x580f9000 nid=0x1dc4 runnable [0x5717f000]

                 java.lang.Thread.State: RUNNABLE

                      at java.net.TwoStacksPlainSocketImpl.socketAccept(Native Method)

                      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)

                      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:183)

                      - locked <0x1a4b8be0> (a java.net.SocksSocketImpl)

                      at java.net.ServerSocket.implAccept(ServerSocket.java:522)

                      at sun.security.ssl.SSLServerSocketImpl.accept(SSLServerSocketImpl.java:317)

                      at org.apache.tomcat.util.net.jsse.JSSESocketFactory.acceptSocket(JSSESocketFactory.java:180)

                      at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:321)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "http--127.0.0.1-8443-Poller" daemon prio=6 tid=0x580f8800 nid=0x1464 in Object.wait() [0x5a46f000]

                 java.lang.Thread.State: TIMED_WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      at org.apache.tomcat.util.net.JIoEndpoint$Poller.run(JIoEndpoint.java:742)

                      - locked <0x1a4b8e20> (a org.apache.tomcat.util.net.JIoEndpoint$Poller)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Transaction Reaper Worker 0" daemon prio=6 tid=0x580f8000 nid=0x1210 in Object.wait() [0x5a3cf000]

                 java.lang.Thread.State: WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x1a4b8eb8> (a java.util.LinkedList)

                      at java.lang.Object.wait(Object.java:503)

                      at com.arjuna.ats.arjuna.coordinator.TransactionReaper.waitForCancellations(TransactionReaper.java:321)

                      - locked <0x1a4b8eb8> (a java.util.LinkedList)

                      at com.arjuna.ats.internal.arjuna.coordinator.ReaperWorkerThread.run(ReaperWorkerThread.java:65)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Transaction Reaper" daemon prio=6 tid=0x580f7c00 nid=0x19c4 in Object.wait() [0x5a37f000]

                 java.lang.Thread.State: TIMED_WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x1a4b8ed0> (a com.arjuna.ats.arjuna.coordinator.TransactionReaper)

                      at com.arjuna.ats.internal.arjuna.coordinator.ReaperThread.run(ReaperThread.java:90)

                      - locked <0x1a4b8ed0> (a com.arjuna.ats.arjuna.coordinator.TransactionReaper)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Periodic Recovery" prio=6 tid=0x580f7400 nid=0x550 in Object.wait() [0x58d0f000]

                 java.lang.Thread.State: TIMED_WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doPeriodicWait(PeriodicRecovery.java:672)

                      at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:392)

                      - locked <0x1a4b9020> (a java.lang.Object)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Thread-62" prio=6 tid=0x580f7000 nid=0x1c3c runnable [0x590bf000]

                 java.lang.Thread.State: RUNNABLE

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277)

                      at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158)

                      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

                      - locked <0x1a4bc158> (a sun.nio.ch.Util$2)

                      - locked <0x1a4bc168> (a java.util.Collections$UnmodifiableSet)

                      - locked <0x1a4bc0e0> (a sun.nio.ch.WindowsSelectorImpl)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)

                      at org.jboss.sun.net.httpserver.ServerImpl$Dispatcher.run(ServerImpl.java:382)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Transaction Expired Entry Monitor" daemon prio=6 tid=0x580f6800 nid=0x1344 in Object.wait() [0x5a17f000]

                 java.lang.Thread.State: TIMED_WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x1a4bc188> (a com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor)

                      at com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor.run(ExpiredEntryMonitor.java:190)

                      - locked <0x1a4bc188> (a com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "server-timer1" daemon prio=6 tid=0x580f6400 nid=0x10b4 in Object.wait() [0x5a24f000]

                 java.lang.Thread.State: TIMED_WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      at java.util.TimerThread.mainLoop(Timer.java:552)

                      - locked <0x1a4bc260> (a java.util.TaskQueue)

                      at java.util.TimerThread.run(Timer.java:505)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "server-timer" daemon prio=6 tid=0x580f5c00 nid=0x16cc in Object.wait() [0x5a1cf000]

                 java.lang.Thread.State: TIMED_WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      at java.util.TimerThread.mainLoop(Timer.java:552)

                      - locked <0x1a4bc310> (a java.util.TaskQueue)

                      at java.util.TimerThread.run(Timer.java:505)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "DeploymentScanner-threads - 1" prio=6 tid=0x580f5400 nid=0x1d48 waiting on condition [0x58fef000]

                 java.lang.Thread.State: TIMED_WAITING (parking)

                      at sun.misc.Unsafe.park(Native Method)

                      - parking to wait for  <0x1a4b89f0> (a java.util.concurrent.FutureTask$Sync)

                      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

                      at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1033)

                      at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1326)

                      at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:257)

                      at java.util.concurrent.FutureTask.get(FutureTask.java:119)

                      at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scan(FileSystemDeploymentService.java:409)

                      at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$DeploymentScanRunnable.run(FileSystemDeploymentService.java:149)

                      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)

                      at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)

                      at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)

                      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)

                      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

                      at org.jboss.threads.JBossThread.run(JBossThread.java:122)

               

               

                 Locked ownable synchronizers:

                      - <0x1a4bc568> (a java.util.concurrent.ThreadPoolExecutor$Worker)

                      - <0x1a692290> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

               

               

              "Timer-0" prio=6 tid=0x57c32c00 nid=0x1004 in Object.wait() [0x5910f000]

                 java.lang.Thread.State: WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x1a319fa8> (a java.util.TaskQueue)

                      at java.lang.Object.wait(Object.java:503)

                      at java.util.TimerThread.mainLoop(Timer.java:526)

                      - locked <0x1a319fa8> (a java.util.TaskQueue)

                      at java.util.TimerThread.run(Timer.java:505)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Remoting "achilles:MANAGEMENT" write-1" prio=6 tid=0x57c32800 nid=0x1eb0 runnable [0x58f4f000]

                 java.lang.Thread.State: RUNNABLE

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277)

                      at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158)

                      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

                      - locked <0x1a366ac0> (a sun.nio.ch.Util$2)

                      - locked <0x1a366ab0> (a java.util.Collections$UnmodifiableSet)

                      - locked <0x1a366890> (a sun.nio.ch.WindowsSelectorImpl)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)

                      at org.xnio.nio.WorkerThread.run(WorkerThread.java:153)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Remoting "achilles:MANAGEMENT" read-1" prio=6 tid=0x57c32000 nid=0x1e44 runnable [0x5903f000]

                 java.lang.Thread.State: RUNNABLE

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277)

                      at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158)

                      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

                      - locked <0x1966f9a8> (a sun.nio.ch.Util$2)

                      - locked <0x19330040> (a java.util.Collections$UnmodifiableSet)

                      - locked <0x1975fde8> (a sun.nio.ch.WindowsSelectorImpl)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)

                      at org.xnio.nio.WorkerThread.run(WorkerThread.java:153)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Remoting "achilles" write-1" prio=6 tid=0x57c31c00 nid=0x1a80 runnable [0x588df000]

                 java.lang.Thread.State: RUNNABLE

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277)

                      at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158)

                      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

                      - locked <0x1a2e2b58> (a sun.nio.ch.Util$2)

                      - locked <0x1a2e2b48> (a java.util.Collections$UnmodifiableSet)

                      - locked <0x1a2e2928> (a sun.nio.ch.WindowsSelectorImpl)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)

                      at org.xnio.nio.WorkerThread.run(WorkerThread.java:153)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Remoting "achilles" read-1" prio=6 tid=0x57c31400 nid=0x1260 runnable [0x586ff000]

                 java.lang.Thread.State: RUNNABLE

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295)

                      at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277)

                      at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158)

                      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

                      - locked <0x19331178> (a sun.nio.ch.Util$2)

                      - locked <0x19331168> (a java.util.Collections$UnmodifiableSet)

                      - locked <0x19330f48> (a sun.nio.ch.WindowsSelectorImpl)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)

                      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)

                      at org.xnio.nio.WorkerThread.run(WorkerThread.java:153)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "ContainerBackgroundProcessor[StandardEngine[jboss.web]]" daemon prio=6 tid=0x57c31000 nid=0x1f50 waiting on condition [0x58e2f000]

                 java.lang.Thread.State: TIMED_WAITING (sleeping)

                      at java.lang.Thread.sleep(Native Method)

                      at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1579)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "ConnectionValidator" daemon prio=6 tid=0x57c30800 nid=0x1d80 waiting on condition [0x58dcf000]

                 java.lang.Thread.State: TIMED_WAITING (parking)

                      at sun.misc.Unsafe.park(Native Method)

                      - parking to wait for  <0x194cc190> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

                      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

                      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2176)

                      at org.jboss.jca.core.connectionmanager.pool.validator.ConnectionValidator$ConnectionValidatorRunner.run(ConnectionValidator.java:263)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - <0x194ce2a8> (a java.util.concurrent.ThreadPoolExecutor$Worker)

               

               

              "IdleRemover" daemon prio=6 tid=0x57c30000 nid=0x454 waiting on condition [0x58acf000]

                 java.lang.Thread.State: TIMED_WAITING (parking)

                      at sun.misc.Unsafe.park(Native Method)

                      - parking to wait for  <0x194c77d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

                      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

                      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2176)

                      at org.jboss.jca.core.connectionmanager.pool.idle.IdleRemover$IdleRemoverRunner.run(IdleRemover.java:261)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - <0x194c97b8> (a java.util.concurrent.ThreadPoolExecutor$Worker)

               

               

              "DestroyJavaVM" prio=6 tid=0x00d1c400 nid=0xaa4 waiting on condition [0x00000000]

                 java.lang.Thread.State: RUNNABLE

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "MSC service thread 1-4" prio=6 tid=0x562ac800 nid=0x12fc in Object.wait() [0x0062e000]

                 java.lang.Thread.State: WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x05a0c450> (a org.jboss.modules.Module)

                      at java.lang.Object.wait(Object.java:503)

                      at org.jboss.modules.Module.getPaths(Module.java:1141)

                      - locked <0x05a0c450> (a org.jboss.modules.Module)

                      at org.jboss.modules.Module.getPathsUnchecked(Module.java:1164)

                      at org.jboss.modules.Module.loadModuleClass(Module.java:512)

                      at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:182)

                      at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:468)

                      at org.jboss.modules.ConcurrentClassLoader.performLoadClassChecked(ConcurrentClassLoader.java:456)

                      at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398)

                      at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:120)

                      at java.lang.ClassLoader.defineClass1(Native Method)

                      at java.lang.ClassLoader.defineClass(ClassLoader.java:791)

                      at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)

                      at org.jboss.modules.ModuleClassLoader.doDefineOrLoadClass(ModuleClassLoader.java:327)

                      at org.jboss.modules.ModuleClassLoader.defineClass(ModuleClassLoader.java:391)

                      at org.jboss.modules.ModuleClassLoader.loadClassLocal(ModuleClassLoader.java:243)

                      at org.jboss.modules.ModuleClassLoader$1.loadClassLocal(ModuleClassLoader.java:73)

                      at org.jboss.modules.Module.loadModuleClass(Module.java:517)

                      at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:182)

                      at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:468)

                      at org.jboss.modules.ConcurrentClassLoader.performLoadClassChecked(ConcurrentClassLoader.java:456)

                      at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398)

                      at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:120)

                      at org.jboss.as.jpa.processor.PersistenceProviderProcessor.deploy(PersistenceProviderProcessor.java:70)

                      at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:113)

                      - locked <0x05bc3c50> (a org.jboss.as.server.deployment.DeploymentUnitPhaseService)

                      at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1811)

                      at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1746)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - <0x1975fbb8> (a java.util.concurrent.ThreadPoolExecutor$Worker)

               

               

              "MSC service thread 1-3" prio=6 tid=0x562ac000 nid=0x1a78 waiting on condition [0x56cbf000]

                 java.lang.Thread.State: WAITING (parking)

                      at sun.misc.Unsafe.park(Native Method)

                      - parking to wait for  <0x1989c390> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

                      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)

                      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)

                      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)

                      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "MSC service thread 1-2" prio=6 tid=0x55e4cc00 nid=0x9c0 waiting on condition [0x56b5f000]

                 java.lang.Thread.State: WAITING (parking)

                      at sun.misc.Unsafe.park(Native Method)

                      - parking to wait for  <0x1989c390> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

                      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)

                      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)

                      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)

                      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "MSC service thread 1-1" prio=6 tid=0x55e4c800 nid=0x1f70 waiting on condition [0x56bdf000]

                 java.lang.Thread.State: WAITING (parking)

                      at sun.misc.Unsafe.park(Native Method)

                      - parking to wait for  <0x1989c390> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

                      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)

                      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)

                      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)

                      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

                      at java.lang.Thread.run(Thread.java:722)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Reference Reaper" daemon prio=6 tid=0x55e52800 nid=0xb8c in Object.wait() [0x55c5f000]

                 java.lang.Thread.State: WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x197601d0> (a java.lang.ref.ReferenceQueue$Lock)

                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)

                      - locked <0x197601d0> (a java.lang.ref.ReferenceQueue$Lock)

                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)

                      at org.jboss.modules.ref.References$ReaperThread.run(References.java:68)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Service Thread" daemon prio=6 tid=0x55dd1800 nid=0x11c4 runnable [0x00000000]

                 java.lang.Thread.State: RUNNABLE

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "C1 CompilerThread0" daemon prio=10 tid=0x55db1c00 nid=0x1a9c waiting on condition [0x00000000]

                 java.lang.Thread.State: RUNNABLE

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Attach Listener" daemon prio=10 tid=0x55db0400 nid=0xab0 waiting on condition [0x00000000]

                 java.lang.Thread.State: RUNNABLE

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Signal Dispatcher" daemon prio=10 tid=0x55dad400 nid=0x1f5c runnable [0x00000000]

                 java.lang.Thread.State: RUNNABLE

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Finalizer" daemon prio=8 tid=0x00ccf400 nid=0xbb0 in Object.wait() [0x55fff000]

                 java.lang.Thread.State: WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x197603f8> (a java.lang.ref.ReferenceQueue$Lock)

                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)

                      - locked <0x197603f8> (a java.lang.ref.ReferenceQueue$Lock)

                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)

                      at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "Reference Handler" daemon prio=10 tid=0x00ccdc00 nid=0x5ec in Object.wait() [0x0020f000]

                 java.lang.Thread.State: WAITING (on object monitor)

                      at java.lang.Object.wait(Native Method)

                      - waiting on <0x197542d8> (a java.lang.ref.Reference$Lock)

                      at java.lang.Object.wait(Object.java:503)

                      at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)

                      - locked <0x197542d8> (a java.lang.ref.Reference$Lock)

               

               

                 Locked ownable synchronizers:

                      - None

               

               

              "VM Thread" prio=10 tid=0x00cca000 nid=0x15bc runnable

               

               

              "VM Periodic Task Thread" prio=10 tid=0x55de5800 nid=0x1658 waiting on condition

               

               

              JNI global references: 223

               

              Regards,

              Aditya Neurgaonkar

              • 4. Re: JBoss hangs during WAR Deployment
                adityan

                1 more thing i forgot to mention....

                I had added this module in the modules of the Jboss 7.1. Is this module causing above scenario? If yes, then how can i tackle it?

                 

                private module ("org.apache.openjpa:main")

                Thanks and Regards,

                Aditya

                • 5. Re: JBoss hangs during WAR Deployment
                  nickarls

                  Hmm. Not sure, there is a waiting thread 0x562ac800 in Modules so it could be worth a try to disable it. Also, try upgrading to 7.2.0 like Tomaz suggested.

                  • 6. Re: JBoss hangs during WAR Deployment
                    adityan

                    So how do I disable that thread, remove that module altogether or is their anyway to disable that thread?

                    Thanks and regards,

                    Aditya

                    • 7. Re: JBoss hangs during WAR Deployment
                      nickarls

                      Threads can't be disabled, they are run when there is work to do. Just remove the module temporarily.

                      Did you try upgrading to 7.2.0? Does anything else deploy? Has that particular deployment ever worked?

                      • 8. Re: JBoss hangs during WAR Deployment
                        adityan

                        After Removing the module I get following error.

                        11:34:34,311 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-4) MSC00001: Failed to start service jboss.module.service."deployment.eQubeMI302.war".main: org.jboss.msc.service.StartException in service jboss.module.service."deployme

                        nt.eQubeMI302.war".main: Failed to load module: deployment.eQubeMI302.war:main

                                at org.jboss.as.server.moduleservice.ModuleLoadService.start(ModuleLoadService.java:91) [jboss-as-server-7.1.0.Final.jar:7.1.0.Final]

                                at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1811) [jboss-msc-1.0.2.GA.jar:1.0.2.GA]

                                at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1746) [jboss-msc-1.0.2.GA.jar:1.0.2.GA]

                                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_04]

                                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_04]

                                at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_04]

                        Caused by: org.jboss.modules.ModuleNotFoundException: Module org.apache.openjpa:main is not found in local module loader @1f4899c (roots: E:\DarshanJboss\jboss-as-7.1.0.Final\modules)

                                at org.jboss.modules.LocalModuleLoader.findModule(LocalModuleLoader.java:126)

                                at org.jboss.modules.ModuleLoader.loadModuleLocal(ModuleLoader.java:275)

                                at org.jboss.modules.ModuleLoader.preloadModule(ModuleLoader.java:222)

                                at org.jboss.modules.LocalModuleLoader.preloadModule(LocalModuleLoader.java:94)

                                at org.jboss.modules.ModuleLoader.preloadExportedModule(ModuleLoader.java:233)

                                at org.jboss.modules.ModuleLoader.preloadModule(ModuleLoader.java:246)

                                at org.jboss.as.server.moduleservice.ServiceModuleLoader.preloadModule(ServiceModuleLoader.java:160) [jboss-as-server-7.1.0.Final.jar:7.1.0.Final]

                                at org.jboss.modules.Module.addPaths(Module.java:841)

                                at org.jboss.modules.Module.link(Module.java:1181)

                                at org.jboss.modules.Module.relinkIfNecessary(Module.java:1207)

                                at org.jboss.modules.ModuleLoader.loadModule(ModuleLoader.java:208)

                                at org.jboss.as.server.moduleservice.ModuleLoadService.start(ModuleLoadService.java:70) [jboss-as-server-7.1.0.Final.jar:7.1.0.Final]

                                ... 5 more

                         

                         

                        11:34:34,585 INFO  [org.jboss.as.server] (DeploymentScanner-threads - 2) JBAS015870: Deploy of deployment "eQubeMI302.war" was rolled back with failure message {"JBAS014671: Failed services" => {"jboss.module.service.\"deployment.eQubeMI302

                        .war\".main" => "org.jboss.msc.service.StartException in service jboss.module.service.\"deployment.eQubeMI302.war\".main: Failed to load module: deployment.eQubeMI302.war:main"}}

                        11:34:35,173 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-2) JBAS015877: Stopped deployment eQubeMI302.war in 589ms

                        11:34:35,176 INFO  [org.jboss.as.controller] (DeploymentScanner-threads - 2) JBAS014774: Service status report

                        JBAS014777:   Services which failed to start:      service jboss.module.service."deployment.eQubeMI302.war".main: org.jboss.msc.service.StartException in service jboss.module.service."deployment.eQubeMI302.war".main: Failed to load module:

                        deployment.eQubeMI302.war:main

                         

                         

                        11:34:35,185 ERROR [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 1) {"JBAS014653: Composite operation failed and was rolled back. Steps that failed:" => {"Operation step-2" => {"JBAS014671: Failed services" => {"jbos

                        s.module.service.\"deployment.eQubeMI302.war\".main" => "org.jboss.msc.service.StartException in service jboss.module.service.\"deployment.eQubeMI302.war\".main: Failed to load module: deployment.eQubeMI302.war:main"}}}}

                         

                        I am deploying this WAR for the first time on JBoss 7. The WAR is meant to run on JBoss 5. I am evaluating what changes are required to run it on JBoss 7.1.1

                        Thanks and Regards,

                        Aditya

                        • 9. Re: JBoss hangs during WAR Deployment
                          hindsp

                          I had run into the same problem (deploying an EJB jar in JBoss AS 7.1.1.Final was hanging without giving any reason).

                           

                          In the end I had to interrogate the JVM using JVisualVM which showed that the deployment thread was waiting, I copied " at org.jboss.as.controller.ContainerStateMonitor.awaitContainerStateChangeReport(ContainerStateMonitor.java:161)" from the stack trace and Googled it, which brought me here.

                           

                          I thought I should add that when I tried upgrading to 7.2 as Tomaz suggested, this fixed the issue for me.