0 Replies Latest reply on Apr 25, 2014 1:51 AM by 1purohit

    Jboss shutdown twice in a week

    1purohit

      Hi,

       

      My application is deployed in a clustered environment. I am using

      jboss 4.0.1.sp1

      Hibernate 3

      EJB 3

       

      All was ok, application was running smoothly. But from last week JBOSS Shutdown is monitored on any of the cluster environment twice in a week. Cannot figure out what can be the problem, Below is part of the stacktrace. As the whole log file is very big can not post it.

       

      NFO   | jvm 1    | 2014/04/24 14:58:20 | 14:58:20,666 WARN  [ProxyWarnLog] Narrowing proxy to class com.axxia.workflow.afcl.domain.metadata.detail.SubDetail - this operation breaks ==

      INFO   | jvm 1    | 2014/04/24 14:58:20 | 14:58:20,666 WARN  [ProxyWarnLog] Narrowing proxy to class com.axxia.workflow.afcl.domain.metadata.detail.SubDetail - this operation breaks ==

      INFO   | jvm 1    | 2014/04/24 14:58:20 | 14:58:20,682 WARN  [AFCL] getColValue: Failed to find Column number 780

      INFO   | jvm 1    | 2014/04/24 14:58:20 | 14:58:20,713 INFO  [Server] JBoss SHUTDOWN: Undeploying all packages

      INFO   | jvm 1    | 2014/04/24 14:58:20 | [Full GC

      INFO   | jvm 1    | 2014/04/24 14:58:26 |  1520447K->1076357K(1520448K), 5.3998737 secs]

      INFO   | jvm 1    | 2014/04/24 14:58:26 | 14:58:26,119 INFO  [TomcatDeployer] undeploy, ctxPath=/dna, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/dna-exp.war/

      INFO   | jvm 1    | 2014/04/24 14:58:26 | 14:58:26,119 INFO  [TomcatDeployer] undeploy, ctxPath=/PKCOnlineHelp, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/PKCOnlineHelp-exp.war/

      INFO   | jvm 1    | 2014/04/24 14:58:26 | 14:58:26,119 INFO  [TomcatDeployer] undeploy, ctxPath=/PKCLook, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/PKCLook-exp.war/

      INFO   | jvm 1    | 2014/04/24 14:58:26 | 14:58:26,135 INFO  [TomcatDeployer] undeploy, ctxPath=/PKC, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/PKC-exp.war/

      INFO   | jvm 1    | 2014/04/24 14:58:26 | 14:58:26,198 ERROR [ActionQueue] could not release a cache lock

      INFO   | jvm 1    | 2014/04/24 14:58:26 | org.hibernate.cache.CacheException: java.lang.IllegalStateException: The com.axxia.workflow.afcl.domain.metadata.detail.DetailDefinition Cache is not alive.

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.cache.EhCache.clear(EhCache.java:167)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.cache.NonstrictReadWriteCache.clear(NonstrictReadWriteCache.java:99)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.impl.SessionFactoryImpl.evictEntity(SessionFactoryImpl.java:832)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.action.BulkOperationCleanupAction.evictEntityRegions(BulkOperationCleanupAction.java:137)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.action.BulkOperationCleanupAction.afterTransactionCompletion(BulkOperationCleanupAction.java:116)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.engine.ActionQueue.afterTransactionCompletion(ActionQueue.java:172)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.impl.SessionImpl.afterTransactionCompletion(SessionImpl.java:424)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.jdbc.JDBCContext.afterTransactionCompletion(JDBCContext.java:225)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.hibernate.transaction.CacheSynchronization.afterCompletion(CacheSynchronization.java:85)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jboss.tm.TransactionImpl.doAfterCompletion(TransactionImpl.java:1418)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jboss.tm.TransactionImpl.completeTransaction(TransactionImpl.java:1090)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:349)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jboss.aspects.tx.TxPolicy.endTransaction(TxPolicy.java:162)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at com.axxia.util.hibernate.annotation.AxxiaTxPolicy.invokeInOurTx(AxxiaTxPolicy.java:119)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:134)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.CommitAction$commit_8461082169793485964.invokeNext(CommitAction$commit_8461082169793485964.java)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.CommitAction.commit(CommitAction.java)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.CommitAction.doExecute(CommitAction.java:66)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.BaseAction.execute(BaseAction.java:95)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Action.execute(Action.java:79)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.GraphElement.executeActions(GraphElement.java:186)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.GraphElement.fireAndPropagateEvent(GraphElement.java:149)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.GraphElement.fireEvent(GraphElement.java:133)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:274)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.StartState.leave(StartState.java:73)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:127)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:92)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ProcessInstance.signal(ProcessInstance.java:201)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.ProcessState.execute(ProcessState.java:117)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ExecutionContext.leaveNode(ExecutionContext.java:101)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.Decision.execute(Decision.java:94)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ExecutionContext.leaveNode(ExecutionContext.java:101)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.Decision.execute(Decision.java:94)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.StartState.leave(StartState.java:73)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:127)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:92)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ProcessInstance.signal(ProcessInstance.java:201)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.ProcessState.execute(ProcessState.java:117)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.ProcessState.notifySubProcessEnd(ProcessState.java:153)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ProcessInstance.end(ProcessInstance.java:249)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.notifyParentOfTokenEnd(Token.java:214)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.end(Token.java:186)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.end(Token.java:146)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.node.EndState.execute(EndState.java:25)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)

      INFO   | jvm 1    | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)

       

      after this exception can not commit, and cache is not alive action is notified. Then it start giving not serialized exception for all.

       

      Thanks