Jboss shutdown twice in a week
1purohit Apr 25, 2014 1:51 AMHi,
My application is deployed in a clustered environment. I am using
jboss 4.0.1.sp1
Hibernate 3
EJB 3
All was ok, application was running smoothly. But from last week JBOSS Shutdown is monitored on any of the cluster environment twice in a week. Cannot figure out what can be the problem, Below is part of the stacktrace. As the whole log file is very big can not post it.
NFO | jvm 1 | 2014/04/24 14:58:20 | 14:58:20,666 WARN [ProxyWarnLog] Narrowing proxy to class com.axxia.workflow.afcl.domain.metadata.detail.SubDetail - this operation breaks ==
INFO | jvm 1 | 2014/04/24 14:58:20 | 14:58:20,666 WARN [ProxyWarnLog] Narrowing proxy to class com.axxia.workflow.afcl.domain.metadata.detail.SubDetail - this operation breaks ==
INFO | jvm 1 | 2014/04/24 14:58:20 | 14:58:20,682 WARN [AFCL] getColValue: Failed to find Column number 780
INFO | jvm 1 | 2014/04/24 14:58:20 | 14:58:20,713 INFO [Server] JBoss SHUTDOWN: Undeploying all packages
INFO | jvm 1 | 2014/04/24 14:58:20 | [Full GC
INFO | jvm 1 | 2014/04/24 14:58:26 | 1520447K->1076357K(1520448K), 5.3998737 secs]
INFO | jvm 1 | 2014/04/24 14:58:26 | 14:58:26,119 INFO [TomcatDeployer] undeploy, ctxPath=/dna, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/dna-exp.war/
INFO | jvm 1 | 2014/04/24 14:58:26 | 14:58:26,119 INFO [TomcatDeployer] undeploy, ctxPath=/PKCOnlineHelp, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/PKCOnlineHelp-exp.war/
INFO | jvm 1 | 2014/04/24 14:58:26 | 14:58:26,119 INFO [TomcatDeployer] undeploy, ctxPath=/PKCLook, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/PKCLook-exp.war/
INFO | jvm 1 | 2014/04/24 14:58:26 | 14:58:26,135 INFO [TomcatDeployer] undeploy, ctxPath=/PKC, warUrl=file:/D:/jboss-4.0.1sp1/server/dna_live/tmp/deploy/tmp2605726349159349267DNA-1.8.2-10498.ear-contents/PKC-exp.war/
INFO | jvm 1 | 2014/04/24 14:58:26 | 14:58:26,198 ERROR [ActionQueue] could not release a cache lock
INFO | jvm 1 | 2014/04/24 14:58:26 | org.hibernate.cache.CacheException: java.lang.IllegalStateException: The com.axxia.workflow.afcl.domain.metadata.detail.DetailDefinition Cache is not alive.
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.cache.EhCache.clear(EhCache.java:167)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.cache.NonstrictReadWriteCache.clear(NonstrictReadWriteCache.java:99)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.impl.SessionFactoryImpl.evictEntity(SessionFactoryImpl.java:832)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.action.BulkOperationCleanupAction.evictEntityRegions(BulkOperationCleanupAction.java:137)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.action.BulkOperationCleanupAction.afterTransactionCompletion(BulkOperationCleanupAction.java:116)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.engine.ActionQueue.afterTransactionCompletion(ActionQueue.java:172)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.impl.SessionImpl.afterTransactionCompletion(SessionImpl.java:424)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.jdbc.JDBCContext.afterTransactionCompletion(JDBCContext.java:225)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.hibernate.transaction.CacheSynchronization.afterCompletion(CacheSynchronization.java:85)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jboss.tm.TransactionImpl.doAfterCompletion(TransactionImpl.java:1418)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jboss.tm.TransactionImpl.completeTransaction(TransactionImpl.java:1090)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:349)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jboss.aspects.tx.TxPolicy.endTransaction(TxPolicy.java:162)
INFO | jvm 1 | 2014/04/24 14:58:26 | at com.axxia.util.hibernate.annotation.AxxiaTxPolicy.invokeInOurTx(AxxiaTxPolicy.java:119)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:134)
INFO | jvm 1 | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.CommitAction$commit_8461082169793485964.invokeNext(CommitAction$commit_8461082169793485964.java)
INFO | jvm 1 | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.CommitAction.commit(CommitAction.java)
INFO | jvm 1 | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.CommitAction.doExecute(CommitAction.java:66)
INFO | jvm 1 | 2014/04/24 14:58:26 | at com.axxia.core.website.wizard.process.action.BaseAction.execute(BaseAction.java:95)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Action.execute(Action.java:79)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.GraphElement.executeActions(GraphElement.java:186)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.GraphElement.fireAndPropagateEvent(GraphElement.java:149)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.GraphElement.fireEvent(GraphElement.java:133)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:274)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.StartState.leave(StartState.java:73)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:127)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:92)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ProcessInstance.signal(ProcessInstance.java:201)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.ProcessState.execute(ProcessState.java:117)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ExecutionContext.leaveNode(ExecutionContext.java:101)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.Decision.execute(Decision.java:94)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ExecutionContext.leaveNode(ExecutionContext.java:101)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.Decision.execute(Decision.java:94)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.StartState.leave(StartState.java:73)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:127)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.signal(Token.java:92)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ProcessInstance.signal(ProcessInstance.java:201)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.ProcessState.execute(ProcessState.java:117)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.leave(Node.java:349)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.ProcessState.notifySubProcessEnd(ProcessState.java:153)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.ProcessInstance.end(ProcessInstance.java:249)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.notifyParentOfTokenEnd(Token.java:214)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.end(Token.java:186)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.exe.Token.end(Token.java:146)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.node.EndState.execute(EndState.java:25)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Node.enter(Node.java:284)
INFO | jvm 1 | 2014/04/24 14:58:26 | at org.jbpm.graph.def.Transition.take(Transition.java:92)
after this exception can not commit, and cache is not alive action is notified. Then it start giving not serialized exception for all.
Thanks