Jboss 4.3 - Entity Bean Lock not getting released after a Network connectivity problem.

[georgesg]

Our application uses RMI Call as well as EJB call to interact with a module which uses Entity Bean to do interaction with the Database. In this case, due to "Network Connectivity problem", as we can see in the below stacktrace, the database connectivity got affected too. But the Entity Bean is not release eventually. Due to this, the subsequent Threads started waiting and finally made the Application to freeze. Problem is getting resolved only after a restart.

Any suggestions ?

Exception Stack Trace:

2013-12-14 01:12:52,557 13556860 DEBUG [com.cassis.cx.inventory.MaterialInterface_Bean] (http-0.0.0.0-8022-215:)  ----> getJobFromDiscoveryData()

2013-12-14 01:12:52,557 13556860 DEBUG [com.cassis.cx.inventory.MaterialSetJDBCMgr] (http-0.0.0.0-8022-215:)  ----> findByUnitData()

2013-12-14 01:12:52,558 13556861 DEBUG [com.cassis.cx.inventory.MaterialSetJDBCMgr] (http-0.0.0.0-8022-215:) Find by unit data statement = select GPSECDOMMATERIAL.materialset_id from GPSECDOMMATERIAL where GPSECDOMMATERIAL.partition = ? and GPSECDOMMATERIAL.profile_id = ? and GPSECDOMMATERIAL.DISCOVERY_DATA = ?

2013-12-14 01:12:52,563 13556866 DEBUG [com.cassis.cx.inventory.MaterialSetJDBCMgr] (http-0.0.0.0-8022-215:)  <---- findByUnitData()

2013-12-14 01:12:58,337 13562640 WARN  [org.jboss.resource.adapter.jdbc.local.LocalManagedConnectionFactory] (Thread-2124:) Destroying connection that is not valid, due to the following exception: oracle.jdbc.driver.T4CConnection@5d712499

java.sql.SQLException: pingDatabase failed status=-1

    at org.jboss.resource.adapter.jdbc.vendor.OracleValidConnectionChecker.isValidConnection(OracleValidConnectionChecker.java:74)

    at org.jboss.resource.adapter.jdbc.BaseWrapperManagedConnectionFactory.isValidConnection(BaseWrapperManagedConnectionFactory.java:458)

    at org.jboss.resource.adapter.jdbc.BaseWrapperManagedConnection.checkValid(BaseWrapperManagedConnection.java:240)

    at org.jboss.resource.adapter.jdbc.local.LocalManagedConnectionFactory.matchManagedConnections(LocalManagedConnectionFactory.java:211)

    at org.jboss.resource.connectionmanager.InternalManagedConnectionPool.getConnection(InternalManagedConnectionPool.java:216)

    at org.jboss.resource.connectionmanager.JBossManagedConnectionPool$BasePool.getConnection(JBossManagedConnectionPool.java:500)

    at org.jboss.resource.connectionmanager.BaseConnectionManager2.getManagedConnection(BaseConnectionManager2.java:348)

    at org.jboss.resource.connectionmanager.TxConnectionManager.getManagedConnection(TxConnectionManager.java:331)

    at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:403)

    at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:850)

    at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:90)

    at org.jboss.messaging.core.impl.JDBCSupport.getConnectionWithRetry(JDBCSupport.java:405)

    at org.jboss.messaging.core.impl.JDBCSupport$JDBCTxRunner2.execute(JDBCSupport.java:649)

    at org.jboss.messaging.core.impl.JDBCSupport$JDBCTxRunner2.executeWithRetry(JDBCSupport.java:698)

    at org.jboss.messaging.core.impl.JDBCPersistenceManager.addReference(JDBCPersistenceManager.java:1686)

    at org.jboss.messaging.core.impl.ChannelSupport.handle(ChannelSupport.java:239)

    at org.jboss.messaging.core.impl.postoffice.MessagingPostOffice.routeInternal(MessagingPostOffice.java:3141)

    at org.jboss.messaging.core.impl.postoffice.MessagingPostOffice.route(MessagingPostOffice.java:958)

    at org.jboss.jms.server.endpoint.ServerConnectionEndpoint.sendMessage(ServerConnectionEndpoint.java:786)

    at org.jboss.jms.server.endpoint.ServerSessionEndpoint.send(ServerSessionEndpoint.java:438)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised.org$jboss$jms$server$endpoint$advised$SessionAdvised$send$aop(SessionAdvised.java:87)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised$send_7280680627620114891.invokeNext(SessionAdvised$send_7280680627620114891.java)

    at org.jboss.jms.server.container.SecurityAspect.handleSend(SecurityAspect.java:157)

    at sun.reflect.GeneratedMethodAccessor405.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.aop.advice.PerInstanceAdvice.invoke(PerInstanceAdvice.java:121)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised$send_7280680627620114891.invokeNext(SessionAdvised$send_7280680627620114891.java)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised.send(SessionAdvised.java)

    at org.jboss.jms.wireformat.SessionSendRequest.serverInvoke(SessionSendRequest.java:95)

    at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:165)

    at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:900)

    at org.jboss.remoting.transport.local.LocalClientInvoker.invoke(LocalClientInvoker.java:101)

    at org.jboss.remoting.Client.invoke(Client.java:1978)

    at org.jboss.remoting.Client.invoke(Client.java:812)

    at org.jboss.remoting.Client.invoke(Client.java:800)

    at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:189)

    at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:160)

    at org.jboss.jms.client.delegate.ClientSessionDelegate.org$jboss$jms$client$delegate$ClientSessionDelegate$send$aop(ClientSessionDelegate.java:499)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.container.SessionAspect.handleSend(SessionAspect.java:725)

    at org.jboss.aop.advice.org.jboss.jms.client.container.SessionAspect30.invoke(SessionAspect30.java)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.container.FailoverValveInterceptor.invoke(FailoverValveInterceptor.java:92)

    at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:172)

    at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.delegate.ClientSessionDelegate.send(ClientSessionDelegate.java)

    at org.jboss.jms.client.container.ProducerAspect.handleSend(ProducerAspect.java:276)

    at org.jboss.aop.advice.org.jboss.jms.client.container.ProducerAspect48.invoke(ProducerAspect48.java)

    at org.jboss.jms.client.delegate.ClientProducerDelegate$send_3961598017717988886.invokeNext(ClientProducerDelegate$send_3961598017717988886.java)

    at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:172)

    at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)

    at org.jboss.jms.client.delegate.ClientProducerDelegate$send_3961598017717988886.invokeNext(ClientProducerDelegate$send_3961598017717988886.java)

    at org.jboss.jms.client.delegate.ClientProducerDelegate.send(ClientProducerDelegate.java)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:165)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:208)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:146)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:137)

    at com.cassis.cx.base.JMSDispatcher_Bean.sendMessage(JMSDispatcher_Bean.java:499)

    at com.cassis.cx.base.JMSDispatcher_Bean.sendToASINotification(JMSDispatcher_Bean.java:348)

    at com.cassis.cx.base.JMSDispatcher_Bean.handleNotification(JMSDispatcher_Bean.java:378)

    at sun.reflect.GeneratedMethodAccessor503.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

    at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

    at com.sun.proxy.$Proxy256.handleNotification(Unknown Source)

    at com.cassis.cx.base.NotificationTransport.send(NotificationTransport.java:57)

    at com.cassis.cx.base.EJBProcessController.sendToMessageTransport(EJBProcessController.java:136)

    at com.cassis.base.process.ProcessController.sendAllMessages(ProcessController.java:849)

    at com.cassis.base.process.ProcessController.dispatch(ProcessController.java:203)

    at com.cassis.cx.base.Dispatcher_Bean.dispatch(Dispatcher_Bean.java:726)

    at sun.reflect.GeneratedMethodAccessor404.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

    at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

    at com.sun.proxy.$Proxy209.dispatch(Unknown Source)

    at com.cassis.cx.inventory.MaterialInterface_Bean.dispatchJob(MaterialInterface_Bean.java:889)

    at com.cassis.cx.inventory.MaterialInterface_Bean.handlePackageUpdate(MaterialInterface_Bean.java:134)

    at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

    at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

    at com.sun.proxy.$Proxy202.handlePackageUpdate(Unknown Source)

    at com.cassis.cx.asi.service.process.IssueProgramUnitProcess_Bean.forwardToMaterialInterface(IssueProgramUnitProcess_Bean.java:599)

    at com.cassis.cx.asi.service.process.IssueProgramUnitProcess_Bean.createCustomerPackageAndProducts(IssueProgramUnitProcess_Bean.java:515)

    at com.cassis.cx.asi.service.process.IssueProgramUnitProcess_Bean.execute(IssueProgramUnitProcess_Bean.java:143)

    at sun.reflect.GeneratedMethodAccessor600.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:404)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at sun.reflect.GeneratedMethodAccessor343.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)

    at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)

    at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)

    at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)

    at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)

    at org.jboss.invocation.local.LocalInvoker$MBeanServerAction.invoke(LocalInvoker.java:169)

    at org.jboss.invocation.local.LocalInvoker.invoke(LocalInvoker.java:118)

    at org.jboss.invocation.InvokerInterceptor.invokeLocalMarshalled(InvokerInterceptor.java:295)

    at org.jboss.invocation.MarshallingInvokerInterceptor.invoke(MarshallingInvokerInterceptor.java:61)

    at org.jboss.proxy.TransactionInterceptor.invoke(TransactionInterceptor.java:61)

    at org.jboss.proxy.SecurityInterceptor.invoke(SecurityInterceptor.java:70)

    at org.jboss.proxy.ejb.StatelessSessionInterceptor.invoke(StatelessSessionInterceptor.java:112)

    at org.jboss.proxy.ClientContainer.invoke(ClientContainer.java:100)

    at com.sun.proxy.$Proxy656.execute(Unknown Source)

    at com.cassis.reqmgr.jobmgr.ExecuteJob_Bean.performIPU(ExecuteJob_Bean.java:199)

    at com.cassis.reqmgr.jobmgr.ExecuteJob_Bean.executeAsyncJob(ExecuteJob_Bean.java:95)

    at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)

    at org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)

    at org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.timer.TimerTxRegistrationInterceptor.invoke(TimerTxRegistrationInterceptor.java:38)

    at org.jboss.ejb3.timer.TimerTxRegistrationInterceptor.invoke(TimerTxRegistrationInterceptor.java:29)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.aspects.tx.TxPolicy.invokeInNoTx(TxPolicy.java:66)

    at org.jboss.aspects.tx.TxInterceptor$NotSupported.invoke(TxInterceptor.java:112)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.tx.NullInterceptor.invoke(NullInterceptor.java:42)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)

    at org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:139)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.interceptor.EJB3TCCLInterceptor.invoke(EJB3TCCLInterceptor.java:86)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:217)

    at org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:187)

    at org.jboss.ejb3.stateless.StatelessLocalProxy.invoke(StatelessLocalProxy.java:81)

    at com.sun.proxy.$Proxy455.executeAsyncJob(Unknown Source)

    at com.cassis.reqmgr.jobmgr.ExecuteJobInvoker.invokeExecuteAsyncJob(ExecuteJobInvoker.java:74)

    at com.cassis.reqmgr.jobmgr.ExecuteJobInvoker.run(ExecuteJobInvoker.java:63)

    at java.lang.Thread.run(Thread.java:662)

2013-12-14 01:12:58,339 13562642 WARN  [org.jboss.resource.connectionmanager.TxConnectionManager] (Thread-2124:) Connection error occured: org.jboss.resource.connectionmanager.TxConnectionManager$TxConnectionEventListener@216790a2[state=NORMAL mc=org.jboss.resource.adapter.jdbc.local.LocalManagedConnection@2f19e8bc handles=0 lastUse=1386974902404 permit=false trackByTx=false mcp=org.jboss.resource.connectionmanager.JBossManagedConnectionPool$PoolBySubject@4dfea6cc context=org.jboss.resource.connectionmanager.InternalManagedConnectionPool@978c315 xaResource=org.jboss.resource.connectionmanager.TxConnectionManager$LocalXAResource@574f9c8e txSync=null]

java.sql.SQLException: pingDatabase failed status=-1

    at org.jboss.resource.adapter.jdbc.vendor.OracleValidConnectionChecker.isValidConnection(OracleValidConnectionChecker.java:74)

    at org.jboss.resource.adapter.jdbc.BaseWrapperManagedConnectionFactory.isValidConnection(BaseWrapperManagedConnectionFactory.java:458)

    at org.jboss.resource.adapter.jdbc.BaseWrapperManagedConnection.checkValid(BaseWrapperManagedConnection.java:240)

    at org.jboss.resource.adapter.jdbc.local.LocalManagedConnectionFactory.matchManagedConnections(LocalManagedConnectionFactory.java:211)

    at org.jboss.resource.connectionmanager.InternalManagedConnectionPool.getConnection(InternalManagedConnectionPool.java:216)

    at org.jboss.resource.connectionmanager.JBossManagedConnectionPool$BasePool.getConnection(JBossManagedConnectionPool.java:500)

    at org.jboss.resource.connectionmanager.BaseConnectionManager2.getManagedConnection(BaseConnectionManager2.java:348)

    at org.jboss.resource.connectionmanager.TxConnectionManager.getManagedConnection(TxConnectionManager.java:331)

    at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:403)

    at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:850)

    at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:90)

    at org.jboss.messaging.core.impl.JDBCSupport.getConnectionWithRetry(JDBCSupport.java:405)

    at org.jboss.messaging.core.impl.JDBCSupport$JDBCTxRunner2.execute(JDBCSupport.java:649)

    at org.jboss.messaging.core.impl.JDBCSupport$JDBCTxRunner2.executeWithRetry(JDBCSupport.java:698)

    at org.jboss.messaging.core.impl.JDBCPersistenceManager.addReference(JDBCPersistenceManager.java:1686)

    at org.jboss.messaging.core.impl.ChannelSupport.handle(ChannelSupport.java:239)

    at org.jboss.messaging.core.impl.postoffice.MessagingPostOffice.routeInternal(MessagingPostOffice.java:3141)

    at org.jboss.messaging.core.impl.postoffice.MessagingPostOffice.route(MessagingPostOffice.java:958)

    at org.jboss.jms.server.endpoint.ServerConnectionEndpoint.sendMessage(ServerConnectionEndpoint.java:786)

    at org.jboss.jms.server.endpoint.ServerSessionEndpoint.send(ServerSessionEndpoint.java:438)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised.org$jboss$jms$server$endpoint$advised$SessionAdvised$send$aop(SessionAdvised.java:87)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised$send_7280680627620114891.invokeNext(SessionAdvised$send_7280680627620114891.java)

    at org.jboss.jms.server.container.SecurityAspect.handleSend(SecurityAspect.java:157)

    at sun.reflect.GeneratedMethodAccessor405.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.aop.advice.PerInstanceAdvice.invoke(PerInstanceAdvice.java:121)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised$send_7280680627620114891.invokeNext(SessionAdvised$send_7280680627620114891.java)

    at org.jboss.jms.server.endpoint.advised.SessionAdvised.send(SessionAdvised.java)

    at org.jboss.jms.wireformat.SessionSendRequest.serverInvoke(SessionSendRequest.java:95)

    at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:165)

    at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:900)

    at org.jboss.remoting.transport.local.LocalClientInvoker.invoke(LocalClientInvoker.java:101)

    at org.jboss.remoting.Client.invoke(Client.java:1978)

    at org.jboss.remoting.Client.invoke(Client.java:812)

    at org.jboss.remoting.Client.invoke(Client.java:800)

    at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:189)

    at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:160)

    at org.jboss.jms.client.delegate.ClientSessionDelegate.org$jboss$jms$client$delegate$ClientSessionDelegate$send$aop(ClientSessionDelegate.java:499)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.container.SessionAspect.handleSend(SessionAspect.java:725)

    at org.jboss.aop.advice.org.jboss.jms.client.container.SessionAspect30.invoke(SessionAspect30.java)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.container.FailoverValveInterceptor.invoke(FailoverValveInterceptor.java:92)

    at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:172)

    at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)

    at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeNext(ClientSessionDelegate$send_6145266547759487588.java)

    at org.jboss.jms.client.delegate.ClientSessionDelegate.send(ClientSessionDelegate.java)

    at org.jboss.jms.client.container.ProducerAspect.handleSend(ProducerAspect.java:276)

    at org.jboss.aop.advice.org.jboss.jms.client.container.ProducerAspect48.invoke(ProducerAspect48.java)

    at org.jboss.jms.client.delegate.ClientProducerDelegate$send_3961598017717988886.invokeNext(ClientProducerDelegate$send_3961598017717988886.java)

    at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:172)

    at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)

    at org.jboss.jms.client.delegate.ClientProducerDelegate$send_3961598017717988886.invokeNext(ClientProducerDelegate$send_3961598017717988886.java)

    at org.jboss.jms.client.delegate.ClientProducerDelegate.send(ClientProducerDelegate.java)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:165)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:208)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:146)

    at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:137)

    at com.cassis.cx.base.JMSDispatcher_Bean.sendMessage(JMSDispatcher_Bean.java:499)

    at com.cassis.cx.base.JMSDispatcher_Bean.sendToASINotification(JMSDispatcher_Bean.java:348)

    at com.cassis.cx.base.JMSDispatcher_Bean.handleNotification(JMSDispatcher_Bean.java:378)

    at sun.reflect.GeneratedMethodAccessor503.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

    at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

    at com.sun.proxy.$Proxy256.handleNotification(Unknown Source)

    at com.cassis.cx.base.NotificationTransport.send(NotificationTransport.java:57)

    at com.cassis.cx.base.EJBProcessController.sendToMessageTransport(EJBProcessController.java:136)

    at com.cassis.base.process.ProcessController.sendAllMessages(ProcessController.java:849)

    at com.cassis.base.process.ProcessController.dispatch(ProcessController.java:203)

    at com.cassis.cx.base.Dispatcher_Bean.dispatch(Dispatcher_Bean.java:726)

    at sun.reflect.GeneratedMethodAccessor404.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

    at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

    at com.sun.proxy.$Proxy209.dispatch(Unknown Source)

    at com.cassis.cx.inventory.MaterialInterface_Bean.dispatchJob(MaterialInterface_Bean.java:889)

    at com.cassis.cx.inventory.MaterialInterface_Bean.handlePackageUpdate(MaterialInterface_Bean.java:134)

    at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

    at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

    at com.sun.proxy.$Proxy202.handlePackageUpdate(Unknown Source)

    at com.cassis.cx.asi.service.process.IssueProgramUnitProcess_Bean.forwardToMaterialInterface(IssueProgramUnitProcess_Bean.java:599)

    at com.cassis.cx.asi.service.process.IssueProgramUnitProcess_Bean.createCustomerPackageAndProducts(IssueProgramUnitProcess_Bean.java:515)

    at com.cassis.cx.asi.service.process.IssueProgramUnitProcess_Bean.execute(IssueProgramUnitProcess_Bean.java:143)

    at sun.reflect.GeneratedMethodAccessor600.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

    at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

    at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

    at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

    at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

    at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:404)

    at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

    at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

    at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

    at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

    at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

    at org.jboss.ejb.Container.invoke(Container.java:960)

    at sun.reflect.GeneratedMethodAccessor343.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)

    at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)

    at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)

    at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)

    at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)

    at org.jboss.invocation.local.LocalInvoker$MBeanServerAction.invoke(LocalInvoker.java:169)

    at org.jboss.invocation.local.LocalInvoker.invoke(LocalInvoker.java:118)

    at org.jboss.invocation.InvokerInterceptor.invokeLocalMarshalled(InvokerInterceptor.java:295)

    at org.jboss.invocation.MarshallingInvokerInterceptor.invoke(MarshallingInvokerInterceptor.java:61)

    at org.jboss.proxy.TransactionInterceptor.invoke(TransactionInterceptor.java:61)

    at org.jboss.proxy.SecurityInterceptor.invoke(SecurityInterceptor.java:70)

    at org.jboss.proxy.ejb.StatelessSessionInterceptor.invoke(StatelessSessionInterceptor.java:112)

    at org.jboss.proxy.ClientContainer.invoke(ClientContainer.java:100)

    at com.sun.proxy.$Proxy656.execute(Unknown Source)

    at com.cassis.reqmgr.jobmgr.ExecuteJob_Bean.performIPU(ExecuteJob_Bean.java:199)

    at com.cassis.reqmgr.jobmgr.ExecuteJob_Bean.executeAsyncJob(ExecuteJob_Bean.java:95)

    at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)

    at org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)

    at org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.timer.TimerTxRegistrationInterceptor.invoke(TimerTxRegistrationInterceptor.java:38)

    at org.jboss.ejb3.timer.TimerTxRegistrationInterceptor.invoke(TimerTxRegistrationInterceptor.java:29)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.aspects.tx.TxPolicy.invokeInNoTx(TxPolicy.java:66)

    at org.jboss.aspects.tx.TxInterceptor$NotSupported.invoke(TxInterceptor.java:112)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.tx.NullInterceptor.invoke(NullInterceptor.java:42)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)

    at org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:139)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.interceptor.EJB3TCCLInterceptor.invoke(EJB3TCCLInterceptor.java:86)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)

    at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)

    at org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:217)

    at org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:187)

    at org.jboss.ejb3.stateless.StatelessLocalProxy.invoke(StatelessLocalProxy.java:81)

    at com.sun.proxy.$Proxy455.executeAsyncJob(Unknown Source)

    at com.cassis.reqmgr.jobmgr.ExecuteJobInvoker.invokeExecuteAsyncJob(ExecuteJobInvoker.java:74)

    at com.cassis.reqmgr.jobmgr.ExecuteJobInvoker.run(ExecuteJobInvoker.java:63)

    at java.lang.Thread.run(Thread.java:662)

2013-12-14 01:12:58,340 13562643 WARN  [org.jboss.resource.connectionmanager.JBossManagedConnectionPool] (Thread-2124:) Destroying connection that could not be successfully matched: org.jboss.resource.connectionmanager.TxConnectionManager$TxConnectionEventListener@216790a2[state=DESTROYED mc=org.jboss.resource.adapter.jdbc.local.LocalManagedConnection@2f19e8bc handles=0 lastUse=1386974902404 permit=false trackByTx=false mcp=org.jboss.resource.connectionmanager.JBossManagedConnectionPool$PoolBySubject@4dfea6cc context=org.jboss.resource.connectionmanager.InternalManagedConnectionPool@978c315 xaResource=org.jboss.resource.connectionmanager.TxConnectionManager$LocalXAResource@574f9c8e txSync=null]

2013-12-14 01:12:58,374 13562677 ERROR [org.jboss.ejb.BeanLock] (Thread-2124:) Saw rolled back tx=TransactionImple < ac, BasicAction: -3f57d7fb:bf53:52ab6d95:d643e status: ActionStatus.ABORTED >

2013-12-14 01:12:58,374 13562677 ERROR [org.jboss.ejb.plugins.LogInterceptor] (Thread-2124:) TransactionRolledbackLocalException in method: public abstract boolean com.cassis.cx.inventory.MaterialSet_Local.unlock(java.lang.String), causedBy:

java.lang.RuntimeException: Transaction marked for rollback, possibly a timeout

    at org.jboss.ejb.plugins.lock.QueuedPessimisticEJBLock.doSchedule(QueuedPessimisticEJBLock.java:219)

    at org.jboss.ejb.plugins.lock.QueuedPessimisticEJBLock.schedule(QueuedPessimisticEJBLock.java:191)

    at org.jboss.ejb.plugins.EntityLockInterceptor.invoke(EntityLockInterceptor.java:100)

    at org.jboss.ejb.plugins.EntityCreationInterceptor.invoke(EntityCreationInterceptor.java:76)

    at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

[wdfink]

Problem is that the Entity lock get's not freed until the call ends.

I'm not sure whether this is related to your application ...

Could you explain where you see the network problem? you might need to set rollbackOnly in your application and return

[georgesg]

When Entity Bean try to access database i see "ping database" error. That is the point i see the Bean getting locked and never getting unlocked/receovered.

[georgesg]

I saw a Mbean functionality in the jboss4.3 jmx-console under  jboss.cache --> service=EJB3EntityTreeCache . Just wanted to know whether it will help to release all locks associated with the EJB Cache during runtime without server restart ?

void releaseAllLocks()

[wdfink]

For me it looks like as a problem with the database connection. pingDatabase is used to check the connection and that failed.

The entity might be locked before and the Exception handling might not release the lock.

You should check whether the DB connection pool works correct

[georgesg]

Because, even after the database connection recovered, Subsequent Threads accessing the EntityBean unable to acquire a lock leading to Timeout and TransactionRollback happened.

Do you know how to do EntityBean lock monitoring in Jboss 4.3 ? I enabled the below EntityLockMonitor in jboss-service.xml under /conf. Do you know which link i should refer to in the /jmx-console ?

  <!-- Uncomment to enable JMX monitoring of the entity bean locking-->

   <mbean code="org.jboss.monitor.EntityLockMonitor"

          name="jboss.monitor:name=EntityLockMonitor"/>

[georgesg]

I looked for all the links available in jmx-console. But i could not find any link relevant to view the EntityLock monitor statistics after enabling this Mbean in the jboss-server.xml. I did extensive search online, But can't find any documentation on how to view this using jmx-console.

Please help.