2 Replies Latest reply on Mar 22, 2007 3:46 PM by kevinstembridge

    TimeoutException on next access after eviction

    kevinstembridge Newbie

      Hi folks,
      I'm using JBossCache as the L2 cache for Hibernate and I started seeing a strange error after adding some eviction policy configuration.

      I'm now getting a TimeoutException when Hibernate tries to add an object to the cache. However, even though the error is thrown, the object still seems to get added to the cache. But after the next time the object is evicted I get the same error. The error doesn't occur at all if I remove the eviction policy config for that object. This behaviour seems to be very consistent and repeatable.

      The cache is configured with Isolation level REPEATABLE_READ, and CacheMode REPL_ASYNC.
      JBossCache version = 1.4.0SP1
      JBoss version = 4.0.5
      Hibernate version = 3.2.0GA


      Full cache configuration and stack traces are below.

      Thanks in advance for any help.

      Kevin


      <mbean code="org.jboss.cache.TreeCache" name="jboss.cache:service=HibernateTreeCache">
       <depends>jboss:service=Naming</depends>
       <depends>jboss:service=TransactionManager</depends>
       <depends>jboss.jca:service=XATxCM,name=XAOracleDS</depends>
      
       <attribute name="TransactionManagerLookupClass">org.jboss.cache.JBossTransactionManagerLookup</attribute>
      
       <attribute name="IsolationLevel">REPEATABLE_READ</attribute>
      
       <attribute name="CacheMode">REPL_ASYNC</attribute>
      
       <attribute name="ClusterName">${elink3.hibernate.partition.name:TreeCache-Cluster}</attribute>
      
       <attribute name="ClusterConfig">
       <config>
       <UDP mcast_addr="${elink3.hibernate.partition.udpGroup:229.1.98.1}" mcast_port="${elink3.hibernate.partition.udpPort:45679}" ip_ttl="64" ip_mcast="true"
       mcast_send_buf_size="150000" mcast_recv_buf_size="80000" ucast_send_buf_size="150000"
       ucast_recv_buf_size="80000" loopback="false" />
       <PING timeout="2000" num_initial_members="3" up_thread="false" down_thread="false" />
       <MERGE2 min_interval="10000" max_interval="20000" />
       <FD shun="true" up_thread="true" down_thread="true" />
       <VERIFY_SUSPECT timeout="1500" up_thread="false" down_thread="false" />
       <pbcast.NAKACK gc_lag="50" max_xmit_size="8192" retransmit_timeout="600,1200,2400,4800" up_thread="false"
       down_thread="false" />
       <UNICAST timeout="600,1200,2400" window_size="100" min_threshold="10" down_thread="false" />
       <pbcast.STABLE desired_avg_gossip="20000" up_thread="false" down_thread="false" />
       <FRAG frag_size="8192" down_thread="false" up_thread="false" />
       <pbcast.GMS join_timeout="5000" join_retry_timeout="2000" shun="true" print_local_addr="true" />
       <pbcast.STATE_TRANSFER up_thread="false" down_thread="false" />
       </config>
       </attribute>
      
       <attribute name="InitialStateRetrievalTimeout">20000</attribute>
      
       <attribute name="SyncReplTimeout">10000</attribute>
      
       <attribute name="LockAcquisitionTimeout">15000</attribute>
      
       <attribute name="FetchStateOnStartup">true</attribute>
      
       <attribute name="EvictionPolicyClass">org.jboss.cache.eviction.LRUPolicy</attribute>
      
       <attribute name="EvictionPolicyConfig">
       <config>
       <attribute name="wakeUpIntervalSeconds">5</attribute>
       <region name="/_default_">
       <attribute name="maxNodes">100000</attribute>
       <attribute name="timeToLiveSeconds">0</attribute>
       </region>
       <region name="/uk/co/objectsoft/hibernate/dbo/TraderBO" >
       <attribute name="maxNodes">10000</attribute>
       <attribute name="timeToLiveSeconds">60</attribute>
       <attribute name="maxAgeSeconds">60</attribute>
       </region>
       </config>
       </attribute>
      
      </mbean>


      2007-03-20 10:57:05,730 DEBUG [org.jboss.cache.interceptors.TxInterceptor:84] local transaction exists - registering global tx if not present for Thread[http-10.142.204.71-8080-9,5,jboss]
      2007-03-20 10:57:06,230 DEBUG [org.hibernate.cache.TransactionalCache:84] caching: uk.co.objectsoft.hibernate.dbo.TraderBO#-50
      2007-03-20 10:57:06,730 DEBUG [org.hibernate.cache.TransactionalCache:84] cache lookup: uk.co.objectsoft.hibernate.dbo.TraderBO.loginSessions#-50
      2007-03-20 10:57:06,730 DEBUG [org.jboss.cache.interceptors.TxInterceptor:84] local transaction exists - registering global tx if not present for Thread[http-10.142.204.71-8080-9,5,jboss]
      2007-03-20 10:57:06,730 DEBUG [org.jboss.cache.interceptors.TxInterceptor:84] Transaction TransactionImpl:XidImpl[FormatId=257, GlobalId=dblonws20733/23, BranchQual=, localId=23] is already registered.
      2007-03-20 10:57:06,730 DEBUG [org.hibernate.cache.TransactionalCache:84] cache miss
      2007-03-20 10:57:07,246 DEBUG [org.jboss.cache.interceptors.TxInterceptor:84] local transaction exists - registering global tx if not present for Thread[http-10.142.204.71-8080-9,5,jboss]
      2007-03-20 10:57:07,246 DEBUG [org.jboss.cache.interceptors.TxInterceptor:84] Transaction TransactionImpl:XidImpl[FormatId=257, GlobalId=dblonws20733/23, BranchQual=, localId=23] is already registered.
      2007-03-20 10:57:07,246 DEBUG [org.hibernate.cache.TransactionalCache:84] caching: uk.co.objectsoft.hibernate.dbo.TraderBO.loginSessions#-50
      2007-03-20 10:57:08,856 DEBUG [org.jboss.cache.interceptors.TxInterceptor:84] local transaction exists - registering global tx if not present for Thread[http-10.142.204.71-8080-9,5,jboss]
      2007-03-20 10:57:10,700 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm:84] Adding element /uk/co/objectsoft/hibernate/dbo/TraderBO/uk.co.objectsoft.hibernate.dbo.TraderBO#-50 for a node that doesn't exist yet. Process as an add.
      2007-03-20 10:57:10,700 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm:84] Adding element /uk/co/objectsoft/hibernate/dbo/TraderBO/loginSessions/uk.co.objectsoft.hibernate.dbo.TraderBO.loginSessions#-50 for a node that doesn't exist yet. Process as an add.
      2007-03-20 10:57:23,858 INFO [org.jboss.cache.interceptors.TxInterceptor:99] There was a problem handling this request
      org.jboss.cache.lock.TimeoutException: failure acquiring lock: fqn=/uk/co/objectsoft/hibernate/dbo/TraderBO/uk.co.objectsoft.hibernate.dbo.TraderBO#-50, caller=GlobalTransaction:<dblonws20733:4249>:18, lock=write owner=GlobalTransaction:<dblonws20733:4249>:17 (activeReaders=0, activeWriter=Thread[http-10.142.204.71-8080-9,5,jboss], waitingReaders=0, waitingWriters=0, waitingUpgrader=0)
       at org.jboss.cache.Node.acquire(Node.java:407)
       at org.jboss.cache.interceptors.PessimisticLockInterceptor.lock(PessimisticLockInterceptor.java:231)
       at org.jboss.cache.interceptors.PessimisticLockInterceptor.invoke(PessimisticLockInterceptor.java:166)
       at org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
       at org.jboss.cache.interceptors.UnlockInterceptor.invoke(UnlockInterceptor.java:32)
       at org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
       at org.jboss.cache.interceptors.ReplicationInterceptor.invoke(ReplicationInterceptor.java:34)
       at org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
       at org.jboss.cache.interceptors.TxInterceptor.handleNonTxMethod(TxInterceptor.java:345)
       at org.jboss.cache.interceptors.TxInterceptor.invoke(TxInterceptor.java:156)
       at org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
       at org.jboss.cache.interceptors.CacheMgmtInterceptor.invoke(CacheMgmtInterceptor.java:138)
       at org.jboss.cache.TreeCache.invokeMethod(TreeCache.java:5520)
       at org.jboss.cache.TreeCache.get(TreeCache.java:3469)
       at org.jboss.cache.TreeCache.get(TreeCache.java:3450)
       at org.hibernate.cache.TreeCache.read(TreeCache.java:54)
       at org.hibernate.cache.TransactionalCache.put(TransactionalCache.java:45)
       at org.hibernate.engine.TwoPhaseLoad.initializeEntity(TwoPhaseLoad.java:156)
       at org.hibernate.loader.Loader.initializeEntitiesAndCollections(Loader.java:842)
       at org.hibernate.loader.Loader.doQuery(Loader.java:717)
       at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224)
       at org.hibernate.loader.Loader.doList(Loader.java:2144)
       at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2028)
       at org.hibernate.loader.Loader.list(Loader.java:2023)
       at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:393)
       at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)
       at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)
       at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)
       at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)
       at uk.co.objectsoft.hibernate.dao.TraderDAO.getTraderByName(TraderDAO.java:83)
       at uk.co.objectsoft.hibernate.dao.TraderDAO.getTraderByName(TraderDAO.java:104)
       at uk.co.objectsoft.gateway.hibernate.OrderMapper.createAddJournal(OrderMapper.java:122)
       at uk.co.objectsoft.gateway.hibernate.OrderMapper.createSendJournal(OrderMapper.java:110)
       at uk.co.objectsoft.router.ejb.RouterBean.send(RouterBean.java:176)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)
       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)
       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)
       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)
       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)
       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)
       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:404)
       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)
       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)
       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)
       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:136)
       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)
       at org.jboss.ejb.Container.invoke(Container.java:954)
       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)
       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)
       at $Proxy130.send(Unknown Source)
       at uk.co.objectsoft.router.ejb.ClientRouterBean.send(ClientRouterBean.java:101)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)
       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)
       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)
       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)
       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)
       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)
       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:404)
       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)
       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)
       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)
       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:136)
       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)
       at org.jboss.ejb.Container.invoke(Container.java:954)
       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)
       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)
       at $Proxy135.send(Unknown Source)
       at uk.co.objectsoft.gateway.session.fix.FixGatewaySession.route(FixGatewaySession.java:65)
       at uk.co.objectsoft.ha.singleton.HAOrderService.route(HAOrderService.java:157)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.invocation.jrmp.server.JRMPProxyFactory.invoke(JRMPProxyFactory.java:175)
       at sun.reflect.GeneratedMethodAccessor255.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.invocation.local.LocalInvoker$MBeanServerAction.invoke(LocalInvoker.java:169)
       at org.jboss.invocation.local.LocalInvoker.invoke(LocalInvoker.java:118)
       at org.jboss.invocation.InvokerInterceptor.invokeLocal(InvokerInterceptor.java:209)
       at org.jboss.invocation.InvokerInterceptor.invoke(InvokerInterceptor.java:195)
       at org.jboss.proxy.ClientMethodInterceptor.invoke(ClientMethodInterceptor.java:74)
       at org.jboss.proxy.ClientContainer.invoke(ClientContainer.java:100)
       at $Proxy134.route(Unknown Source)
       at uk.co.objectsoft.order.service.JrmpOrderServiceImpl.route(JrmpOrderServiceImpl.java:245)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318)
       at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:203)
       at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:162)
       at org.acegisecurity.intercept.method.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:66)
       at com.db.exlink.common.service.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:40)
       at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
       at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:107)
       at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
       at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:209)
       at $Proxy169.route(Unknown Source)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318)
       at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:203)
       at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:162)
       at org.springframework.remoting.support.RemoteInvocationTraceInterceptor.invoke(RemoteInvocationTraceInterceptor.java:70)
       at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
       at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:209)
       at $Proxy169.route(Unknown Source)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.springframework.remoting.support.RemoteInvocation.invoke(RemoteInvocation.java:181)
       at org.acegisecurity.context.rmi.ContextPropagatingRemoteInvocation.invoke(ContextPropagatingRemoteInvocation.java:103)
       at org.springframework.remoting.support.DefaultRemoteInvocationExecutor.invoke(DefaultRemoteInvocationExecutor.java:38)
       at org.springframework.remoting.support.RemoteInvocationBasedExporter.invoke(RemoteInvocationBasedExporter.java:76)
       at org.springframework.remoting.support.RemoteInvocationBasedExporter.invokeAndCreateResult(RemoteInvocationBasedExporter.java:112)
       at org.springframework.remoting.httpinvoker.HttpInvokerServiceExporter.handleRequest(HttpInvokerServiceExporter.java:117)
       at org.springframework.web.servlet.mvc.HttpRequestHandlerAdapter.handle(HttpRequestHandlerAdapter.java:47)
       at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:806)
       at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:736)
       at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:396)
       at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:360)
       at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
       at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
       at uk.co.objectsoft.tomcat.filter.CompressionFilter.doFilter(CompressionFilter.java:60)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
       at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
       at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
       at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
       at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:175)
       at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:74)
       at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
       at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
       at org.jboss.web.tomcat.tc5.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:156)
       at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
       at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
       at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
       at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
       at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
       at org.apache.tomcat.util.net.MasterSlaveWorkerThread.run(MasterSlaveWorkerThread.java:112)
       at java.lang.Thread.run(Thread.java:595)
      Caused by: org.jboss.cache.lock.TimeoutException: read lock for /uk/co/objectsoft/hibernate/dbo/TraderBO/uk.co.objectsoft.hibernate.dbo.TraderBO#-50 could not be acquired by GlobalTransaction:<dblonws20733:4249>:18 after 15000 ms. Locks: Read lock owners: []
      Write lock owner: GlobalTransaction:<dblonws20733:4249>:17
      , lock info: write owner=GlobalTransaction:<dblonws20733:4249>:17 (activeReaders=0, activeWriter=Thread[http-10.142.204.71-8080-9,5,jboss], waitingReaders=0, waitingWriters=0, waitingUpgrader=0)
       at org.jboss.cache.lock.IdentityLock.acquireReadLock(IdentityLock.java:257)
       at org.jboss.cache.Node.acquireReadLock(Node.java:417)
       at org.jboss.cache.Node.acquire(Node.java:384)
       ... 166 more