4 Replies Latest reply on Apr 14, 2015 3:03 PM by Paul Ferraro

    TimeoutException with Infinispan

    valsaraj viswanathan Master

      Hi,

       

      I am seeing following error in clustered domain node:

      Caused by: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [ZjzZuLL4u61e3QT52s2M698y] for requestor [GlobalTransaction:<node-00/web>:134:remote]! Lock held by [GlobalTransaction:<node-00/web>:104:remote]

       

      What is the solution to avoid this?

       

      Thanks!

        • 1. Re: TimeoutException with Infinispan
          Paul Ferraro Master

          I need more context.  Can you post the full stack trace?

          • 2. Re: TimeoutException with Infinispan
            valsaraj viswanathan Master

            Here is the full error stack trace:

            ERROR [org.infinispan.interceptors.InvocationContextInterceptor] (remote-thread-0) ISPN000136: Execution error: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.wildfly.clustering.server.group.AddressableNode@d44ed9dd] for requestor [GlobalTransaction:<node-01/ejb>:3:remote]! Lock held by [GlobalTransaction:<node-01/ejb>:2:remote]

              at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLock(LockManagerImpl.java:171) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.lockKeyAndCheckOwnership(AbstractTxLockingInterceptor.java:169) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.lockAndRegisterBackupLock(AbstractTxLockingInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitLockControlCommand(PessimisticLockingInterceptor.java:235) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.AbstractVisitor.visitLockControlCommand(AbstractVisitor.java:147) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.TxInterceptor.invokeNextInterceptorAndVerifyTransaction(TxInterceptor.java:114) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.TxInterceptor.visitLockControlCommand(TxInterceptor.java:181) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.AbstractVisitor.visitLockControlCommand(AbstractVisitor.java:147) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.statetransfer.TransactionSynchronizerInterceptor.visitLockControlCommand(TransactionSynchronizerInterceptor.java:75) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:263) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.statetransfer.StateTransferInterceptor.handleTxCommand(StateTransferInterceptor.java:194) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.statetransfer.StateTransferInterceptor.visitLockControlCommand(StateTransferInterceptor.java:136) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.AbstractVisitor.visitLockControlCommand(AbstractVisitor.java:147) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.InvocationContextInterceptor.visitLockControlCommand(InvocationContextInterceptor.java:78) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.BatchingInterceptor.handleDefault(BatchingInterceptor.java:58) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.AbstractVisitor.visitLockControlCommand(AbstractVisitor.java:147) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.acceptVisitor(LockControlCommand.java:110) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:333) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.commands.control.LockControlCommand.perform(LockControlCommand.java:129) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.remoting.InboundInvocationHandlerImpl.handleInternal(InboundInvocationHandlerImpl.java:95) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.remoting.InboundInvocationHandlerImpl.access$000(InboundInvocationHandlerImpl.java:50) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at org.infinispan.remoting.InboundInvocationHandlerImpl$2.run(InboundInvocationHandlerImpl.java:172) [infinispan-core-6.0.2.Final.jar:6.0.2.Final]

              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_07]

              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_07]

              at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_07]

            • 3. Re: TimeoutException with Infinispan
              valsaraj viswanathan Master

              Hi pferraro,

               

              My application is distributable. I found some suggestion to remove it to avoid this error but we can't do this. I checked configuration file of JBoss to find which timeout is set to 15s but cannot find a value that matches 15s. Do you know what is this and how can we increase this value?

               

              Thanks!

              • 4. Re: TimeoutException with Infinispan
                Paul Ferraro Master

                When does this timeout occur?  e.g. during startup, shutdown, etc?

                 

                This timeout is controlled by the <locking/> element of a cache, e.g.

                <distributed-cache name="server">
                    <locking acquire-timeout="15000"/>
                </distributed-cache>