Problem with acquiring the lock held by another thread
sverdier Nov 27, 2017 8:16 AMHello
We have the following error on our application
2017-11-16 15:59:55,806 ERROR [InboundInvocationHandlerImpl]||ID:JBM-e0af5084-5e4a-48a2-ba4f-13fa7d49a7c8|ISPN000260: Exception executing command
- org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [10 seconds] on key [[U_ALL]|null|{3C982090-12BB-01dd-8090-0003BA0AEDF7}|false_1510847691977] for requestor [Thread[remote-thread-30857,5,JBoss Pooled Threads]]! Lock held by [Thread[remote-thread-30832,5,JBoss Pooled Threads]]
ERROR [InvocationContextInterceptor]||ID:JBM-e0af5084-5e4a-48a2-ba4f-13fa7d49a7c8|ISPN000136: Execution error
- org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [10 seconds] on key [[U_ALL]|null|{3C982090-12BB-01dd-8090-0003BA0AEDF7}|false_1510847691977] for requestor [Thread[remote-thread-30853,5,JBoss Pooled Threads]]! Lock held by [Thread[remote-thread-30832,5,JBoss Pooled Threads]]
As you can see Infinisipan is build in to the web application :
[root@XXXO005O005 ~]# strings /app/jboss/jboss-5.1.0.GA/server/airman/deploy/airman-web.ear |grep infi |tail -n 4
org/infinispan/commons/util/concurrent/jdk8backported/Striped64$Cell.classPK
org/infinispan/commons/util/concurrent/jdk8backported/Striped64$HashCode.classPK
org/infinispan/commons/util/concurrent/jdk8backported/Striped64$ThreadHashCode.classPK
org/infinispan/commons/util/concurrent/jdk8backported/Striped64.classPK
Version of used Infinispan is :
2017-11-16 17:55:47,135 INFO [JGroupsTransport]|||ISPN000094: Received new cluster view: [XXXO005O005-10772|0] (1) [XXXO005O005-10772]
2017-11-16 17:55:47,137 INFO [JGroupsTransport]|||ISPN000079: Cache local address is XXXO005O005-10772, physical addresses are [X.X.1X.X:61915]
2017-11-16 17:55:47,141 INFO [GlobalComponentRegistry]|||ISPN000128: Infinispan version: Infinispan 'Infinium' 6.0.2.Final
The issue starts occurring constantly from 13:32
The issue stopped occurring on node 1 (XXXO005O005) :
During this period there is a plenty of errors :
2017-11-16 15:59:45,451 ERROR [TxPolicy]|CPA|44a168e9-789f-3bad-82a0-5fbfec1ad8b3|javax.ejb.EJBTransactionRolledbackException: Node XXXO005-49482 timed out
2017-11-16 15:59:45,450 ERROR [TxPolicy]|THY|a06583be-fbf3-36f2-bce2-b8e9929d1e25|javax.ejb.EJBTransactionRolledbackException: Node XXXO005-49482 timed out
2017-11-16 15:59:45,455 ERROR [TxPolicy]|||javax.ejb.EJBTransactionRolledbackException: javax.ejb.EJBTransactionRolledbackException: Node XXXO005-49482 timed out
2017-11-16 15:59:45,446 ERROR [TxPolicy]|AVA|7163330b-0c84-393b-a2ed-91b98634f55d|javax.ejb.EJBTransactionRolledbackException: Node XXXO005O005-49482 timed out
2017-11-16 15:59:45,444 ERROR [TxPolicy]|SVA|9bffa28a-822f-327f-b964-fd04366ca773|javax.ejb.EJBTransactionRolledbackException: Node XXXO005O005-49482 timed out
Same checks has been done on second node (XXXO005O005):
Eend of the issue on node 1 has stopped after restart of JBOSS on node 2
Tks for your help