0 Replies Latest reply on Nov 27, 2017 8:16 AM by sverdier

    Problem with acquiring the lock held by another thread

    sverdier

      Hello

       

      We have the following error on our application

       

      2017-11-16 15:59:55,806 ERROR [InboundInvocationHandlerImpl]||ID:JBM-e0af5084-5e4a-48a2-ba4f-13fa7d49a7c8|ISPN000260: Exception executing command

      • org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [10 seconds] on key [[U_ALL]|null|{3C982090-12BB-01dd-8090-0003BA0AEDF7}|false_1510847691977] for requestor [Thread[remote-thread-30857,5,JBoss Pooled Threads]]! Lock held by [Thread[remote-thread-30832,5,JBoss Pooled Threads]]

       

      ERROR [InvocationContextInterceptor]||ID:JBM-e0af5084-5e4a-48a2-ba4f-13fa7d49a7c8|ISPN000136: Execution error

      • org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [10 seconds] on key [[U_ALL]|null|{3C982090-12BB-01dd-8090-0003BA0AEDF7}|false_1510847691977] for requestor [Thread[remote-thread-30853,5,JBoss Pooled Threads]]! Lock held by [Thread[remote-thread-30832,5,JBoss Pooled Threads]]

       

      As you can see Infinisipan is build in to the web application :

       

      [root@XXXO005O005 ~]# strings /app/jboss/jboss-5.1.0.GA/server/airman/deploy/airman-web.ear |grep infi |tail -n 4

      org/infinispan/commons/util/concurrent/jdk8backported/Striped64$Cell.classPK

      org/infinispan/commons/util/concurrent/jdk8backported/Striped64$HashCode.classPK

      org/infinispan/commons/util/concurrent/jdk8backported/Striped64$ThreadHashCode.classPK

      org/infinispan/commons/util/concurrent/jdk8backported/Striped64.classPK

       

       

      Version of used Infinispan is :

       

      2017-11-16 17:55:47,135 INFO [JGroupsTransport]|||ISPN000094: Received new cluster view: [XXXO005O005-10772|0] (1) [XXXO005O005-10772]

      2017-11-16 17:55:47,137 INFO [JGroupsTransport]|||ISPN000079: Cache local address is XXXO005O005-10772, physical addresses are [X.X.1X.X:61915]

      2017-11-16 17:55:47,141 INFO [GlobalComponentRegistry]|||ISPN000128: Infinispan version: Infinispan 'Infinium' 6.0.2.Final

       

       

      The issue starts occurring constantly from 13:32

       

       

       

      The issue stopped occurring on node 1 (XXXO005O005) :

       

       

       

       

      During this period there is  a plenty of errors :

       

      2017-11-16 15:59:45,451 ERROR [TxPolicy]|CPA|44a168e9-789f-3bad-82a0-5fbfec1ad8b3|javax.ejb.EJBTransactionRolledbackException: Node XXXO005-49482 timed out

      2017-11-16 15:59:45,450 ERROR [TxPolicy]|THY|a06583be-fbf3-36f2-bce2-b8e9929d1e25|javax.ejb.EJBTransactionRolledbackException: Node XXXO005-49482 timed out

      2017-11-16 15:59:45,455 ERROR [TxPolicy]|||javax.ejb.EJBTransactionRolledbackException: javax.ejb.EJBTransactionRolledbackException: Node XXXO005-49482 timed out

      2017-11-16 15:59:45,446 ERROR [TxPolicy]|AVA|7163330b-0c84-393b-a2ed-91b98634f55d|javax.ejb.EJBTransactionRolledbackException: Node XXXO005O005-49482 timed out

      2017-11-16 15:59:45,444 ERROR [TxPolicy]|SVA|9bffa28a-822f-327f-b964-fd04366ca773|javax.ejb.EJBTransactionRolledbackException: Node XXXO005O005-49482 timed out

       

      Same checks has been done on second node (XXXO005O005):

       

       

       

       

      Eend of the issue on node 1 has stopped after restart of JBOSS on node 2

       

      Tks for your help