2 Replies Latest reply on Jul 18, 2016 7:39 AM by Asher Bitton

    Wildfly 10 standalone-ha cluster with infinispan on AWS

    Asher Bitton Newbie

      Hi,

       

      We are building a Wildfly 10 standalone-ha cluster (made of 2 to 4 nodes) with a LB in AWS (moving from a VMWare based Wildfly8 standalone with a keepalive LB and Apache frontending the wildfly servers). After going through all of the setup everything seems to be working fine, Testing the cluster (taking up\down the different nodes) we can see that the sessions behave properly and the client does not notice the nodes interruptions.

      The only problem is that the Wildfly logs (of both nodes in the cluster) are full of the exception:

      08:58:53,829 WARN  [org.infinispan.transaction.tm.DummyTransaction] (SessionExpirationScheduler - 1) ISPN000112: exception while committing: javax.transaction.xa.XAException

      The exceptions seems to be happening every few seconds, regardless of traffic to the cluster.

       

      Following other posts on the forum we have used the following infinispan configuration:

                      <replicated-cache name="portalCache" mode="SYNC">

                          <transaction locking="OPTIMISTIC"/>

                          <locking isolation="READ_COMMITTED"/>

        <transaction mode="BATCH"/>

                          <file-store/>

                      </replicated-cache>

      And on the stack side we used:

      <stack name="s3">

                          <transport type="TCP" socket-binding="jgroups-tcp"/>

                          <protocol type="S3_PING">

                              <property name="access_key">

                                  my-access-key

                              </property>

                              <property name="secret_access_key">

                                  my-secret-access-key

                              </property>

                              <property name="location">

                                  my-buckect-name

                              </property>

                          </protocol>

                          <protocol type="MERGE3"/>

                          <protocol type="FD_SOCK" socket-binding="jgroups-tcp-fd"/>

                          <protocol type="FD"/>

                          <protocol type="VERIFY_SUSPECT"/>

                          <protocol type="pbcast.NAKACK2">

      <property name="use_mcast_xmit">false</property>
      <property name="use_mcast_xmit_req">false</property>
      </protocol>

                          <protocol type="UNICAST3"/>

                          <protocol type="pbcast.STABLE"/>

                          <protocol type="pbcast.GMS"/>

                          <protocol type="MFC"/>

                          <protocol type="FRAG2"/>

                          <protocol type="RSVP"/>

                      </stack>

       

       

      We would like to know that this is not a problem and how we can make sure the message goes away (preferably by fixing the root cause of it).

        • 1. Re: Wildfly 10 standalone-ha cluster with infinispan on AWS
          Paul Ferraro Master

          Do you have a full stack trace?

          • 2. Re: Wildfly 10 standalone-ha cluster with infinispan on AWS
            Asher Bitton Newbie

            Sure:

            07:38:03,826 WARN  [org.infinispan.transaction.tm.DummyTransaction] (SessionExpirationScheduler - 1) ISPN000112: exception while committing: javax.transaction.xa.XAException

                    at org.infinispan.transaction.xa.TransactionXaAdapter.getLocalTransactionAndValidateImpl(TransactionXaAdapter.java:242)

                    at org.infinispan.transaction.xa.TransactionXaAdapter.getLocalTransactionAndValidate(TransactionXaAdapter.java:235)

                    at org.infinispan.transaction.xa.TransactionXaAdapter.commit(TransactionXaAdapter.java:103)

                    at org.infinispan.transaction.tm.DummyTransaction.finishResource(DummyTransaction.java:389)

                    at org.infinispan.transaction.tm.DummyTransaction.commitResources(DummyTransaction.java:435)

                    at org.infinispan.transaction.tm.DummyTransaction.runCommit(DummyTransaction.java:314)

                    at org.infinispan.transaction.tm.DummyTransaction.commit(DummyTransaction.java:105)

                    at org.infinispan.transaction.tm.DummyBaseTransactionManager.commit(DummyBaseTransactionManager.java:73)

                    at org.wildfly.clustering.ee.infinispan.ActiveTransactionBatch.close(ActiveTransactionBatch.java:48)

                    at org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler$ExpirationTask.run(SessionExpirationScheduler.java:148)

                    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

                    at java.util.concurrent.FutureTask.run(FutureTask.java:266)

                    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)

                    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)

                    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

                    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

                    at java.lang.Thread.run(Thread.java:745)

                    at org.jboss.threads.JBossThread.run(JBossThread.java:320)