0 Replies Latest reply on Aug 1, 2017 6:39 AM by sujitrajan

Replication timeout exception is occuring often in infinispan replicated cache added in wildfly 10 cluster(2 nodes)

sujitrajan Aug 1, 2017 6:39 AM

Hi All,

We are setting up a clustered environment using wildfly 10 of 2 nodes. We have added a new cache-container & replicated cache named 'userSessionData' for sharing data across 2 servers.Standalone-full-ha.xml is used. Everything is working fine in our development environment. But in client pre-prod environment, quite often, we are getting replication timeout exception. In our dev environment, we are using default remote-timeout setting i.e. 17500 ms, which I think corresponds to replication timeout. In client pre-prod env. , we have increased it to 60000 ms i.e. 1 min, but still getting same exception quite often. One of the timeout issue scenario:- When user login into application,then we put user session details into cache. During writing into cache, exception occurs. I have attached infinispan configuration, java codes used during cache writing & exception. Also pasted it below.

Please help me as soon as possible.It's very urgent. Without this we can't make our prod live.

Below is the infinispan configuration for added cache.

<cache-container name="userSessionData_cache" default-cache="default" jndi-name="infinispan/userSessionData_cache">

<replicated-cache name="userSessionData" jndi-name="infinispan/userSessionData_cache/userSessionData" mode="SYNC" remote-timeout="60000">

</replicated-cache>

</cache-container>

Below is the java class code which will call another java class used for cache:

public class UserSessionTracker {

private UserSessionTracker() {

}

private static UserSessionTracker instance = new UserSessionTracker();

public static void putUserSession(String userName, String sessionId) {

synchronized (instance) {

UserSessionDataCacheManager.getInstance().putUserSession(userName, sessionId);

}

Below is the java class used for cache (Singleton pattern for class is used ) :

@ManagedBean(name = "userSessionDataCacheManager", eager = true)

@ApplicationScoped

public class UserSessionDataCacheManager {

@Resource(name = "java:jboss/infinispan/userSessionData_cache/userSessionData")

private Cache<String, java.util.Hashtable<String, Object>> entityCache = null;

private static UserSessionDataCacheManager configInstance = null;

public UserSessionDataCacheManager() {

configInstance = this;

}

@PostConstruct

public void start() {

System.out.println("Cache name: " + entityCache.getName());

}

public static UserSessionDataCacheManager getInstance() {

if (configInstance == null) {

createInstance();

}

return configInstance;

}

private static void createInstance() {

configInstance = new UserSessionDataCacheManager();

}

public void putUserSession(String userName, String sessionId) {

System.out.println("inside putUserSession");

java.util.Hashtable<String, Object> sessionData = new java.util.Hashtable<String, Object>();

sessionData.put("Session", sessionId);

entityCache.put(userName, sessionData);

}

Below is the exception log.

2017-07-27 11:53:54,539 INFO [stdout] (default task-15) inside putUserSession

2017-07-27 11:54:54,571 ERROR [org.infinispan.interceptors.InvocationContextInterceptor] (default task-15) ISPN000136: Error executing command PrepareCommand, writing keys [F2959267]: org.infinispan.util.concurrent.TimeoutException: Replication timeout for fit-r3stems01

at org.infinispan.remoting.transport.jgroups.JGroupsTransport.checkRsp(JGroupsTransport.java:801)

at org.infinispan.remoting.transport.jgroups.JGroupsTransport.lambda$invokeRemotelyAsync$1(JGroupsTransport.java:642)

at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602)

at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577)

at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)

at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962)

at org.infinispan.remoting.transport.jgroups.RspListFuture.call(RspListFuture.java:47)

at org.infinispan.remoting.transport.jgroups.RspListFuture.call(RspListFuture.java:16)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:748)

2017-07-27 11:54:54,571 ERROR [org.infinispan.transaction.impl.TransactionCoordinator] (default task-15) ISPN000097: Error while processing a prepare in a single-phase transaction: org.infinispan.util.concurrent.TimeoutException: Replication timeout for fit-r3stems01