ISPN00136: Execution error The local cache xxxx failed to backup data to the remote sites:

[ckriley0814]

Hi,

I am trying to configure Infinispan 5.2.Final to perform cross-site replication to an AWS instance also running Infinispan 5.2.Final. When I place a message into a cache, I get the following error:

2013-07-12 07:58:39,034 ERROR [InvocationContextInterceptor] (HotRodServerWorker-2) ISPN000136: Execution error

The local cache importantCache failed to backup data to the remote sites:

VA: UnreachableException: member=SiteMaster(VA)

  at org.infinispan.xsite.BackupSenderImpl.processFailedResponses(BackupSenderImpl.java:224)

  at org.infinispan.xsite.BackupSenderImpl.processResponses(BackupSenderImpl.java:133)

  at org.infinispan.xsite.BackupSenderImpl.processResponses(BackupSenderImpl.java:125)

  at org.infinispan.interceptors.xsite.NonTransactionalBackupInterceptor.handleWrite(NonTransactionalBackupInterceptor.java:70)

  at org.infinispan.interceptors.xsite.NonTransactionalBackupInterceptor.visitPutKeyValueCommand(NonTransactionalBackupInterceptor.java:42)

  at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)

  at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)

  at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitPutKeyValueCommand(NonTransactionalLockingInterceptor.java:84)

  at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)

  at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)

  at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132)

  at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:62)

  at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)

  at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)

  at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:128)

  at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:92)

  at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:62)

  at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)

  at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:343)

  at org.infinispan.CacheImpl.executeCommandAndCommitIfNeeded(CacheImpl.java:1162)

  at org.infinispan.CacheImpl.putInternal(CacheImpl.java:760)

  at org.infinispan.CacheImpl.put(CacheImpl.java:754)

  at org.infinispan.DecoratedCache.put(DecoratedCache.java:320)

  at org.infinispan.server.core.AbstractProtocolDecoder.put(AbstractProtocolDecoder.scala:201)

  at org.infinispan.server.core.AbstractProtocolDecoder.decodeValue(AbstractProtocolDecoder.scala:156)

  at org.infinispan.server.core.AbstractProtocolDecoder.decode(AbstractProtocolDecoder.scala:73)

  at org.infinispan.server.core.AbstractProtocolDecoder.decode(AbstractProtocolDecoder.scala:47)

  at org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500)

  at org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435)

  at org.infinispan.server.core.AbstractProtocolDecoder.messageReceived(AbstractProtocolDecoder.scala:387)

  at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)

  at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560)

  at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555)

  at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268)

  at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255)

  at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)

  at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107)

  at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:313)

  at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88)

  at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)

  at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)

  at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)

  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)

  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)

  at java.lang.Thread.run(Thread.java:662)

Reading both Infinispan cross site doc and JGroups, I have three configuration files:

- infinispan.xml

- bos.xml

- bos-relay.xml

- global.xml

I have attached these to these the discussion as well as the full log on the local infinispan instance where the cache put is made. In addition to the configuration files we are using CENTOS 6.4 on the local box, RHEL 6 Linux on the AWS instance. JDK 1.6 for both environments.

[ckriley0814]

Figured it out on our own. Basically downloaded the udp.xml and tcp.xml from the distro and modified those versus downloading the files in the WAN Replication documentation. We think we changed the sequence and made the files invalid.