Infinispan - hibernate search - Update exception
Hi Team,
We are on Infinispan 7.0.0.Final & Hibernate-search 5.0.0.Beta1. Using shared indexing on the distributed cluster. The jgroups being used as worker backend, for a single node doing the update.
We have been tuning this for quite a while with a numerous upgrades and still we keep getting into issues.
The latest is this: Why is jgroups trying to send the updates to the same node. Please help.Attaching the infinispan configuration file that we are using. Quick suggestions are highly appreciated.
:25:52,216 ERROR [org.infinispan.interceptors.InvocationContextInterceptor] (Incoming-243,lxomavmtceap616-11308) ISPN000136: Execution error: org.hibernate.search.exception.SearchException: HSEARCH200004: Unable to send Lucene update w
ork via JGroups cluster
at org.hibernate.search.backend.jgroups.impl.JGroupsBackendQueueTask.sendLuceneWorkList(JGroupsBackendQueueTask.java:85)
at org.hibernate.search.backend.jgroups.impl.JGroupsBackendQueueProcessor.applyWork(JGroupsBackendQueueProcessor.java:155)
at org.hibernate.search.indexes.impl.DirectoryBasedIndexManager.performOperations(DirectoryBasedIndexManager.java:113) [hibernate-search-engine-5.0.0.Beta1.jar:5.0.0.Beta1]
at org.hibernate.search.backend.impl.WorkQueuePerIndexSplitter.commitOperations(WorkQueuePerIndexSplitter.java:49) [hibernate-search-engine-5.0.0.Beta1.jar:5.0.0.Beta1]
at org.hibernate.search.backend.impl.BatchedQueueingProcessor.performWorks(BatchedQueueingProcessor.java:82) [hibernate-search-engine-5.0.0.Beta1.jar:5.0.0.Beta1]
at org.hibernate.search.backend.impl.TransactionalWorker.performWork(TransactionalWorker.java:86) [hibernate-search-engine-5.0.0.Beta1.jar:5.0.0.Beta1]
at org.infinispan.query.backend.QueryInterceptor.performSearchWorks(QueryInterceptor.java:235) [infinispan-query.jar:7.0.0.Final]
at org.infinispan.query.backend.QueryInterceptor.performSearchWork(QueryInterceptor.java:229) [infinispan-query.jar:7.0.0.Final]
at org.infinispan.query.backend.QueryInterceptor.removeFromIndexes(QueryInterceptor.java:217) [infinispan-query.jar:7.0.0.Final]
at org.infinispan.query.backend.QueryInterceptor.processPutMapCommand(QueryInterceptor.java:414) [infinispan-query.jar:7.0.0.Final]
at org.infinispan.query.backend.QueryInterceptor.visitPutMapCommand(QueryInterceptor.java:186) [infinispan-query.jar:7.0.0.Final]
at org.infinispan.commands.write.PutMapCommand.acceptVisitor(PutMapCommand.java:47) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitPutMapCommand(NonTransactionalLockingInterceptor.java:67) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.write.PutMapCommand.acceptVisitor(PutMapCommand.java:47) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.AbstractVisitor.visitPutMapCommand(AbstractVisitor.java:55) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.write.PutMapCommand.acceptVisitor(PutMapCommand.java:47) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.AbstractVisitor.visitPutMapCommand(AbstractVisitor.java:55) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.write.PutMapCommand.acceptVisitor(PutMapCommand.java:47) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:166) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.statetransfer.StateTransferInterceptor.visitPutMapCommand(StateTransferInterceptor.java:100) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.write.PutMapCommand.acceptVisitor(PutMapCommand.java:47) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.CacheMgmtInterceptor.visitPutMapCommand(CacheMgmtInterceptor.java:117) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.write.PutMapCommand.acceptVisitor(PutMapCommand.java:47) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.AbstractVisitor.visitPutMapCommand(AbstractVisitor.java:55) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.write.PutMapCommand.acceptVisitor(PutMapCommand.java:47) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:333) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.remote.BaseRpcInvokingCommand.processVisitableCommand(BaseRpcInvokingCommand.java:39) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.commands.remote.SingleRpcCommand.perform(SingleRpcCommand.java:48) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.remoting.InboundInvocationHandlerImpl.handleInternal(InboundInvocationHandlerImpl.java:97) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.remoting.InboundInvocationHandlerImpl.handleWithWaitForBlocks(InboundInvocationHandlerImpl.java:218) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:86) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommandFromLocalCluster(CommandAwareRpcDispatcher.java:267) [infinispan-core.jar:7.0.0.Final]
at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:211) [infinispan-core.jar:7.0.0.Final]
at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:460) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:377) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:250) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:677) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.JChannel.up(JChannel.java:733) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1029) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.pbcast.STATE_TRANSFER.up(STATE_TRANSFER.java:146) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.RSVP.up(RSVP.java:201) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:505) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.FRAG2.up(FRAG2.java:182) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:447) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:447) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:294) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.UNICAST3.deliverBatch(UNICAST3.java:1087) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.UNICAST3.removeAndDeliver(UNICAST3.java:886) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.UNICAST3.handleDataReceived(UNICAST3.java:790) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.UNICAST3.up(UNICAST3.java:426) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:619) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:155) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:200) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:297) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.MERGE3.up(MERGE3.java:288) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.Discovery.up(Discovery.java:277) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.MPING.up(MPING.java:178) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.TP.passMessageUp(TP.java:1572) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at org.jgroups.protocols.TP$MyHandler.run(TP.java:1791) [jgroups-3.6.0.Final.jar:3.6.0.Final]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65]
Caused by: org.jgroups.TimeoutException: HSEARCH200002: Timeout sending synchronous message to JGroups peer 'lxomavmtceap616-40022''
at org.hibernate.search.backend.jgroups.impl.DispatchMessageSender.send(DispatchMessageSender.java:84)
at org.hibernate.search.backend.jgroups.impl.JGroupsBackendQueueTask.sendLuceneWorkList(JGroupsBackendQueueTask.java:79)
... 72 more
-
infinispan-config-test2.zip 2.5 KB
