ModeShape + InfiniSpan cluster: indexes are not updated
geensb May 22, 2013 10:48 AMWe are trying to set up a clustered ModeShape with a replicated InfiniSpan as cache in JBoss 5 on MS Windows using SQL Server. (ModeShape 3.2.0, InfiniSpan 5.2.5, JGroups 3.2.7, SQL Server 2008, JBoss is not clustered).
The problem we are facing is that when data is modified on the first machine the index on the second machine is not updated. The changes however can be found in InfiniSpan so our InfiniSpan configuration would appear to be correct (even so I've attached it for completeness).
A bunch of these messages do appear in the second machine's log which to me seem to indicate that it is getting "nudged" about the udpated data:
2013-05-22 16:07:58,162 TRACE [org.modeshape.jcr.bus.ClusteredRepositoryChangeBus] (Incoming-2,HA2-BRMS-23320) Received on cluster 'modeshape-cluster' 10 changes on workspace system made by <anonymous> from process '4b0a01e9-27d3-4c6b-bd2a-fa09a585334a' at 2013-05-22T16:07:58.300+02:00 2013-05-22 16:07:58,224 TRACE [org.infinispan.remoting.InboundInvocationHandlerImpl] (OOB-5,HA2-BRMS-5605) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=b099a6e7505d64fb52aaa6-4560-4ab6-9ae8-f0d028de2be3, value=SchematicEntryWholeDelta{ "metadata" : { "id" : "b099a6e7505d64fb52aaa6-4560-4ab6-9ae8-f0d028de2be3" , "contentType" : "application/json" } , "content" : { "key" : "b099a6e7505d64fb52aaa6-4560-4ab6-9ae8-f0d028de2be3" , "parent" : "b099a6e7505d64/" , "properties" : { "http://www.jcp.org/jcr/1.0" : { "primaryType" : { "$name" : "{http://www.lettergen.com/common/}Request" } , "created" : { "$date" : "2013-05-22T16:07:58.222+02:00" } , "mixinTypes" : [ { "$name" : "mix:lockable" } ] , "createdBy" : "<anonymous>" , "lockOwner" : "<anonymous>" , "lockIsDeep" : true } , "http://www.lettergen.com/common/" : { "guid" : "07c40c43f3b82e08227382940545ba58" } } , "children" : [ { "key" : "b099a6e7505d649b3eeaa6-bcfd-43c6-b2f1-b8aba017fb6a" , "name" : "lg:requestData" } ] , "childrenInfo" : { "count" : 1 } } }, flags=[SKIP_REMOTE_LOOKUP, DELTA_WRITE], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}, PutKeyValueCommand{key=b099a6e7505d649b3eeaa6-bcfd-43c6-b2f1-b8aba017fb6a, value=SchematicEntryWholeDelta{ "metadata" : { "id" : "b099a6e7505d649b3eeaa6-bcfd-43c6-b2f1-b8aba017fb6a" , "contentType" : "application/json" } , "content" : { "key" : "b099a6e7505d649b3eeaa6-bcfd-43c6-b2f1-b8aba017fb6a" , "parent" : "b099a6e7505d64fb52aaa6-4560-4ab6-9ae8-f0d028de2be3" , "properties" : { "http://www.jcp.org/jcr/1.0" : { "primaryType" : { "$name" : "nt:file" } , "created" : { "$date" : "2013-05-22T16:07:58.409+02:00" } , "createdBy" : "<anonymous>" } } , "children" : [ { "key" : "b099a6e7505d64c74c1749-7b13-4a5e-b703-50677337d991" , "name" : "jcr:content" } ] , "childrenInfo" : { "count" : 1 } } }, flags=null, putIfAbsent=true, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}, PutKeyValueCommand{key=545c23ac44b1f83fbe696e9db8b4beb961446731-ref, value=SchematicEntryWholeDelta{ "metadata" : { "id" : "545c23ac44b1f83fbe696e9db8b4beb961446731-ref" , "contentType" : "application/json" } , "content" : { "sha1" : "545c23ac44b1f83fbe696e9db8b4beb961446731" , "refCount" : 13 } }, flags=[SKIP_REMOTE_LOOKUP, DELTA_WRITE], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}, PutKeyValueCommand{key=b099a6e7505d64c74c1749-7b13-4a5e-b703-50677337d991, value=SchematicEntryWholeDelta{ "metadata" : { "id" : "b099a6e7505d64c74c1749-7b13-4a5e-b703-50677337d991" , "contentType" : "application/json" } , "content" : { "key" : "b099a6e7505d64c74c1749-7b13-4a5e-b703-50677337d991" , "parent" : "b099a6e7505d649b3eeaa6-bcfd-43c6-b2f1-b8aba017fb6a" , "properties" : { "http://www.jcp.org/jcr/1.0" : { "primaryType" : { "$name" : "nt:resource" } , "data" : { "$sha1" : "545c23ac44b1f83fbe696e9db8b4beb961446731" , "$len" : 672 } , "lastModified" : { "$date" : "2013-05-22T16:07:58.409+02:00" } , "lastModifiedBy" : "<anonymous>" , "mimeType" : "text/xml" } } } }, flags=null, putIfAbsent=true, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=true, gtx=GlobalTransaction:<HA1-BRMS-47165>:288:remote, cacheName='BinRepository', topologyId=6} 2013-05-22 16:07:58,255 TRACE [org.infinispan.remoting.InboundInvocationHandlerImpl] (OOB-5,HA2-BRMS-5605) About to send back response null for command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction:<HA1-BRMS-47165>:288:local, cacheName=DataStoreRepository} 2013-05-22 16:07:58,287 TRACE [org.modeshape.jcr.bus.ClusteredRepositoryChangeBus] (Incoming-1,HA2-BRMS-23320) Received on cluster 'modeshape-cluster' 10 changes on workspace default made by <anonymous> from process '4b0a01e9-27d3-4c6b-bd2a-fa09a585334a' at 2013-05-22T16:07:58.409+02:00
However when trying to query for this node (using SQL2) on the second machine it can't be found. It seems that for some reason the index doesn't get updated.
Note that requesting the root node and iterating over the entire repository does work as expected, presumably the index isn't used when doing so (which would make sense).
We have been struggling with this for a while now and haven't been able to dig up anything that could help us so far. Possibly we haven't been looking for the right thing, any pointers or information you could provide would be most appreciated.
-
jgroups-lg-ms.xml.zip 1.8 KB
-
jgroups-lg.xml.zip 1.8 KB
-
modeshape-config.json.zip 648 bytes
-
configuration.xml 2.8 KB