6 Replies Latest reply on Jan 13, 2012 6:08 AM by Galder Zamarreño

    hotrod server does not start on AIX - IBM JDK 6

    Trixie Tango Newbie

      I am trying to start infinispan server with 'hotrod' protocol and sample jgroups.xml provided in the distribution on AIX.  JDK version is:

       

      java version "1.6.0"

      Java(TM) SE Runtime Environment (build pap3260sr9ifix-20110208_02(SR9+PM18528+IZ90220+IZ94423))

      IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 AIX ppc-32 jvmap3260sr9-20101209_70480 (JIT enabled, AOT enabled)

       

      I am getting following exception:

       

      2012-01-10 10:07:45,154 ERROR [CacheViewsManagerImpl] (CacheViewInstaller-1,Node-1-6273) ISPN000172: Failed to prepare view CacheView{viewId=3, members=[Node-1-6273]} for cache  ___hotRodTopologyCache, rolling back to view Ca

      cheView{viewId=2, members=[]}

      java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: org.infinispan.marshall.jboss.ExtendedRiverMarshaller (initialization failure)

              at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:243)

              at java.util.concurrent.FutureTask.get(FutureTask.java:102)

              at org.infinispan.cacheviews.CacheViewsManagerImpl.clusterPrepareView(CacheViewsManagerImpl.java:303)

              at org.infinispan.cacheviews.CacheViewsManagerImpl.clusterInstallView(CacheViewsManagerImpl.java:249)

              at org.infinispan.cacheviews.CacheViewsManagerImpl$ViewInstallationTask.call(CacheViewsManagerImpl.java:856)

              at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314)

              at java.util.concurrent.FutureTask.run(FutureTask.java:149)

              at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:897)

              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:919)

              at java.lang.Thread.run(Thread.java:736)

      Caused by: java.lang.NoClassDefFoundError: org.infinispan.marshall.jboss.ExtendedRiverMarshaller (initialization failure)

              at java.lang.J9VMInternals.initialize(J9VMInternals.java:140)

              at org.infinispan.marshall.jboss.JBossMarshallerFactory.createMarshaller(JBossMarshallerFactory.java:69)

              at org.infinispan.marshall.jboss.JBossMarshaller.getMarshaller(JBossMarshaller.java:65)

              at org.infinispan.marshall.jboss.AbstractJBossMarshaller.startObjectOutput(AbstractJBossMarshaller.java:74)

              at org.infinispan.marshall.VersionAwareMarshaller.startObjectOutput(VersionAwareMarshaller.java:124)

              at org.infinispan.marshall.VersionAwareMarshaller.objectToBuffer(VersionAwareMarshaller.java:89)

              at org.infinispan.marshall.AbstractMarshaller.objectToBuffer(AbstractMarshaller.java:57)

              at org.infinispan.marshall.AbstractDelegatingMarshaller.objectToBuffer(AbstractDelegatingMarshaller.java:84)

              at org.infinispan.remoting.transport.jgroups.MarshallerAdapter.objectToBuffer(MarshallerAdapter.java:45)

              at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.marshallCall(CommandAwareRpcDispatcher.java:212)

              at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.call(CommandAwareRpcDispatcher.java:233)

              at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:109)

              at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:447)

              at org.infinispan.cacheviews.CacheViewsManagerImpl$2.call(CacheViewsManagerImpl.java:292)

              at org.infinispan.cacheviews.CacheViewsManagerImpl$2.call(CacheViewsManagerImpl.java:289)

              ... 5 more

      Caused by: java.lang.IllegalStateException: No standard field found for reverse order comparator!

              at org.jboss.marshalling.river.Protocol.<clinit>(Protocol.java:216)

              at java.lang.J9VMInternals.initializeImpl(Native Method)

              at java.lang.J9VMInternals.initialize(J9VMInternals.java:200)

              at org.jboss.marshalling.river.RiverMarshaller.<clinit>(RiverMarshaller.java:1215)

              at java.lang.J9VMInternals.initializeImpl(Native Method)

              at java.lang.J9VMInternals.initialize(J9VMInternals.java:200)

              at java.lang.J9VMInternals.initialize(J9VMInternals.java:167)

              ... 19 more

       

       

      When I googled I found out that there was an issue with IBM JDK.  Is there a way to fix this?

       

      Thanks

        • 1. Re: hotrod server does not start on AIX - IBM JDK 6
          Galder Zamarreño Master

          Sounds like a JBoss Marshalling bug and in fact this has previously been reported: https://issues.jboss.org/browse/JBMAR-124

           

          An upgrade to JBoss Marshalling 1.3.1.GA should get rid of this problem.

          • 2. Re: hotrod server does not start on AIX - IBM JDK 6
            Trixie Tango Newbie

            Downloaded 1.3.1 GA and it is working fine now.  Thanks a lot.

             

            I am trying to setup a hotrod server distributed cache between unix machine and windows using the sample jgroups-tcp.xml provided in the distribution.  Sample configuration has 127.0.0.1 as ip address.  What changes has to be made to jgroups-tcp.xml to set up cluster between the 2 boxes?  is there a ssample config?

             

            Thanks

            • 3. Re: hotrod server does not start on AIX - IBM JDK 6
              Galder Zamarreño Master

              Well, pass the right bind address through which the two machines can be communicated - it's like roads really, to get from A to B you need to take exit C

               

              Of course, open the right ports in the firewall or disable firewalls altogether... depends on your environment.

              • 4. Re: hotrod server does not start on AIX - IBM JDK 6
                Galder Zamarreño Master

                Well, pass the right bind address through which the two machines can be communicated - it's like roads really, to get from A to B you need to take exit C

                 

                Of course, open the right ports in the firewall or disable firewalls altogether... depends on your environment.

                • 5. Re: hotrod server does not start on AIX - IBM JDK 6
                  Trixie Tango Newbie

                  I am trying to set up cluster (dist mode) between 2 physical machines windows and linux with no luck so far.  I am able to telnet from windows to linux on port 7800 and 11222 and vice-versa.  But the cluster is not formed.

                   

                  Please see the logs from both the machines.  Actual IP addresses are replaced with dummy ones:

                   

                  Windows log

                   

                  2012-01-12 10:26:51,820 INFO  (main) [org.infinispan.server.core.Main$] ISPN005001: Start main with args: -r, hotrod, -c, \workspaces\infinispan\Infinispan\src\examples\dist-cache-config-node-1.xml, -l, xx.xxx.xx.xxx

                  2012-01-12 10:26:51,867 DEBUG (InfinispanServer-Main) [org.infinispan.util.FileLookup] Unable to find file \workspaces\infinispan\Infinispan\src\examples\dist-cache-config-node-1.xml in classpath; searching for this file on the filesystem instead.

                  2012-01-12 10:26:51,898 DEBUG (InfinispanServer-Main) [org.infinispan.config.InfinispanConfiguration] Using schema schema/infinispan-config-5.1.xsd

                  2012-01-12 10:26:52,070 DEBUG (InfinispanServer-Main) [org.infinispan.util.ModuleProperties] Loading lifecycle SPI class: org.infinispan.server.hotrod.LifecycleCallbacks@c05d3b

                  2012-01-12 10:26:52,086 DEBUG (InfinispanServer-Main) [org.infinispan.util.ModuleProperties] Loading lifecycle SPI class: org.infinispan.server.memcached.LifecycleCallbacks@9945ce

                  2012-01-12 10:26:52,086 DEBUG (InfinispanServer-Main) [org.infinispan.util.ModuleProperties] Loading lifecycle SPI class: org.infinispan.server.core.LifecycleCallbacks@110003

                  2012-01-12 10:26:52,133 DEBUG (InfinispanServer-Main) [org.infinispan.util.ModuleProperties] No module command extensions to load

                  2012-01-12 10:26:52,289 DEBUG (InfinispanServer-Main) [org.infinispan.manager.DefaultCacheManager] Started cache manager test-infinispan-cluster on null

                  2012-01-12 10:26:52,304 DEBUG (InfinispanServer-Main) [org.infinispan.server.hotrod.HotRodServer] Externally facing address is xx.xxx.xx.xxx:11222

                  2012-01-12 10:26:52,492 INFO  (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000078: Starting JGroups Channel

                  2012-01-12 10:26:52,539 DEBUG (InfinispanServer-Main) [org.jgroups.conf.ClassConfigurator] Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs

                  2012-01-12 10:26:52,726 DEBUG (InfinispanServer-Main) [org.jgroups.stack.Configurator] set property TCP.diagnostics_addr to default value /224.0.75.75

                  2012-01-12 10:26:52,758 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.FRAG2] received CONFIG event: {bind_addr=/xx.xxx.xx.xxx}

                  2012-01-12 10:26:52,758 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.MPING] bind_addr=/xx.xxx.xx.xxx mcast_addr=/228.6.7.8, mcast_port=46655

                  2012-01-12 10:26:52,914 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.GMS] address=win-1-61839, cluster=test-infinispan-cluster, physical address=xx.xxx.xx.xxx:7800

                  2012-01-12 10:26:55,945 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.NAKACK]

                  [setDigest()]

                  existing digest:  []

                  new digest:       win-1-61839: [0 (0)]

                  resulting digest: win-1-61839: [0 (0)]

                  2012-01-12 10:26:55,945 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.GMS] win-1-61839: view is [win-1-61839|0] [win-1-61839]

                  2012-01-12 10:26:55,945 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection

                  2012-01-12 10:26:55,945 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.FD_SOCK] VIEW_CHANGE received: [win-1-61839]

                  2012-01-12 10:26:55,945 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 400KB (1 members)

                  2012-01-12 10:26:55,961 DEBUG (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [win-1-61839|0] [win-1-61839]

                  2012-01-12 10:26:55,961 INFO  (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [win-1-61839|0] [win-1-61839]

                  2012-01-12 10:26:55,961 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection

                  2012-01-12 10:26:55,961 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.GMS] created group (first member). My view is [win-1-61839|0], impl is org.jgroups.protocols.pbcast.CoordGmsImpl

                  2012-01-12 10:26:56,055 INFO  (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000079: Cache local address is win-1-61839, physical addresses are [xx.xxx.xx.xxx:7800]

                  2012-01-12 10:26:56,055 DEBUG (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] Waiting on view being accepted

                  2012-01-12 10:26:56,086 DEBUG (InfinispanServer-Main) [org.infinispan.transaction.TransactionTable] Min view id set to 0

                  2012-01-12 10:26:56,086 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 7

                  2012-01-12 10:26:56,086 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is:

                            >> org.infinispan.interceptors.InvocationContextInterceptor

                            >> org.infinispan.interceptors.StateTransferLockInterceptor

                            >> org.infinispan.interceptors.NotificationInterceptor

                            >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor

                            >> org.infinispan.interceptors.EntryWrappingInterceptor

                            >> org.infinispan.interceptors.ReplicationInterceptor

                            >> org.infinispan.interceptors.CallInterceptor

                  2012-01-12 10:26:56,086 DEBUG (InfinispanServer-Main) [org.infinispan.cacheviews.CacheViewsManagerImpl] ___hotRodTopologyCache: Node win-1-61839 is joining

                  2012-01-12 10:26:56,086 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.cacheviews.CacheViewsManagerImpl] Installing new view CacheView{viewId=1, members=[win-1-61839]} for cache ___hotRodTopologyCache

                  2012-01-12 10:26:56,101 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.ReplicatedStateTransferTask] Commencing state transfer 1 on node: win-1-61839. Before start, data container had 0 entries

                  2012-01-12 10:26:56,101 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new write commands for cache view 1

                  2012-01-12 10:26:56,117 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.cacheviews.CacheViewsManagerImpl] ___hotRodTopologyCache: Committing cache view 1

                  2012-01-12 10:26:56,117 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking write commands for cache view 1

                  2012-01-12 10:26:56,117 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.BaseStateTransferTask] Node win-1-61839 completed state transfer for view 1 in 16 milliseconds!

                  2012-01-12 10:26:56,117 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.cacheviews.CacheViewsManagerImpl] Successfully installed view CacheView{viewId=1, members=[win-1-61839]} for cache ___hotRodTopologyCache

                  2012-01-12 10:26:56,117 DEBUG (InfinispanServer-Main) [org.infinispan.CacheImpl] Started cache ___hotRodTopologyCache on win-1-61839

                  2012-01-12 10:26:56,148 DEBUG (InfinispanServer-Main) [org.infinispan.server.hotrod.HotRodServer] Map win-1-61839 cluster address with xx.xxx.xx.xxx:11222 server endpoint in address cache

                  2012-01-12 10:26:56,148 DEBUG (InfinispanServer-Main) [org.infinispan.remoting.rpc.RpcManagerImpl] We're the only member in the cluster; Don't invoke remotely.

                  2012-01-12 10:26:56,148 DEBUG (InfinispanServer-Main) [org.infinispan.server.hotrod.HotRodServer] Starting server with basic settings: host=xx.xxx.xx.xxx, port=11222, masterThreads=-1, workerThreads=40, idleTimeout=-1, tcpNoDelay=true, sendBufSize=0, recvBufSize=0

                  2012-01-12 10:26:56,148 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 5

                  2012-01-12 10:26:56,148 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is:

                            >> org.infinispan.interceptors.InvocationContextInterceptor

                            >> org.infinispan.interceptors.NotificationInterceptor

                            >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor

                            >> org.infinispan.interceptors.EntryWrappingInterceptor

                            >> org.infinispan.interceptors.CallInterceptor

                  2012-01-12 10:26:56,148 DEBUG (InfinispanServer-Main) [org.infinispan.CacheImpl] Started cache ___defaultcache on win-1-61839

                  2012-01-12 10:26:56,164 DEBUG (InfinispanServer-Main) [org.infinispan.transaction.TransactionTable] Min view id set to 0

                  2012-01-12 10:26:56,164 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 8

                  2012-01-12 10:26:56,164 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is:

                            >> org.infinispan.interceptors.InvocationContextInterceptor

                            >> org.infinispan.interceptors.CacheMgmtInterceptor

                            >> org.infinispan.interceptors.StateTransferLockInterceptor

                            >> org.infinispan.interceptors.NotificationInterceptor

                            >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor

                            >> org.infinispan.interceptors.EntryWrappingInterceptor

                            >> org.infinispan.interceptors.DistributionInterceptor

                            >> org.infinispan.interceptors.CallInterceptor

                  2012-01-12 10:26:56,180 DEBUG (InfinispanServer-Main) [org.infinispan.cacheviews.CacheViewsManagerImpl] test-cache: Node win-1-61839 is joining

                  2012-01-12 10:26:56,180 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.cacheviews.CacheViewsManagerImpl] Installing new view CacheView{viewId=1, members=[win-1-61839]} for cache test-cache

                  2012-01-12 10:26:56,180 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 1 on node: win-1-61839. Before start, data container had 0 entries

                  2012-01-12 10:26:56,180 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new write commands for cache view 1

                  2012-01-12 10:26:56,180 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.cacheviews.CacheViewsManagerImpl] test-cache: Committing cache view 1

                  2012-01-12 10:26:56,180 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking write commands for cache view 1

                  2012-01-12 10:26:56,180 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.statetransfer.BaseStateTransferTask] Node win-1-61839 completed state transfer for view 1 in 0 milliseconds!

                  2012-01-12 10:26:56,180 DEBUG (CacheViewInstaller-1,win-1-61839) [org.infinispan.cacheviews.CacheViewsManagerImpl] Successfully installed view CacheView{viewId=1, members=[win-1-61839]} for cache test-cache

                  2012-01-12 10:26:56,180 DEBUG (InfinispanServer-Main) [org.infinispan.CacheImpl] Started cache test-cache on win-1-61839

                   

                   

                  UNIX log

                   

                  2012-01-12 10:02:44,768 DEBUG (InfinispanServer-Main) [org.jgroups.stack.Configurator] set property TCP.diagnostics_addr to default value /224.0.75.75

                  2012-01-12 10:02:44,825 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.FRAG2] received CONFIG event: {bind_addr=/xx.xxx.xx.xxx}

                  2012-01-12 10:02:44,827 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.MPING] bind_addr=/xx.xxx.xx.xxx mcast_addr=/228.6.7.8, mcast_port=46655

                  2012-01-12 10:02:44,884 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.GMS] address=linux-1-62807, cluster=test-infinispan-cluster, physical address=xx.xxx.xx.xxx:7800

                  2012-01-12 10:02:44,908 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.NAKACK]

                  [setDigest()]

                  existing digest:  []

                  new digest:       linux-1-62807: [0 (0)]

                  resulting digest: linux-1-62807: [0 (0)]

                  2012-01-12 10:02:44,908 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.GMS] linux-1-62807: view is [linux-1-62807|0] [linux-1-62807]

                  2012-01-12 10:02:44,909 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection

                  2012-01-12 10:02:44,910 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.FD_SOCK] VIEW_CHANGE received: [linux-1-62807]

                  2012-01-12 10:02:44,969 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 400KB (1 members)

                  2012-01-12 10:02:44,971 DEBUG (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [linux-1-62807|0] [linux-1-62807]

                  2012-01-12 10:02:44,971 INFO  (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [linux-1-62807|0] [linux-1-62807]

                  2012-01-12 10:02:44,972 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection

                  2012-01-12 10:02:44,972 DEBUG (InfinispanServer-Main) [org.jgroups.protocols.pbcast.GMS] created group (first member). My view is [linux-1-62807|0], impl is org.jgroups.protocols.pbcast.CoordGmsImpl

                  2012-01-12 10:02:45,030 INFO  (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000079: Cache local address is linux-1-62807, physical addresses are [xx.xxx.xx.xxx:7800]

                  2012-01-12 10:02:45,030 DEBUG (InfinispanServer-Main) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] Waiting on view being accepted

                  2012-01-12 10:02:45,047 DEBUG (InfinispanServer-Main) [org.infinispan.transaction.TransactionTable] Min view id set to 0

                  2012-01-12 10:02:45,051 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 7

                  2012-01-12 10:02:45,052 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is:

                          >> org.infinispan.interceptors.InvocationContextInterceptor

                          >> org.infinispan.interceptors.StateTransferLockInterceptor

                          >> org.infinispan.interceptors.NotificationInterceptor

                          >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor

                          >> org.infinispan.interceptors.EntryWrappingInterceptor

                          >> org.infinispan.interceptors.ReplicationInterceptor

                          >> org.infinispan.interceptors.CallInterceptor

                  2012-01-12 10:02:45,056 DEBUG (InfinispanServer-Main) [org.infinispan.cacheviews.CacheViewsManagerImpl] ___hotRodTopologyCache: Node linux-1-62807 is joining

                  2012-01-12 10:02:45,058 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.cacheviews.CacheViewsManagerImpl] Installing new view CacheView{viewId=1, members=[linux-1-62807]} for cache ___hotRodTopologyCache

                  2012-01-12 10:02:45,134 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.ReplicatedStateTransferTask] Commencing state transfer 1 on node: linux-1-62807. Before start, data container had 0 entries

                  2012-01-12 10:02:45,134 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new write commands for cache view 1

                  2012-01-12 10:02:45,324 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.cacheviews.CacheViewsManagerImpl] ___hotRodTopologyCache: Committing cache view 1

                  2012-01-12 10:02:45,325 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking write commands for cache view 1

                  2012-01-12 10:02:45,325 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.BaseStateTransferTask] Node linux-1-62807 completed state transfer for view 1 in 191 milliseconds!

                  2012-01-12 10:02:45,325 DEBUG (InfinispanServer-Main) [org.infinispan.CacheImpl] Started cache ___hotRodTopologyCache on linux-1-62807

                  2012-01-12 10:02:45,325 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.cacheviews.CacheViewsManagerImpl] Successfully installed view CacheView{viewId=1, members=[linux-1-62807]} for cache ___hotRodTopologyCache

                  2012-01-12 10:02:45,467 DEBUG (InfinispanServer-Main) [org.infinispan.server.hotrod.HotRodServer] Map linux-1-62807 cluster address with xx.xxx.xx.xxx:11222 server endpoint in address cache

                  2012-01-12 10:02:45,472 DEBUG (InfinispanServer-Main) [org.infinispan.remoting.rpc.RpcManagerImpl] We're the only member in the cluster; Don't invoke remotely.

                  2012-01-12 10:02:45,474 DEBUG (InfinispanServer-Main) [org.infinispan.server.hotrod.HotRodServer] Starting server with basic settings: host=xx.xxx.xx.xxx, port=11222, masterThreads=-1, workerThreads=40, idleTimeout=-1, tcpNoDelay=true, sendBufSize=0, recvBufSize=0

                  2012-01-12 10:02:45,478 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 5

                  2012-01-12 10:02:45,478 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is:

                          >> org.infinispan.interceptors.InvocationContextInterceptor

                          >> org.infinispan.interceptors.NotificationInterceptor

                          >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor

                          >> org.infinispan.interceptors.EntryWrappingInterceptor

                          >> org.infinispan.interceptors.CallInterceptor

                  2012-01-12 10:02:45,478 DEBUG (InfinispanServer-Main) [org.infinispan.CacheImpl] Started cache ___defaultcache on linux-1-62807

                  2012-01-12 10:02:45,510 DEBUG (InfinispanServer-Main) [org.infinispan.transaction.TransactionTable] Min view id set to 0

                  2012-01-12 10:02:45,510 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 8

                  2012-01-12 10:02:45,510 DEBUG (InfinispanServer-Main) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is:

                          >> org.infinispan.interceptors.InvocationContextInterceptor

                          >> org.infinispan.interceptors.CacheMgmtInterceptor

                          >> org.infinispan.interceptors.StateTransferLockInterceptor

                          >> org.infinispan.interceptors.NotificationInterceptor

                          >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor

                          >> org.infinispan.interceptors.EntryWrappingInterceptor

                          >> org.infinispan.interceptors.DistributionInterceptor

                          >> org.infinispan.interceptors.CallInterceptor

                  2012-01-12 10:02:45,520 DEBUG (InfinispanServer-Main) [org.infinispan.cacheviews.CacheViewsManagerImpl] test-cache: Node linux-1-62807 is joining

                  2012-01-12 10:02:45,521 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.cacheviews.CacheViewsManagerImpl] Installing new view CacheView{viewId=1, members=[linux-1-62807]} for cache test-cache

                  2012-01-12 10:02:45,523 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 1 on node: linux-1-62807. Before start, data container had 0 entries

                  2012-01-12 10:02:45,523 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new write commands for cache view 1

                  2012-01-12 10:02:45,524 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.cacheviews.CacheViewsManagerImpl] test-cache: Committing cache view 1

                  2012-01-12 10:02:45,525 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking write commands for cache view 1

                  2012-01-12 10:02:45,526 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.statetransfer.BaseStateTransferTask] Node linux-1-62807 completed state transfer for view 1 in 3 milliseconds!

                  2012-01-12 10:02:45,526 DEBUG (CacheViewInstaller-1,linux-1-62807) [org.infinispan.cacheviews.CacheViewsManagerImpl] Successfully installed view CacheView{viewId=1, members=[linux-1-62807]} for cache test-cache

                  2012-01-12 10:02:45,526 DEBUG (InfinispanServer-Main) [org.infinispan.CacheImpl] Started cache test-cache on linux-1-62807

                   

                   

                   

                  Your help is greatly appreciated.  Thanks