1 Reply Latest reply on Feb 26, 2015 11:08 AM by rvansa

    cluster synchronization is being messed up

    zeituni

      Hi,

      I have installed the infinispan 7.0.2 final, and I am using 2 different instances of infinispan clusters.

      They need to be separated, and to synchronize with another server. However, although they are configured differently, they still gets synchronized between them: I put a record into one instance, and see it on the other instance as well. They are not configured on the same port, nor on the same name. The only thing in common is the IP.

      Here is the tcp.xml:

      Instance 1:

      <config xmlns="urn:org:jgroups" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:org:jgroups http://www.jgroups.org/schema/JGroups-3.0.xsd">
          <TCP bind_port="40000" bind_addr="${bind.address}" loopback="false" discard_incompatible_packets="true" use_send_queues="true" sock_conn_timeout="300" conn_expire_time="1800000" timer_type="new" timer.min_threads="4" timer.max_threads="30" timer.keep_alive_time="3000" timer.queue_max_size="500" thread_pool.enabled="true" thread_pool.min_threads="1" thread_pool.max_threads="30" thread_pool.keep_alive_time="5000" thread_pool.queue_enabled="false" thread_pool.queue_max_size="100" thread_pool.rejection_policy="discard" oob_thread_pool.enabled="true" oob_thread_pool.min_threads="1" oob_thread_pool.max_threads="8" oob_thread_pool.keep_alive_time="5000" oob_thread_pool.queue_enabled="false" oob_thread_pool.queue_max_size="100" oob_thread_pool.rejection_policy="discard"/>
      
      
          <TCPPING timeout="2000" initial_hosts="${active.storage.bind.address}[40000],${passive.storage.bind.address}[40000]" port_range="2" num_initial_members="3"/>
          <MERGE2 min_interval="10000" max_interval="20000"/>
          <FD_SOCK/>
          <FD timeout="3000" max_tries="3"/>
          <VERIFY_SUSPECT timeout="1500"/>
          <BARRIER/>
          <pbcast.NAKACK use_mcast_xmit="false" exponential_backoff="500" discard_delivered_msgs="true"/>
          <UNICAST/>
          <pbcast.STABLE stability_delay="1000" desired_avg_gossip="50000" max_bytes="4M"/>
          <pbcast.GMS print_local_addr="true" join_timeout="3000" view_bundling="true"/>
          <UFC max_credits="4M" max_block_time="1000" min_threshold="0.4"/>
          <MFC max_credits="2M" min_threshold="0.4"/>
          <FRAG2 frag_size="8192"/>
          <pbcast.STATE/>
      </config>
      

       

      Instance 2:

      <config xmlns="urn:org:jgroups" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:org:jgroups http://www.jgroups.org/schema/JGroups-3.0.xsd">
          <TCP bind_port="20000" bind_addr="${bind.address}" loopback="false" discard_incompatible_packets="true" use_send_queues="true" sock_conn_timeout="300" conn_expire_time="1800000" timer_type="new" timer.min_threads="4" timer.max_threads="30" timer.keep_alive_time="3000" timer.queue_max_size="500" thread_pool.enabled="true" thread_pool.min_threads="1" thread_pool.max_threads="30" thread_pool.keep_alive_time="5000" thread_pool.queue_enabled="false" thread_pool.queue_max_size="100" thread_pool.rejection_policy="discard" oob_thread_pool.enabled="true" oob_thread_pool.min_threads="1" oob_thread_pool.max_threads="8" oob_thread_pool.keep_alive_time="5000" oob_thread_pool.queue_enabled="false" oob_thread_pool.queue_max_size="100" oob_thread_pool.rejection_policy="discard"/>
      
      
          <TCPPING timeout="2000" initial_hosts="${active.storage.bind.address}[20000],${passive.storage.bind.address}[20000]" port_range="2" num_initial_members="3"/>
          <MERGE2 min_interval="10000" max_interval="20000"/>
          <FD_SOCK/>
          <FD timeout="3000" max_tries="3"/>
          <VERIFY_SUSPECT timeout="1500"/>
          <BARRIER/>
          <pbcast.NAKACK use_mcast_xmit="false" exponential_backoff="500" discard_delivered_msgs="true"/>
          <UNICAST/>
          <pbcast.STABLE stability_delay="1000" desired_avg_gossip="50000" max_bytes="4M"/>
          <pbcast.GMS print_local_addr="true" join_timeout="3000" view_bundling="true"/>
          <UFC max_credits="4M" max_block_time="1000" min_threshold="0.4"/>
          <MFC max_credits="2M" min_threshold="0.4"/>
          <FRAG2 frag_size="8192"/>
          <pbcast.STATE/>
      </config>
      

       

      This is what I see in the startup log:

      ------------------------------------------------------------------- GMS: address=CH55-SL01-WMR-47798, cluster=SessionInformationCacheStorage2, physical address=192.168.65.1:40000 ------------------------------------------------------------------- 2015-02-26 17:33:26,064 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view for channel SessionInformationCacheStorage2: [CH55-SL01-WMR-47798|0] (1) [CH55-SL01-WMR-47798] 2015-02-26 17:33:26,068 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000079: Channel SessionInformationCacheStorage2 local address is CH55-SL01-WMR-47798, physical addresses are [192.168.65.1:40000] 2015-02-26 17:33:26,074 INFO  [org.infinispan.factories.GlobalComponentRegistry] ISPN000128: Infinispan version: Infinispan 'Guinness' 7.0.2.Final

       

      and the other:

      ------------------------------------------------------------------- GMS: address=CH55-SL01-WMR-10255, cluster=SessionInformationCacheStorage, physical address=192.168.65.1:20000 ------------------------------------------------------------------- 2015-02-26 17:18:47,175 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view for channel SessionInformationCacheStorage: [CH55-SL01-WMR-10255|0] (1) [CH55-SL01-WMR-10255] 2015-02-26 17:18:47,180 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000079: Channel SessionInformationCacheStorage local address is CH55-SL01-WMR-10255, physical addresses are [192.168.65.1:20000]

       

      Can anyone tell me what I am doing wrong? why are they synchronizing between them??

      Thanks!

      Uri

        • 1. Re: cluster synchronization is being messed up
          rvansa

          There is no trace of those nodes clustering together in the log excerpts you've posted. The configuration is technically correct, though very, very outdated - checkout recent default JGroups configurations in Infinispan; e.g. you should be using MERGE3, UNICAST3, NAKACK2 and BARRIER is not necessary anymore.