4 Replies Latest reply on Jun 17, 2009 7:16 AM by chtimi2

    Completely confused by client failover

      First i will explain my use case so that you can get a general sense of what i'm trying to do:

      1/ Use case
      I have a clustered JBoss 5.1.0 ear application (with default JBM so 1.4?).
      A Swing application is connected to both nodes and receives JMS notifications via a ClusteredXAConnectionFactory. When one of of the nodes fails, the other detects the change in topology and posts a "LostNode" message on a topic which the client listens to.

      2/ Problem
      The failover sometimes works, sometimes not (maybe depending on which node the connection was last pointing to?)

      3/ Things i'm confused about:
      * The FailoverOnNodeLeave attribute in oracle-persistence-service.xml. From what i read it forces same failover on Ctrl-C as on brutal kill-9 or crash?

      * Do i have to do anything in the client (interceptor, exception listener,...)? I'm getting mixed messages, so is the failover transparent or not? If it's not, what do i need to do (the connection is injected via Spring if it makes any difference)

      * Does specifying ClusteredXAConnectionFactory/ClusteredConnectionFactory/others in the client make any difference? I don't see what XA or not would change for a remote client but i could be horribly wrong?

      Any examples of a transparently reconnecting client? I see only xml files in the JBoss messaging examples directory?

        • 1. Re: Completely confused by client failover
          gaohoward

           


          2/ Problem
          The failover sometimes works, sometimes not (maybe depending on which node the connection was last pointing to?)


          Did you have any error log when the failover not happening?


          3/ Things i'm confused about:
          * The FailoverOnNodeLeave attribute in oracle-persistence-service.xml. From what i read it forces same failover on Ctrl-C as on brutal kill-9 or crash?


          yes, it will force a failover on a normal node shutdown.


          * Do i have to do anything in the client (interceptor, exception listener,...)? I'm getting mixed messages, so is the failover transparent or not? If it's not, what do i need to do (the connection is injected via Spring if it makes any difference)


          the client failover is transparent.


          * Does specifying ClusteredXAConnectionFactory/ClusteredConnectionFactory/others in the client make any difference? I don't see what XA or not would change for a remote client but i could be horribly wrong?


          No difference. You can cast the reference to a XAConnectionFactory or ConnectionFactory based on your need.


          Any examples of a transparently reconnecting client? I see only xml files in the JBoss messaging examples directory?


          The examples for the moment you need to get from svn:
          http://anonsvn.jboss.org/repos/messaging/tags/JBossMessaging_1_4_3_GA/


          • 2. Re: Completely confused by client failover

            Thanks for all the answers, it leaves us with just the failover failure then :)
            Meanwhile i'm going to checkout the examples.

            "gaohoward" wrote:

            Did you have any error log when the failover not happening?


            No, no error stack anywhere. Here is a more precise test, where
            -both server nodes are initially completely started
            -the client is then started
            -one of the nodes is killed

            Observed behaviour:
            1/ If the node killed is NOT the node where the topic subscription was pointing to:
            No failover required, the message is always received by the client

            2/ The node killed IS the node where the topic subscription was pointing to:
            Failover required, the message is received by the client about half the time.
            Even when the client isn't notified, the MDB that listens to that same topic ALWAYS receives the message (so it is sent correctly).
            No stack whatsoever (in particular no "JMSException:closed connection" in the client which DOES happen if in the server failoverOnNodeLeave=false)


            Remarks that might help:
            -i have ClusteredConnectionFactoryName in messaging-service.xml commented out
            -i receive JBM warnings which might be related?
            WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client 3j011-7h2pwj-fw0ewfv0-1-fw0ezfni-nc, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All associated connection resources will be cleaned up.


            Here is the server stack of the remaining node, in the failure case:
            8:11,225 INFO [STDOUT] [org.jboss.cache.RPCManagerImpl][Incoming-7,192.168.0.1:40045] - Received new cluster view: [10.27.252.164:41988|2] [192.168.0.1:40045]
            11:58:16,559 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.MoteurAlarmesCentre][Incoming-19,192.168.0.1:40045] - isNotificationEnabled/START
            11:58:16,566 INFO [ControleurLocalTachesEgoistes] PAS DE USERDATA
            11:58:16,583 INFO [ControleurLocalTachesEgoistes] PAS DE USERDATA
            11:58:16,653 INFO [MembershipListenerHAS] getCluster/partitionName: P_CLA1
            11:58:16,795 INFO [RPCManagerImpl] Received new cluster view: [10.27.252.164:41988|2] [192.168.0.1:40045]
            11:58:16,822 INFO [P_CLA1] New cluster view for partition P_CLA1 (id: 2, delta: -1) : [192.168.0.1:1099]
            11:58:16,825 INFO [P_CLA1] I am (192.168.0.1:1099) received membershipChanged event:
            11:58:16,825 INFO [P_CLA1] Dead members: 1 ([10.27.252.164:1099])
            11:58:16,825 INFO [P_CLA1] New Members : 0 ([])
            11:58:16,825 INFO [P_CLA1] All Members : 1 ([192.168.0.1:1099])
            11:58:16,843 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - membershipChanged/DEBUT [ deadMembers=[10.27.252.164:1099] , newMembers=[] , allMembers=[192.168.0.1:1099] ]
            11:58:16,843 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - membershipChanged [ deadMembers=[10.27.252.164:1099] , newMembers=[] , allMembers=[192.168.0.1:1099] ]
            11:58:16,843 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - membershipChanged/this: com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes$TachesEgoistesMembershipListener@1d496c7
            11:58:16,844 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - membershipChanged/ControleurCentralTachesEgoistes.this: com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes@1f6f638
            11:58:16,847 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - TopologieChangeEvent [ nbDead=1 , nbNew=0 , nbAll=1 ]
             dead: NoeudCluster[10.27.252.164:41988]
             all: NoeudCluster[192.168.0.1:40045]
            11:58:17,842 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - trouveTachesEgoistes/egoistes: EnsembleDesTachesEgoistes [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE , NAVINEO.SA:service=ActivationVersions , NAVINEO.HORA:service=MoteurAlarmesSite , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE } ]
            11:58:17,842 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - EnsembleDesTachesEgoistes [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE , NAVINEO.SA:service=ActivationVersions , NAVINEO.HORA:service=MoteurAlarmesSite , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE } ]
            11:58:17,843 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][AsynchViewChangeHandler Thread] - getRegistreHashMap
            11:58:17,844 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][AsynchViewChangeHandler Thread] - registre: {NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE=[Ljava.lang.Object;@110b276, NAVINEO.SA:service=ComEmbarques=[Ljava.lang.Object;@134a226, NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE=[Ljava.lang.Object;@817dd2, NAVINEO.SA:service=ActivationVersions=[Ljava.lang.Object;@16b6954, NAVINEO.HORA:service=MoteurAlarmesSite=[Ljava.lang.Object;@d019e9, NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE=[Ljava.lang.Object;@55334a}
            11:58:17,844 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][AsynchViewChangeHandler Thread] - size: 6
            11:58:17,848 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - prendreEnCompte
            11:58:17,848 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - topologieEvent: TopologieChangeEvent [ nbDead=1 , nbNew=0 , nbAll=1 ]
             dead: NoeudCluster[10.27.252.164:41988]
             all: NoeudCluster[192.168.0.1:40045]
            11:58:17,848 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - tachesDefinies: EnsembleDesTachesEgoistes [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE , NAVINEO.SA:service=ActivationVersions , NAVINEO.HORA:service=MoteurAlarmesSite , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE } ]
            11:58:17,849 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - repartitionActuelle: MapTachesEgoistesImpl [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ActivationVersions --> NoeudCluster[10.27.252.164:41988] , NAVINEO.HORA:service=MoteurAlarmesSite --> NoeudCluster[10.27.252.164:41988] , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE --> NoeudCluster[10.27.252.164:41988] } ]
            11:58:17,851 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - strategie: com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique@658cd3
            11:58:17,854 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - transitionRepartitionCouranteVersSouhaitee/START
            11:58:17,854 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - repartitionActuelle: MapTachesEgoistesImpl [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ActivationVersions --> NoeudCluster[10.27.252.164:41988] , NAVINEO.HORA:service=MoteurAlarmesSite --> NoeudCluster[10.27.252.164:41988] , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE --> NoeudCluster[10.27.252.164:41988] } ]
            11:58:17,854 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - tachesDefinies: EnsembleDesTachesEgoistes [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE , NAVINEO.SA:service=ActivationVersions , NAVINEO.HORA:service=MoteurAlarmesSite , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE } ]
            11:58:17,855 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - topologieEvent: TopologieChangeEvent [ nbDead=1 , nbNew=0 , nbAll=1 ]
             dead: NoeudCluster[10.27.252.164:41988]
             all: NoeudCluster[192.168.0.1:40045]
            11:58:17,856 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - redemarreLesTachesQuiEtaientSurUnNoeudMortDepuis/START
            11:58:17,856 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - tachesPresentesSurAucunDesNoeuds
            11:58:17,856 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - map.size(): 6
            11:58:17,857 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.SA:service=ComEmbarques
            11:58:17,857 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE
            11:58:17,857 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE
            11:58:17,857 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.SA:service=ActivationVersions
            11:58:17,857 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.HORA:service=MoteurAlarmesSite
            11:58:17,857 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE
            11:58:17,857 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ret.size(): 0
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - tachesPresentesSurAucunDesNoeuds: 0
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - tachesPresentesSurUnDesNoeuds/deadMembers: 1
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - map.size(): 6
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - dead: NoeudCluster[10.27.252.164:41988]
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.SA:service=ComEmbarques
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[192.168.0.1:40045]
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE
            11:58:17,858 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[192.168.0.1:40045]
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[192.168.0.1:40045]
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.SA:service=ActivationVersions
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[10.27.252.164:41988]
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ADD
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.HORA:service=MoteurAlarmesSite
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[10.27.252.164:41988]
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ADD
            11:58:17,859 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[10.27.252.164:41988]
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ADD
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ret.size(): 3
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - tachesQuiEtaientSurUnNoeudMortDepuis: 3
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - tachesEnDesherence: 3
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - getNbDeTachesADemarrerJusquaEgalisationDeLaCharge
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - inverser_ajouterNoeudsSansTaches_retirerNoeudsMorts/deadMembers: 1
            11:58:17,860 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - copieDefensive AVANT enleverNoeuds: MapTachesEgoistesImpl [ size=6 , egoistes= { NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ComEmbarques --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ActivationVersions --> NoeudCluster[10.27.252.164:41988] , NAVINEO.HORA:service=MoteurAlarmesSite --> NoeudCluster[10.27.252.164:41988] , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE --> NoeudCluster[10.27.252.164:41988] } ]
            11:58:17,872 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - enleverNoeuds/deadMembers: 1
            11:58:17,872 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - tachesPresentesSurUnDesNoeuds/deadMembers: 1
            11:58:17,872 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - map.size(): 6
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - dead: NoeudCluster[10.27.252.164:41988]
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[192.168.0.1:40045]
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.SA:service=ComEmbarques
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[192.168.0.1:40045]
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[192.168.0.1:40045]
            11:58:17,873 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.SA:service=ActivationVersions
            11:58:17,874 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[10.27.252.164:41988]
            11:58:17,874 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ADD
            11:58:17,874 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.HORA:service=MoteurAlarmesSite
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[10.27.252.164:41988]
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ADD
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getKey: NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - entry.getValue: NoeudCluster[10.27.252.164:41988]
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ADD
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - ret.size(): 3
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - enleverNoeuds/tachesPresentesSurUnDesNoeuds: 3
            11:58:17,875 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.SA:service=ActivationVersions
            11:58:17,876 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.HORA:service=MoteurAlarmesSite
            11:58:17,876 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - next: NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE
            11:58:17,876 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.direct.MapTachesEgoistesImpl][AsynchViewChangeHandler Thread] - copieDefensive APRES enleverNoeuds: MapTachesEgoistesImpl [ size=3 , egoistes= { NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ComEmbarques --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] } ]
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - copieDefensive Inversee: 1
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - ntMax: 3
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - somme DEBUT: 0
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - tachesDuNoeudCourant: 3
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - delta: 0
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - somme AVANT +=: 0
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - somme APRES +=: 0
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - somme FIN: 0
            11:58:17,882 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - sequenceNoeudsPourHomogeneisationCharge [ nbDeTachesADemarrerJusquaEgalisationDeLaCharge=0 , chargeMax=3 ]
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - parChargeCroissante: 1
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - next: NoeudCluster[192.168.0.1:40045]
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - AVANT calcul liste
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.inverse.MapTachesEgoistesInverseeImpl][AsynchViewChangeHandler Thread] - seq: 0
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - choixDesNoeudsPourHomogeneiserLaCharge: 0
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - APRES HOMOGENEISATION[]
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - APRES ROUND ROBIN: [NoeudCluster[192.168.0.1:40045], NoeudCluster[192.168.0.1:40045], NoeudCluster[192.168.0.1:40045]]
            11:58:17,883 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - tache: NAVINEO.SA:service=ActivationVersions
            11:58:17,884 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - noeudChoisi: NoeudCluster[192.168.0.1:40045]
            11:58:17,884 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - redemarre: StartService [ tache=NAVINEO.SA:service=ActivationVersions , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:17,937 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - tache: NAVINEO.HORA:service=MoteurAlarmesSite
            11:58:17,937 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - noeudChoisi: NoeudCluster[192.168.0.1:40045]
            11:58:17,937 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - redemarre: StartService [ tache=NAVINEO.HORA:service=MoteurAlarmesSite , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            
            11:58:17,937 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - tache: NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE
            11:58:17,937 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - noeudChoisi: NoeudCluster[192.168.0.1:40045]
            11:58:17,938 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - redemarre: StartService [ tache=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:17,938 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - redemarreLesTachesQuiEtaientSurUnNoeudMortDepuis/END
            11:58:17,938 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - transitionRepartitionCouranteVersSouhaitee/APRES redemarreLesTachesEnDesherence
            11:58:17,938 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.strategierepartition.StrategieRepartitionTachesEgoistesBasique][AsynchViewChangeHandler Thread] - seq: SequenceCommandesRepartition [ size=3 , cmds= { StartService [ tache=NAVINEO.SA:service=ActivationVersions , noeudChoisi=NoeudCluster[192.168.0.1:40045] ] , StartService [ tache=NAVINEO.HORA:service=MoteurAlarmesSite , noeudChoisi=NoeudCluster[192.168.0.1:40045] ] , StartService [ tache=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , noeudChoisi=NoeudCluster[192.168.0.1:40045] ] } ]
            11:58:17,938 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - seq: SequenceCommandesRepartition [ size=3 , cmds= { StartService [ tache=NAVINEO.SA:service=ActivationVersions , noeudChoisi=NoeudCluster[192.168.0.1:40045] ] , StartService [ tache=NAVINEO.HORA:service=MoteurAlarmesSite , noeudChoisi=NoeudCluster[192.168.0.1:40045] ] , StartService [ tache=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , noeudChoisi=NoeudCluster[192.168.0.1:40045] ] } ]
            11:58:17,953 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - _______envoyerNotificationNoeudsPerdus [ deadMembers=[10.27.252.164:1099] + ]
            11:58:17,954 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerGlobalement
            11:58:17,955 INFO [ControleurLocalTachesEgoistes] BasculeTachesEgoistesHANB$NotificationListener/handleNotification
            11:58:17,955 INFO [ControleurLocalTachesEgoistes] userData: [Ljava.io.Serializable;@162cd3d
            11:58:17,955 INFO [ControleurLocalTachesEgoistes] handback: null
            11:58:17,955 INFO [ControleurLocalTachesEgoistes] AVANT cmd.executerLocalement/cmd: StartService [ tache=NAVINEO.SA:service=ActivationVersions , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:17,955 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement?
            11:58:17,955 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement!
            11:58:17,955 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud [ tache=NAVINEO.SA:service=ActivationVersions , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:17,955 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud/AVANT invoke
            11:58:17,956 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud/APRES invoke
            11:58:17,956 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop [ tache=NAVINEO.SA:service=ActivationVersions , targetMethodName=demarrer ]
            11:58:17,956 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop/AVANT invoke
            11:58:17,956 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.ActivationVersions][pool-21-thread-1] - DEBUT demarrer
            11:58:17,956 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.ActivationVersions][pool-21-thread-1] - doDemarrerTacheEgoiste/DEBUT
            11:58:17,978 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.ActivationVersions][pool-21-thread-1] - doDemarrerTacheEgoiste/MILIEU
            11:58:17,987 INFO [STDOUT] [SA.ejb.RfmFacade][pool-21-thread-1] - Appel de initTimerActivation
            11:58:18,042 WARN [InterceptorsFactory] EJBTHREE-1246: Do not use InterceptorsFactory with a ManagedObjectAdvisor, InterceptorRegistry should be used via the bean container
            11:58:18,043 WARN [InterceptorsFactory] EJBTHREE-1246: Do not use InterceptorsFactory with a ManagedObjectAdvisor, InterceptorRegistry should be used via the bean container
            11:58:18,044 INFO [STDOUT] [SA.ejb.NoeudsPerdusFacade][AsynchViewChangeHandler Thread] - _______sendMessageToNoeudsPerdusDestination/START [ msg=NoeudsPerdusEvent [ deadMembers=[10.27.252.164:1099] ] ]
            11:58:18,171 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.ActivationVersions][pool-21-thread-1] - doDemarrerTacheEgoiste/FIN
            11:58:18,171 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.ActivationVersions][pool-21-thread-1] - MILIEU demarrer
            11:58:18,171 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.ActivationVersions][pool-21-thread-1] - FIN demarrer
            11:58:18,172 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop/APRES invoke
            11:58:18,172 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement!/FIN
            11:58:18,172 INFO [ControleurLocalTachesEgoistes] APRES cmd.executerLocalement/cmd: StartService [ tache=NAVINEO.SA:service=ActivationVersions , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:18,173 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerGlobalement
            11:58:18,173 INFO [ControleurLocalTachesEgoistes] BasculeTachesEgoistesHANB$NotificationListener/handleNotification
            11:58:18,173 INFO [ControleurLocalTachesEgoistes] userData: [Ljava.io.Serializable;@99de3
            11:58:18,173 INFO [ControleurLocalTachesEgoistes] handback: null
            11:58:18,173 INFO [ControleurLocalTachesEgoistes] AVANT cmd.executerLocalement/cmd: StartService [ tache=NAVINEO.HORA:service=MoteurAlarmesSite , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:18,173 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement?
            11:58:18,173 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement!
            11:58:18,173 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud [ tache=NAVINEO.HORA:service=MoteurAlarmesSite , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:18,173 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud/AVANT invoke
            11:58:18,174 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud/APRES invoke
            11:58:18,174 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop [ tache=NAVINEO.HORA:service=MoteurAlarmesSite , targetMethodName=demarrer ]
            11:58:18,174 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop/AVANT invoke
            11:58:18,174 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.MoteurAlarmesSite][pool-21-thread-1] - DEBUT demarrer
            11:58:18,226 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.MoteurAlarmesSite][pool-21-thread-1] - doDemarrerTacheEgoiste/libelleCe: null
            11:58:18,390 INFO [STDOUT] AbstractMDP/setClient/task: com.navineo.sa.ejb.session.jms.ReceptionJMSFutureTask@1d5e97e
            11:58:18,390 INFO [STDOUT] [com.navineo.sa.alarmes.runtime.RuntimeAlarmesSS][pool-21-thread-1] - creerJeuDeTestMetadonnees/DEBUT
            11:58:18,497 INFO [STDOUT] [com.navineo.sa.alarmes.runtime.RuntimeAlarmesSS][pool-21-thread-1] - creerJeuDeTestMetadonnees/FIN
            11:58:21,255 INFO [STDOUT] [SA.ejb.NoeudsPerdusFacade][AsynchViewChangeHandler Thread] - _______sendMessageToNoeudsPerdusDestination/END [ msg=NoeudsPerdusEvent [ deadMembers=[10.27.252.164:1099] ] ]
            11:58:21,410 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.controleur.ControleurCentralTachesEgoistes][AsynchViewChangeHandler Thread] - membershipChanged/FIN
            11:58:21,411 INFO [GroupMember] org.jboss.messaging.core.impl.postoffice.GroupMember$ControlMembershipListener@6ef280 got new view [10.27.252.164:41988|2] [192.168.0.1:40045], old view is [10.27.252.164:41988|1] [10.27.252.164:41988, 192.168.0.1:40045]
            11:58:21,411 INFO [GroupMember] I am (192.168.0.1:40045)
            11:58:21,412 INFO [MessagingPostOffice] JBoss Messaging is failing over for failed node 1. If there are many messages to reload this may take some time...
            11:58:21,481 INFO [MessagingPostOffice] JBoss Messaging failover completed
            11:58:21,482 INFO [GroupMember] Dead members: 1 ([10.27.252.164:41988])
            11:58:21,482 INFO [GroupMember] All Members : 1 ([192.168.0.1:40045])
            11:58:21,505 WARN [InterceptorsFactory] EJBTHREE-1246: Do not use InterceptorsFactory with a ManagedObjectAdvisor, InterceptorRegistry should be used via the bean container
            11:58:21,505 WARN [InterceptorsFactory] EJBTHREE-1246: Do not use InterceptorsFactory with a ManagedObjectAdvisor, InterceptorRegistry should be used via the bean container
            11:58:21,506 INFO [STDOUT] [SA.ejb.NoeudsPerdusMDB][WorkManager(2)-11] - onMessage [ message=delegator->JBossMessage[56429274018955264]:NON-PERSISTENT, deliveryId=0 ]
            11:58:21,507 INFO [STDOUT] [SA.ejb.NoeudsPerdusMDB][WorkManager(2)-11] - onMessage/o:NoeudsPerdusEvent [ deadMembers=[10.27.252.164:1099] ]
            11:58:21,667 INFO [STDOUT] [com.navineo.sa.alarmes.common.filter.charge.ChargeurAlarmes][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.common.filter.charge.ChargeurAlarmes@baaa0f
            11:58:21,667 INFO [STDOUT] [com.navineo.sa.alarmes.evt.bp.filter.routeur.bp.RouteurPCEMB][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.bp.filter.routeur.bp.RouteurPCEMB@f2bf28
            11:58:21,667 INFO [STDOUT] [com.navineo.sa.alarmes.evt.bp.filter.routeur.bp.RouteurBP][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.bp.filter.routeur.bp.RouteurBP@e40bcb
            11:58:21,667 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.filtretemporel.FiltreTemporel][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.b.filter.filtretemporel.FiltreTemporel@1c2461d
            11:58:21,667 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.filtredependance.FiltreDependances][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.b.filter.filtredependance.FiltreDependances@189378b
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.chaine.ChaineB][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.b.filter.chaine.ChaineB@19d8776
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.evt.bp.filter.chaine.ChainePC][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.bp.filter.chaine.ChainePC@12880ea
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.evt.bp.filter.routeur.bp.RouteurBP][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.bp.filter.routeur.bp.RouteurBP@2796bb
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.evt.bp.filter.chaine.ChaineEMB][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evt.bp.filter.chaine.ChaineEMB@118fa26
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.evtoccal.filter.inst.p.InstantiateurP][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evtoccal.filter.inst.p.InstantiateurP@cf0fd2
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.evtoccal.filter.inst.b.InstantiateurB][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evtoccal.filter.inst.b.InstantiateurB@17dbcd
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.evtoccal.filter.enrich.Enrichisseur][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.evtoccal.filter.enrich.Enrichisseur@5f76f5
            11:58:21,668 INFO [STDOUT] [com.navineo.sa.alarmes.common.filter.tripleur.Tripleur][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.common.filter.tripleur.Tripleur@17aefd7
            11:58:21,669 INFO [STDOUT] [com.navineo.sa.alarmes.occal.filter.persister.PersisterOccal][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.occal.filter.persister.PersisterOccal@182ac3
            11:58:21,671 INFO [STDOUT] [com.navineo.sa.alarmes.occal.filter.recueil.RecueilleurOccal][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.occal.filter.recueil.RecueilleurOccal@9f6a4e
            11:58:21,671 INFO [STDOUT] [com.navineo.sa.alarmes.occal.filter.notifier.NotifierOccal][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.occal.filter.notifier.NotifierOccal@1fc4f35
            11:58:21,671 INFO [STDOUT] [com.navineo.sa.alarmes.occal.filter.chaine.ChaineConsommationOccal][pool-21-thread-1] - Creation port entree async pour this: com.navineo.sa.alarmes.occal.filter.chaine.ChaineConsommationOccal@1b44371
            11:58:21,671 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.chaine.ChaineB][pool-21-thread-1] - nbEnfantsPolleurs/START
            11:58:21,671 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.chaine.ChaineB][pool-21-thread-1] - nbEnfantsPolleurs AVANT=1
            11:58:21,672 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.chaine.ChaineB][pool-21-thread-1] - nbEnfantsPolleurs+=2
            11:58:21,672 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.chaine.ChaineB][pool-21-thread-1] - nbEnfantsPolleurs+=1
            11:58:21,677 INFO [STDOUT] [com.navineo.sa.alarmes.evt.b.filter.chaine.ChaineB][pool-21-thread-1] - nbEnfantsPolleurs APRES=4
            11:58:21,677 INFO [STDOUT] [com.navineo.sa.alarmes.evt.bp.filter.chaine.ChainePC][pool-21-thread-1] - phaseCourante ( this=com.navineo.sa.alarmes.evt.bp.filter.chaine.ChainePC@12880ea , ret=0 )
            11:58:21,677 INFO [STDOUT] [com.navineo.sa.alarmes.port.reception.PortReceptionAsynchrone][pool-21-thread-1] - demarrer ( this=PortReceptionAsynchrone [ nom=FiltreTemporel.inAsync ] )
            11:58:21,690 INFO [STDOUT] [com.navineo.sa.alarmes.global.filter.chaine.ChaineConsommationAlarmes][pool-21-thread-1] - phaseCourante ( this=com.navineo.sa.alarmes.global.filter.chaine.ChaineConsommationAlarmes@c2f7d4 , ret=0 )
            11:58:21,690 INFO [STDOUT] [com.navineo.sa.alarmes.port.reception.PortReceptionAsynchrone][pool-21-thread-1] - demarrer ( this=PortReceptionAsynchrone [ nom=ChaineConsommationAlarmes.in1Async ] )
            11:58:21,727 INFO [STDOUT] [com.navineo.sa.alarmes.global.filter.chaine.ChaineConsommationAlarmes][pool-21-thread-1] - phaseCourante ( this=com.navineo.sa.alarmes.global.filter.chaine.ChaineConsommationAlarmes@c2f7d4 , ret=25 )
            11:58:21,776 INFO [STDOUT] [com.navineo.sa.alarmes.port.reception.PortReceptionAsynchrone][pool-21-thread-1] - demarrer ( this=PortReceptionAsynchrone [ nom=ChaineConsommationAlarmes.in2Async ] )
            11:58:21,828 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.MoteurAlarmesSite][pool-21-thread-1] - sAbonner
            11:58:21,829 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.MoteurAlarmesSite][pool-21-thread-1] - MILIEU demarrer
            11:58:21,829 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.MoteurAlarmesSite][pool-21-thread-1] - FIN demarrer
            11:58:21,830 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop/APRES invoke
            11:58:21,830 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement!/FIN
            11:58:21,830 INFO [ControleurLocalTachesEgoistes] APRES cmd.executerLocalement/cmd: StartService [ tache=NAVINEO.HORA:service=MoteurAlarmesSite , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:21,830 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerGlobalement
            11:58:21,830 INFO [ControleurLocalTachesEgoistes] BasculeTachesEgoistesHANB$NotificationListener/handleNotification
            11:58:21,830 INFO [ControleurLocalTachesEgoistes] userData: [Ljava.io.Serializable;@726b9c
            11:58:21,830 INFO [ControleurLocalTachesEgoistes] handback: null
            11:58:21,830 INFO [ControleurLocalTachesEgoistes] AVANT cmd.executerLocalement/cmd: StartService [ tache=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:21,830 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement?
            11:58:21,830 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement!
            11:58:21,830 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud [ tache=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:21,830 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud/AVANT invoke
            11:58:21,831 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeSetNoeud/APRES invoke
            11:58:21,842 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop [ tache=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , targetMethodName=demarrer ]
            11:58:21,842 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop/AVANT invoke
            11:58:21,842 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.FTPFileSucker][pool-21-thread-1] - DEBUT demarrer
            11:58:21,868 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.FTPFileSucker][pool-21-thread-1] - MILIEU demarrer
            11:58:21,868 INFO [STDOUT] [com.navineo.hora.jmx.ha.taches.FTPFileSucker][pool-21-thread-1] - FIN demarrer
            11:58:21,868 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionLocaleCommandeRepartition][pool-21-thread-1] - invokeStartStop/APRES invoke
            11:58:21,868 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.StartService][pool-21-thread-1] - executerLocalement!/FIN
            11:58:21,868 INFO [ControleurLocalTachesEgoistes] APRES cmd.executerLocalement/cmd: StartService [ tache=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , noeudChoisi=NoeudCluster[192.168.0.1:40045] ]
            11:58:21,869 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionGlobaleCommandeRepartition][pool-21-thread-1] - invokePrendreEnCompteImpacts/DEBUT/impacts: ImpactsCommandesRepartition [ size=3 , impacts=[ImpactCommandeRepartition [ objectName=NAVINEO.SA:service=ActivationVersions , clusterNode=NoeudCluster[192.168.0.1:40045] , isStart=true ], ImpactCommandeRepartition [ objectName=NAVINEO.HORA:service=MoteurAlarmesSite , clusterNode=NoeudCluster[192.168.0.1:40045] , isStart=true ], ImpactCommandeRepartition [ objectName=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , clusterNode=NoeudCluster[192.168.0.1:40045] , isStart=true ]] ]
            11:58:21,869 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - prendreEnCompteImpacts: ImpactsCommandesRepartition [ size=3 , impacts=[ImpactCommandeRepartition [ objectName=NAVINEO.SA:service=ActivationVersions , clusterNode=NoeudCluster[192.168.0.1:40045] , isStart=true ], ImpactCommandeRepartition [ objectName=NAVINEO.HORA:service=MoteurAlarmesSite , clusterNode=NoeudCluster[192.168.0.1:40045] , isStart=true ], ImpactCommandeRepartition [ objectName=NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE , clusterNode=NoeudCluster[192.168.0.1:40045] , isStart=true ]] ]
            11:58:21,869 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - getRegistreHashMap
            11:58:21,869 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - registre: {NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE=[Ljava.lang.Object;@110b276, NAVINEO.SA:service=ComEmbarques=[Ljava.lang.Object;@134a226, NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE=[Ljava.lang.Object;@817dd2, NAVINEO.SA:service=ActivationVersions=[Ljava.lang.Object;@16b6954, NAVINEO.HORA:service=MoteurAlarmesSite=[Ljava.lang.Object;@d019e9, NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE=[Ljava.lang.Object;@55334a}
            11:58:21,870 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - size: 6
            11:58:21,870 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - prendreEnCompteImpacts/map AVANT: MapTachesEgoistesImpl [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ActivationVersions --> NoeudCluster[10.27.252.164:41988] , NAVINEO.HORA:service=MoteurAlarmesSite --> NoeudCluster[10.27.252.164:41988] , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE --> NoeudCluster[10.27.252.164:41988] } ]
            11:58:21,877 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - prendreEnCompteImpacts/map APRES: MapTachesEgoistesImpl [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ActivationVersions --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurAlarmesSite --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] } ]
            11:58:21,903 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - getRegistreHashMap
            11:58:21,903 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - registre: {NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE=[Ljava.lang.Object;@ed3a80, NAVINEO.SA:service=ComEmbarques=[Ljava.lang.Object;@9be786, NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE=[Ljava.lang.Object;@17d1e1d, NAVINEO.SA:service=ActivationVersions=[Ljava.lang.Object;@14408d6, NAVINEO.HORA:service=MoteurAlarmesSite=[Ljava.lang.Object;@1a02275, NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE=[Ljava.lang.Object;@363442}
            11:58:21,904 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - size: 6
            11:58:21,904 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.registre.RegistreTachesEgoistes][pool-21-thread-1] - prendreEnCompteImpacts/getMap APRES: MapTachesEgoistesImpl [ size=6 , egoistes= { NAVINEO.SA:service=ComEmbarques --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurAlarmesCentre_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurSuivi_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=ActivationVersions --> NoeudCluster[192.168.0.1:40045] , NAVINEO.HORA:service=MoteurAlarmesSite --> NoeudCluster[192.168.0.1:40045] , NAVINEO.SA:service=FTPFileSucker_DEFAULT_CE --> NoeudCluster[192.168.0.1:40045] } ]
            11:58:21,904 INFO [STDOUT] [com.navineo.sa.jmx.ha.taches.cmd.envexec.EnvironnementServeurExecutionGlobaleCommandeRepartition][pool-21-thread-1] - invokePrendreEnCompteImpacts/FIN
            11:58:31,090 INFO [FailoverCommandCenter] JBoss Messaging server failure detected - waiting for failover to complete...
            11:58:31,152 INFO [FailoverCommandCenter] JBoss Messaging failover complete


            • 3. Re: Completely confused by client failover
              gaohoward

               

              WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client 3j
              011-7h2pwj-fw0ewfv0-1-fw0ezfni-nc, jmsClientID=null. It is possible the client has exited without cl
              osing its connection(s) or the network has failed. All associated connection resources will be clean
              ed up.
              


              This means the server detects a client connection loss and does the corresponding clean up.

              • 4. Re: Completely confused by client failover

                I only get this WARN during the failover so it shouldn't be a problem.

                I found a solution for my missed remote client failover: now the remaining node (which is notified of the cluster topology change) waits 10 seconds before posting the message on the LostNode topic.
                It looks like i was posting the message during the failover, and that that was why the client couldn't receive it.