4 Replies Latest reply on Oct 27, 2010 9:48 AM by clewis

    hornetq.notifications queues keep accumulating

    clewis

      We have HornetQ 2.1.2 deployed on JBoss 5.1.0 in a 4 node clustered configuration (all 4 nodes are on the same machine). Although the queues are working fine we have noticed excessive amounts of logging around Bridge connections. This is also showing up as new hornetq.notification queues in the JMX Console. Our cluster configuration looks the same across all four nodes, see below. I've also included some examples of the log messages and queues. I'm assuming we have some configuration setting incorrect but I'm not sure what to change. Can someone please point me in the right direction?

       

      Thanks,

       

      Carl

       

      <cluster-connections>
            <cluster-connection name="PROD-CLUSTER">
               <address>jms</address>    
               <retry-interval>500</retry-interval>
           <use-duplicate-detection>true</use-duplicate-detection>
           <forward-when-no-consumers>false</forward-when-no-consumers>
           <max-hops>1</max-hops>
           <discovery-group-ref discovery-group-name="DG-PROD"/>
            </cluster-connection>
         </cluster-connections>

       

         <address-settings>
            <!--default for catch all-->
            <address-setting match="#">
               <dead-letter-address>jms.queue.DLQ</dead-letter-address>
               <expiry-address>jms.queue.ExpiryQueue</expiry-address>
               <redistribution-delay>0</redistribution-delay>
               <redelivery-delay>60000</redelivery-delay>
               <max-delivery-attempts>720</max-delivery-attempts>
               <max-size-bytes>10485760</max-size-bytes>      
               <message-counter-history-day-limit>10</message-counter-history-day-limit>
           <address-full-policy>BLOCK</address-full-policy>
            </address-setting>
         </address-settings>  

       

       

      2010-10-25 02:04:12,508 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-29 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:04:12,551 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-29 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:04:17,728 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:04:18,171 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:04:52,701 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-18 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:04:53,252 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-18 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:04:57,597 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-26 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:04:57,690 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-26 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:05:12,611 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-9 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:05:12,709 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-9 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:05:17,581 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:05:18,005 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:05:47,842 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-18 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:05:48,373 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-18 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:11:42,853 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-25 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.cccf3b4f-d6fc-11df-8518-005056b2186c to its destination

      2010-10-25 02:11:42,949 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-25 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.cccf3b4f-d6fc-11df-8518-005056b2186c is connected to its destination

      2010-10-25 02:11:52,864 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-6 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:11:53,526 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-6 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:11:58,060 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-13 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:11:58,941 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-13 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:12:02,899 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-24 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.cccf3b4f-d6fc-11df-8518-005056b2186c to its destination

      2010-10-25 02:12:02,962 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-24 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.cccf3b4f-d6fc-11df-8518-005056b2186c is connected to its destination

      2010-10-25 02:12:22,900 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-7 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.cccf3b4f-d6fc-11df-8518-005056b2186c to its destination

      2010-10-25 02:12:22,972 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-7 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.cccf3b4f-d6fc-11df-8518-005056b2186c is connected to its destination

      2010-10-25 02:14:28,137 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-3 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:14:28,156 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-3 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:15:12,958 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-13 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:15:13,060 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-13 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:15:27,987 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-24 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:15:28,458 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-24 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:16:32,979 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-0 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:16:33,039 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-0 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:18:12,996 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-27 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:18:13,087 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-27 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:19:18,031 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-20 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:19:18,122 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-20 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:20:58,101 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-22 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:20:58,231 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-22 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:21:03,154 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-29 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:21:03,403 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-29 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:21:23,298 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-10 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:21:23,448 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-10 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:21:33,302 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-14 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:21:33,377 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-14 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:33:33,528 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-19 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:33:33,624 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-19 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:33:48,553 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-23 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:33:48,772 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-23 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:33:58,549 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-1 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:33:58,620 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-1 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:34:43,580 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-5 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:34:43,710 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-5 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:34:53,601 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:34:53,744 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:36:08,662 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-18 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:36:09,015 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-18 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:36:53,694 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-28 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:36:53,789 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-28 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:37:08,704 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-25 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:37:08,954 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-25 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:37:13,720 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-4 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:37:13,805 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-4 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:37:28,723 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-9 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:37:28,787 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-9 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:37:38,747 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-16 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 02:37:38,843 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-16 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

      2010-10-25 02:38:53,794 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:38:54,010 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-8 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 02:39:08,812 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-14 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 02:39:08,890 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-14 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 03:10:44,534 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-9 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c to its destination

      2010-10-25 03:10:44,628 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-9 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.8d473c20-d6fd-11df-9a6e-005056b2186c is connected to its destination

      2010-10-25 03:14:34,876 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-16 (group:HornetQ-server-threads2937558-4484046)) Connecting bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c to its destination

      2010-10-25 03:14:34,895 INFO  [org.hornetq.core.server.cluster.impl.BridgeImpl] (Thread-16 (group:HornetQ-server-threads2937558-4484046)) Bridge sf.PROD-CLUSTER.61fedfaf-d6fc-11df-9666-005056b2186c is connected to its destination

       

      * address="hornetq.notifications",module=Core,name="notif.01b8b6a4-e08c-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.01bad95c-e08c-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.01bcd5f8-e08c-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.0886faf1-df9c-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.0c05d530-e06d-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.0c07d11a-e06d-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.0dfb9ef4-e000-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.0dfd9b6c-e000-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.0f6a3fe8-e06e-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.0f6cd86a-e06e-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.10809630-e08c-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.130a6ad6-e08b-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.130cdbf4-e08b-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.1db17648-e002-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.1db3c05e-e002-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.1db56e18-e002-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.20e59d50-e06d-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.20e771e4-e06d-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.21f2080e-e08b-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.21ff4e32-e08b-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.2201e66c-e08b-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.2a1fb422-e08f-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.2a222504-e08f-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.2a2cd2e4-e08f-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.338b412c-e06f-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.33904a3c-e06f-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.339887ac-e06f-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.37107f2c-e069-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.3712c964-e069-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.3714ebee-e069-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.375de910-dfff-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.375fe52c-dfff-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.3770fbfe-dfff-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.3fc31672-e08b-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.3fc4eb66-e08b-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.42fda0c8-e069-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.42ff75d0-e069-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4301714a-e069-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.430627aa-e070-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.43084a7a-e070-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4309aa80-e070-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.468affb6-dfc5-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.468cad34-dfc5-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.468e0cb6-dfc5-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.48af2d1a-e08b-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4a503392-dfc7-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4a5192c4-dfc7-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4a85ad2c-e089-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4a87a83e-e089-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4aa431b0-e089-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4bada03e-e08b-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4bb1be84-e08b-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.4f2c4e74-df9c-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.54a1cd2a-e08b-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.54a37aae-e08b-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.54af13b0-e08b-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.5d9bc698-e08b-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.5d9dc1b0-e08b-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.5d9f9712-e08b-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.5e1b103d-dfc4-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.5e1da7f6-dfc4-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.5e55325c-dfc4-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.6544fb34-e002-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.6546a81c-e002-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.65487da2-e002-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.65dbebee-e06e-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.65dd72b0-e06e-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.65df1fb8-e06e-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.69576522-e068-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.69593a64-e068-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7103d2e8-e06c-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.71061d3c-e06c-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7107a42c-e06c-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7113c0f0-dfc7-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7115960e-dfc7-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7116f4d4-dfc7-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.774d8c78-e05f-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7d2272ae-e002-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7d244770-e002-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7d25cd48-e002-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7eafeaca-e069-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.7eb1986c-e069-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.86f277a4-e08a-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.86fcd7fb-e08a-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.86ff9732-e08a-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.87fd1758-e06a-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.87ff12e4-e06a-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.880099d4-e06a-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.8fd5b7fb-df9a-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.957a770f-df9b-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.98357ed8-dfc8-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.98386472-dfc8-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9841da6a-dfc8-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9a09f762-dfc5-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9a0c901a-dfc5-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9a14a6b4-dfc5-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9b69ae60-e089-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9b6c1f80-e089-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9effd764-dff6-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9f286e1c-dff6-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.9f316f0a-dff6-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a172c9d0-e089-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a2956700-e006-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a2971484-e006-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a2a175a4-e006-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a2d200ea-dfc4-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a588e436-dfc4-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a58b5476-dfc4-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a7888e74-e089-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a7ce7b52-dff6-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a7dd9638-dff6-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a7def5fa-dff6-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a81f3f0c-e08b-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a8269204-e08b-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.a8290234-e08b-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.ab74fe90-dfff-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.ab76acec-dfff-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.ab785a9c-dfff-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.ae62cb9c-e006-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.ae64a030-e006-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.ae6675d0-e006-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.bce30ad3-dffd-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.bce4df26-dffd-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.bcf66b66-dffd-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.be843848-e06c-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.be865ad8-e06c-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.c66ab43e-dfc4-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.c8b1a7ef-dffd-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.c8c55acf-dff6-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.c8c55b42-dff6-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.c8c72b52-dffd-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.c8c9797a-dff6-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.ceda1508-dffe-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.cedbc226-dffe-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.cedd973e-dffe-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.d15717d0-dffd-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.dd2ecfb8-e067-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.dd9c48b2-dff6-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.dd9e44b0-dff6-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.dd9ff2d4-dff6-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e6f7c706-e069-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e6f9743c-e069-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e6fb2298-e069-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e9839dd6-dff6-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e9859a48-dff6-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e985bd06-dffd-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e98ffab8-dff6-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e9aaa98a-dffd-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.e9b4e37f-dffd-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.f3d8a650-e088-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.f3dc771c-e088-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.f3e59ec2-e088-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.f5dfffc4-e069-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.f5e186d2-e069-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.f604809c-e006-11df-9662-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.f606081c-e006-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.fcd1403a-e088-11df-a6d8-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.fcd8ba1c-e088-11df-bdd7-005056b2186c",type=Queue

      * address="hornetq.notifications",module=Core,name="notif.fcdcb142-e088-11df-9662-005056b2186c",type=Queue

        • 1. Re: hornetq.notifications queues keep accumulating
          clebert.suconic

          Whenever a node enters the cluster, the Bridge will create notification subscriptions between nodes.

           

          if the node reconnects, the bridge will create another set of queues, and those will be ignored.

           

          Notice that those queues are transient. They won't be recreated when you restart that specific node.

          • 2. Re: hornetq.notifications queues keep accumulating
            clewis

            Is there a reason why nodes are reconnecting so often? We only have the 4 nodes and we leave them up 24/7, so no nodes should be leaving or entering the cluster after the initial startup. Are the nodes leaving the cluster because of some timeout and then automatically rejoining?

            • 3. Re: hornetq.notifications queues keep accumulating
              clebert.suconic

              network issues maybe?

              • 4. Re: hornetq.notifications queues keep accumulating
                clewis

                Thanks Clebert, the problem was a resource issue. We're running all 4 nodes on one virtual machine. Because of this, occasionally a node fails to get a broadcast from another node before the refresh timeout and closes the connection. Of course, the node is still there and the next broadcast triggers a new connection to be created. This was happening across all 4 nodes so it would tend to cause other nodes to miss broadcasts and the problem would cascade. We would see in the logs large sections where nothing was happening but bridge connections and then the problem would go away and come back hours later.

                 

                To fix this we left the broadcast-period the same but increased the refresh-timeout on the discovery groups. Now we only have the original connections created at startup and we don't see nodes constantly reconnecting.

                 

                Thanks,

                 

                Carl