1 2 Previous Next 15 Replies Latest reply on Sep 14, 2009 7:12 AM by rnicholson10

    Serious idle problem with Bridges on AS 5.1.0.Beta

    rnicholson10

      I had previously reported a problem with idle timeouts on bridges:

      http://www.jboss.org/index.html?module=bb&op=viewtopic&t=154559

      In my previous post I had stated that this problem only occurred with QOS_ONCE_AND_ONLY_ONCE bridges. However it would appear that this is not the case. After extensive testing it also occurs with QOS_DUPLICATES_OK. This issue is a show stopper for us as we cannot move our application to production if this issue still exists.

      I have 3 questions related to this:


      1) Has anyone else encountered this problem
      2) Are there any planned fixes for this issue
      3) When possibly could we expect to see this issue fixed in an AS5 release (as we cannot build messaging ourseleves to work with AS5, we've tried but it just doesn't work!).


      Using QOS_DUPLICATES_OK in our test scenario we have a box (box1) that sends messages and another that hosts the bridge file and receives them (box2).

      The bridge file on box2 looks like this:

      <mbean code="org.jboss.jms.server.bridge.BridgeService" name="jboss.messaging:service=Bridge,name=InputToEngineBridge" xmbean-dd="xmdesc/Bridge-xmbean.xml">
      
       <depends optional-attribute-name="SourceProviderLoader">jboss.messaging:service=JMSProviderLoader,name=RemoteJMSProvider</depends>
       <depends optional-attribute-name="TargetProviderLoader">jboss.messaging:service=JMSProviderLoader,name=JMSProvider</depends>
      
       <attribute name="SourceDestinationLookup">/queue/phaseQueueToEngine</attribute>
       <attribute name="TargetDestinationLookup">/queue/phaseQueueFromInput</attribute>
      
       <!-- Optional: The Quality Of Service mode to use, one of:
       QOS_AT_MOST_ONCE = 0;
       QOS_DUPLICATES_OK = 1;
       QOS_ONCE_AND_ONLY_ONCE = 2;-->
       <attribute name="QualityOfServiceMode">1</attribute>
      
       <attribute name="MaxBatchSize">1</attribute>
       <attribute name="MaxBatchTime">-1</attribute>
       <attribute name="FailureRetryInterval">5000</attribute>
       <attribute name="MaxRetries">-1</attribute>
       <attribute name="AddMessageIDInHeader">false</attribute>
      </mbean>
      


      After an idle period of 16 hours (jboss running but no messages are sent), box1 attempts to send 100 messages. The following error occurs on box1:

      2009-06-07 13:23:58,655 ERROR [org.jboss.messaging.util.ExceptionUtil] (http-0.0.0.0-8080-6) ConnectionFactoryEndpoint[jboss.messaging.connectionfactory:service=ConnectionFactory] createFailoverConnectionDelegate [8f41-nq47qnvf-1-yyggvmuf-g3h4ce-b53gs4]
      javax.jms.JMSSecurityException: User null is NOT authenticated
       at org.jboss.jms.server.jbosssx.JBossASSecurityMetadataStore.authenticate(JBossASSecurityMetadataStore.java:223)
       at sun.reflect.GeneratedMethodAccessor926.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
       at java.lang.reflect.Method.invoke(Unknown Source)
       at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
       at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
       at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(Unknown Source)
       at com.sun.jmx.mbeanserver.PerInterface.invoke(Unknown Source)
       at com.sun.jmx.mbeanserver.MBeanSupport.invoke(Unknown Source)
       at javax.management.StandardMBean.invoke(Unknown Source)
       at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:668)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy108.authenticate(Unknown Source)
       at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegateInternal(ServerConnectionFactoryEndpoint.java:233)
       at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegate(ServerConnectionFactoryEndpoint.java:171)
       at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.org$jboss$jms$server$endpoint$advised$ConnectionFactoryAdvised$createConnectionDelegate$aop(ConnectionFactoryAdvised.java:108)
       at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.createConnectionDelegate(ConnectionFactoryAdvised.java)
       at org.jboss.jms.wireformat.ConnectionFactoryCreateConnectionDelegateRequest.serverInvoke(ConnectionFactoryCreateConnectionDelegateRequest.java:91)
       at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:143)
       at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:908)
       at org.jboss.remoting.transport.local.LocalClientInvoker.invoke(LocalClientInvoker.java:106)
       at org.jboss.remoting.Client.invoke(Client.java:1708)
       at org.jboss.remoting.Client.invoke(Client.java:612)
       at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.org$jboss$jms$client$delegate$ClientConnectionFactoryDelegate$createConnectionDelegate$aop(ClientConnectionFactoryDelegate.java:171)
       at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.invokeTarget(ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.java)
       at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111)
       at org.jboss.jms.client.container.StateCreationAspect.handleCreateConnectionDelegate(StateCreationAspect.java:81)
       at org.jboss.aop.advice.org.jboss.jms.client.container.StateCreationAspect_z_handleCreateConnectionDelegate_12191562.invoke(StateCreationAspect_z_handleCreateConnectionDelegate_12191562.java)
       at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
       at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.createConnectionDelegate(ClientConnectionFactoryDelegate.java)
       at org.jboss.jms.client.JBossConnectionFactory.createConnectionInternal(JBossConnectionFactory.java:205)
       at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:87)
       at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:82)
       at com.paddypower.phase.test.servlet.TestMessageOneServlet.doGet(TestMessageOneServlet.java:92)
       at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
       at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
       at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
       at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)
       at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
       at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)
       at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)
       at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)
       at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)
       at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
       at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
       at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)
       at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
       at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)
       at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829)
       at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:601)
       at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
       at java.lang.Thread.run(Unknown Source)
      2009-06-07 13:23:58,657 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (http-0.0.0.0-8080-6) removing callback handler ServerInvokerCallbackHandler[4sg35b-ec4h3g-fumvggyy-1-fvnq74q0-14f2+4sg35b-ec4h3g-fumvggyy-1-fvnq74qf-14f5]
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-6) removed org.jboss.remoting.transport.local.LocalClientInvoker@1f5facb from registry
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.ServerInvoker] (http-0.0.0.0-8080-6) ServerInvoker (SocketServerInvoker[172.16.113.11:1227169616]) removing client callback handler with session id of 4sg35b-ec4h3g-fumvggyy-1-fvnq74q0-14f2+4sg35b-ec4h3g-fumvggyy-1-fvnq74qf-14f5.
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (http-0.0.0.0-8080-6) unrecognized listener ID: 4sg35b-ec4h3g-fumvggyy-1-fvnq74qf-14f5
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-6) removed org.jboss.remoting.transport.local.LocalClientInvoker@2460e7 from registry
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (http-0.0.0.0-8080-6) SocketServerInvoker[172.16.113.11:1227169616] stopped threads in clientpool
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (http-0.0.0.0-8080-6) SocketServerInvoker[172.16.113.11:1227169616] stopped threads in threadpool
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (http-0.0.0.0-8080-6) SocketServerInvoker[172.16.113.11:1227169616] exiting
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.ServerInvoker] (http-0.0.0.0-8080-6) SocketServerInvoker[172.16.113.11:1227169616] stopped
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-6) decremented org.jboss.remoting.transport.local.LocalClientInvoker@1da6374's count, current count 2
      2009-06-07 13:23:58,657 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-6) decremented org.jboss.remoting.transport.local.LocalClientInvoker@b76609's count, current count 2
      


      At this point I restart jboss on box1, but box2 now gives the following errors:

      2009-06-07 13:20:00,372 WARN [org.jboss.jms.server.bridge.Bridge] (Thread-98) jboss.messaging:name=InputToEngineBridge,service=Bridge Failed to set up connections
      javax.jms.JMSSecurityException: User null is NOT authenticated
       at org.jboss.jms.server.jbosssx.JBossASSecurityMetadataStore.authenticate(JBossASSecurityMetadataStore.java:223)
       at sun.reflect.GeneratedMethodAccessor301.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
       at java.lang.reflect.Method.invoke(Unknown Source)
       at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
       at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
       at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(Unknown Source)
       at com.sun.jmx.mbeanserver.PerInterface.invoke(Unknown Source)
       at com.sun.jmx.mbeanserver.MBeanSupport.invoke(Unknown Source)
       at javax.management.StandardMBean.invoke(Unknown Source)
       at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:668)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy98.authenticate(Unknown Source)
       at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegateInternal(ServerConnectionFactoryEndpoint.java:233)
       at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegate(ServerConnectionFactoryEndpoint.java:171)
       at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.org$jboss$jms$server$endpoint$advised$ConnectionFactoryAdvised$createConnectionDelegate$aop(ConnectionFactoryAdvised.java:108)
       at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.createConnectionDelegate(ConnectionFactoryAdvised.java)
       at org.jboss.jms.wireformat.ConnectionFactoryCreateConnectionDelegateRequest.serverInvoke(ConnectionFactoryCreateConnectionDelegateRequest.java:91)
       at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:143)
       at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:908)
       at org.jboss.remoting.transport.local.LocalClientInvoker.invoke(LocalClientInvoker.java:106)
       at org.jboss.remoting.Client.invoke(Client.java:1708)
       at org.jboss.remoting.Client.invoke(Client.java:612)
       at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.org$jboss$jms$client$delegate$ClientConnectionFactoryDelegate$createConnectionDelegate$aop(ClientConnectionFactoryDelegate.java:171)
       at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.invokeTarget(ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.java)
       at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111)
       at org.jboss.jms.client.container.StateCreationAspect.handleCreateConnectionDelegate(StateCreationAspect.java:81)
       at org.jboss.aop.advice.org.jboss.jms.client.container.StateCreationAspect_z_handleCreateConnectionDelegate_7578460.invoke(StateCreationAspect_z_handleCreateConnectionDelegate_7578460.java)
       at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
       at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.createConnectionDelegate(ClientConnectionFactoryDelegate.java)
       at org.jboss.jms.client.JBossConnectionFactory.createConnectionInternal(JBossConnectionFactory.java:205)
       at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:87)
       at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:82)
       at org.jboss.jms.server.bridge.Bridge.createConnection(Bridge.java:893)
       at org.jboss.jms.server.bridge.Bridge.setupJMSObjects(Bridge.java:1015)
       at org.jboss.jms.server.bridge.Bridge.setupJMSObjectsWithRetry(Bridge.java:1223)
       at org.jboss.jms.server.bridge.Bridge.access$1600(Bridge.java:68)
       at org.jboss.jms.server.bridge.Bridge$FailureHandler.run(Bridge.java:1569)
       at java.lang.Thread.run(Unknown Source)
      2009-06-07 13:20:00,375 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-98) removed SocketClientInvoker[138cef1, bisocket://jbdevapp1.inhouse.paddypower.com:4457] from registry
      2009-06-07 13:20:00,375 DEBUG [org.jboss.remoting.transport.socket.MicroSocketClientInvoker] (Thread-98) SocketClientInvoker[138cef1, bisocket://jbdevapp1.inhouse.paddypower.com:4457] disconnecting ...
      2009-06-07 13:20:00,375 DEBUG [org.jboss.remoting.ConnectionValidator] (Thread-98) ConnectionValidator[SocketClientInvoker[138cef1, bisocket://jbdevapp1.inhouse.paddypower.com:4457], pingPeriod=10000 ms] stopped, returning true
      2009-06-07 13:20:00,477 DEBUG [org.jboss.remoting.ServerInvoker] (Thread-98) ServerInvoker (SocketServerInvoker[172.16.113.22:1145771147]) removing client callback handler with session id of 4sg35m-gh2wpi-fvmo2mas-1-fvnq20td-356+4sg35m-gh2wpi-fvmo2mas-1-fvnq20u7-35a.
      2009-06-07 13:20:00,478 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (Thread-98) SocketServerInvoker[172.16.113.22:1145771147] shutting down control connection: 4sg35m-gh2wpi-fvmo2mas-1-fvnq20u7-35a
      2009-06-07 13:20:00,478 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-98) removed org.jboss.remoting.transport.local.LocalClientInvoker@3abbcd from registry
      2009-06-07 13:20:00,478 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-98) SocketServerInvoker[172.16.113.22:1145771147] stopped threads in clientpool
      2009-06-07 13:20:00,478 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-98) SocketServerInvoker[172.16.113.22:1145771147] stopped threads in threadpool
      2009-06-07 13:20:00,478 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-98) SocketServerInvoker[172.16.113.22:1145771147] exiting
      2009-06-07 13:20:00,478 DEBUG [org.jboss.remoting.ServerInvoker] (Thread-98) SocketServerInvoker[172.16.113.22:1145771147] stopped
      2009-06-07 13:20:00,478 DEBUG [org.jboss.remoting.LeasePinger] (Thread-98) LeasePinger[SocketClientInvoker[1058a14, bisocket://jbdevapp1.inhouse.paddypower.com:4457](4sg35m-gh2wpi-fvmo2mas-1-fvnq20mq-34s)] setting disconnect timeout to: -1
      2009-06-07 13:20:00,490 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-98) removed SocketClientInvoker[1058a14, bisocket://jbdevapp1.inhouse.paddypower.com:4457] from registry
      2009-06-07 13:20:00,490 DEBUG [org.jboss.remoting.transport.socket.MicroSocketClientInvoker] (Thread-98) SocketClientInvoker[1058a14, bisocket://jbdevapp1.inhouse.paddypower.com:4457] disconnecting ...
      2009-06-07 13:20:00,491 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (Thread-98) ClientSocketWrapper[Socket[addr=/172.16.113.11,port=4457,localport=36016].7f5d75] closing socket
      2009-06-07 13:20:00,491 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (Thread-98) ClientSocketWrapper[Socket[addr=/172.16.113.11,port=4457,localport=36016].7f5d75] closed socket
      2009-06-07 13:20:00,491 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (Thread-98) ClientSocketWrapper[Socket[addr=/172.16.113.11,port=4457,localport=36017].1d0ca53] closing socket
      2009-06-07 13:20:00,491 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (Thread-98) ClientSocketWrapper[Socket[addr=/172.16.113.11,port=4457,localport=36017].1d0ca53] closed socket
      2009-06-07 13:20:00,491 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-98) removed SocketClientInvoker[1b4f110, bisocket://jbdevapp1.inhouse.paddypower.com:4457] from registry
      2009-06-07 13:20:00,491 DEBUG [org.jboss.remoting.transport.socket.MicroSocketClientInvoker] (Thread-98) SocketClientInvoker[1b4f110, bisocket://jbdevapp1.inhouse.paddypower.com:4457] disconnecting ...
      2009-06-07 13:20:00,491 WARN [org.jboss.jms.server.bridge.Bridge] (Thread-98) jboss.messaging:name=InputToEngineBridge,service=Bridge Failed to set up connections, will retry after a pause of 5000 ms
      2009-06-07 13:20:01,526 FINE [sun.rmi.transport.tcp] (RMI Scheduler(0)) RMI Scheduler(0): close connection
      2009-06-07 13:20:02,171 DEBUG [org.jboss.remoting.transport.socket.MicroSocketClientInvoker] (Finalizer) SocketClientInvoker[1058a14, bisocket://jbdevapp1.inhouse.paddypower.com:4457] disconnecting ...
      2009-06-07 13:20:02,171 DEBUG [org.jboss.remoting.transport.socket.MicroSocketClientInvoker] (Finalizer) SocketClientInvoker[1058a14, bisocket://jbdevapp1.inhouse.paddypower.com:4457] disconnecting ...
      2009-06-07 13:20:02,171 DEBUG [org.jboss.remoting.transport.socket.MicroSocketClientInvoker] (Finalizer) SocketClientInvoker[1b4f110, bisocket://jbdevapp1.inhouse.paddypower.com:4457] disconnecting ...
      2009-06-07 13:20:02,171 DEBUG [org.jboss.remoting.transport.socket.MicroSocketClientInvoker] (Finalizer) SocketClientInvoker[1b4f110, bisocket://jbdevapp1.inhouse.paddypower.com:4457] disconnecting ...
      2009-06-07 13:20:02,172 DEBUG [org.jboss.remoting.ServerInvoker] (Finalizer) SocketServerInvoker[172.16.113.22:1304616729] stopped
      2009-06-07 13:20:02,172 DEBUG [org.jboss.remoting.ServerInvoker] (Finalizer) SocketServerInvoker[172.16.113.22:1104212656] stopped
      2009-06-07 13:20:02,173 DEBUG [org.jboss.remoting.ServerInvoker] (Finalizer) SocketServerInvoker[172.16.113.22:1145771147] stopped
      2009-06-07 13:20:02,173 DEBUG [org.jboss.remoting.ServerInvoker] (Finalizer) SocketServerInvoker[172.16.113.22:1304616767] stopped
      


      If I now restart box2, the bridges behave correctly once again.

        • 1. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
          gaohoward
          • 2. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
            gaohoward

            Hi,

            Just tried with 5.1.0.GA (JBM is the same as Beta). Bridge server has been deployed for over 19 hours without sending any messages. Then I tried to send messages and the bridge works normally.

            Do you have any opinions on how to reproduce it?

            Thanks

            • 3. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
              rnicholson10

              Howard,

              Are you running the bridge across two physically different boxes? I have the default JMS Provider (localhost) and a remote JMS Provider to a separate box with a different IP Address.

              If your remote provider is also localhost you might not see the issue.

              Here are my JMS providers (jms-ds.xml):

              <?xml version="1.0" encoding="UTF-8"?>
              
              <connection-factories>
              
               <!-- ==================================================================== -->
               <!-- JMS Stuff -->
               <!-- ==================================================================== -->
              
               <!--
               The JMS provider loader. Currently pointing to a non-clustered ConnectionFactory. Need to
               be replaced with a clustered non-load-balanced ConnectionFactory when it becomes available.
               See http://jira.jboss.org/jira/browse/JBMESSAGING-843.
               -->
               <mbean code="org.jboss.jms.jndi.JMSProviderLoader"
               name="jboss.messaging:service=JMSProviderLoader,name=JMSProvider">
               <attribute name="ProviderName">DefaultJMSProvider</attribute>
               <attribute name="ProviderAdapterClass">org.jboss.jms.jndi.JNDIProviderAdapter</attribute>
               <attribute name="FactoryRef">java:/XAConnectionFactory</attribute>
               <attribute name="QueueFactoryRef">java:/XAConnectionFactory</attribute>
               <attribute name="TopicFactoryRef">java:/XAConnectionFactory</attribute>
               </mbean>
              
               <mbean code="org.jboss.jms.jndi.JMSProviderLoader"
               name="jboss.messaging:service=JMSProviderLoader,name=RemoteJMSProvider">
               <attribute name="ProviderName">RemoteJMSProvider</attribute>
               <attribute name="ProviderAdapterClass">
               org.jboss.jms.jndi.JNDIProviderAdapter
               </attribute>
               <attribute name="FactoryRef">/XAConnectionFactory</attribute>
               <attribute name="QueueFactoryRef">/XAConnectionFactory</attribute>
               <attribute name="TopicFactoryRef">/XAConnectionFactory</attribute>
               <attribute name="Properties">
               java.naming.factory.initial=org.jnp.interfaces.NamingContextFactory
               java.naming.factory.url.pkgs=org.jboss.naming:org.jnp.interfaces
               java.naming.provider.url=jnp://jbdevapp1:1099
               </attribute>
               </mbean>
              
               <!-- JMS XA Resource adapter, use this to get transacted JMS in beans -->
               <tx-connection-factory>
               <jndi-name>JmsXA</jndi-name>
               <xa-transaction/>
               <rar-name>jms-ra.rar</rar-name>
               <connection-definition>org.jboss.resource.adapter.jms.JmsConnectionFactory</connection-definition>
               <config-property name="SessionDefaultType" type="java.lang.String">javax.jms.Topic</config-property>
               <config-property name="JmsProviderAdapterJNDI" type="java.lang.String">java:/DefaultJMSProvider</config-property>
               <max-pool-size>20</max-pool-size>
               <security-domain-and-application>JmsXARealm</security-domain-and-application>
               <depends>jboss.messaging:service=ServerPeer</depends>
               </tx-connection-factory>
              
              </connection-factories>
              


              • 4. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                rnicholson10

                Another point, I ran the same test again. But this time I tried to re-deploy the bridges on box2 (before trying anything else). Strange thing is I get exactly the same errors as if I restarted box1. So now I restart box2, but still the same errors.

                The "User null is NOT authenticated" error seems to be a coverall for many different types of error. Is there anyway to see the logging at a finer grain to try and find out why this error is being thrown.

                Tomorrow I will try restarting box1 after idle before I try to send 100 messages. And the following day I will do the same but restart box 2.

                The only situation I've found so far that fixes the issue is to completely restart both jboss instances.

                • 5. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                  gaohoward

                  hi,

                  I do have two physical machines setup for the test and my jms-ds.xml is quite the equivalent to yours.

                  To get more log, you can modify the jboss-log4j.xml under /conf dir in your JBOSS_HOME/server/<server-config>

                  Thanks

                  • 6. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                    rnicholson10

                    I have tested all cases and the only way to recover from these errors is to restart both boxes.

                    I will write a keep alive packet running from a timer and see does it fix the issue.

                    I have added the following to jboss-log4j.xml. Howard, should this be sufficient to see further into the "User null is NOT authenticated" error? Or do I need to trace other packages as well? Maybe security too?

                    <!-- ENABLE TRACE LEVEL LOGGING FOR JMS -->
                     <category name="org.jboss.jms">
                     <priority value="TRACE"/>
                     </category>
                    


                    • 7. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                      gaohoward

                      Hi I think turn on security trace is a good idea, and it would be better if you also trace the remoting logs. Thanks

                      • 8. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                        rnicholson10

                        Ok so if I have this to trace:

                         <category name="org.jboss.jms">
                         <priority value="TRACE"/>
                         </category>
                        
                         <category name="org.jboss.remoting">
                         <priority value="TRACE"/>
                         </category>
                        


                        I havn't added security as I think it's under the jms package. If it's something else just post the package name for me and I'll add it in.

                        • 9. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                          gaohoward

                          Thank's fine, waiting for your result. Thanks.

                          • 10. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                            rnicholson10

                            Sorry about the delay in getting back to you.

                            Here's the log from the box1, after the idle time.

                            It seems that the remoting session etc. is found. Spot anything interesting?

                            The second log extract is from box2 when I try to redeploy one of the bridges.

                            2009-06-19 09:43:40,373 DEBUG [org.jboss.remoting.Client] (http-0.0.0.0-8080-1) starting callback Connector: InvokerLocator [bisocket://172.16.113.11:871825415/callback?callbackServerHost=172.16.113.11&callbackServerPort=871825415&callbackServerProtocol=bisocket&clientMaxPoolSize=1&clientSocketClass=org.jboss.jms.client.remoting.ClientSocketWrapper&datatype=jms&guid=4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jq&isCallbackServer=true&onewayThreadPool=org.jboss.jms.server.remoting.DirectThreadPool&serverSocketClass=org.jboss.jms.server.remoting.ServerSocketWrapper]
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.ServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] did not find server socket factory configuration as mbean service or classname. Creating default server socket factory.
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.ServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] created server socket factory javax.net.DefaultServerSocketFactory@87bf5
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] setting pingFrequency to 214748364
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] setting pingWindowFactor to 10
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.transport.Connector] (http-0.0.0.0-8080-1) org.jboss.remoting.transport.Connector@1117568 started
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.ServerInvoker] (http-0.0.0.0-8080-1) ServerInvoker (SocketServerInvoker[172.16.113.11:871825415]) added client callback handler CallbackManager[12d3d44] with session id of 4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo+4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr and callback handle object of null.
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-1) removed org.jboss.remoting.transport.local.LocalClientInvoker@1e3ba17 from registry
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (http-0.0.0.0-8080-1) Session id for callback handler is 4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo+4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (http-0.0.0.0-8080-1) ServerInvokerCallbackHandler[4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo+4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr] using callbackTimeout value 10000
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (http-0.0.0.0-8080-1) DefaultCallbackErrorHandler[UNITIALIZED] setting server invoker to SocketServerInvoker[jbdevapp1:4457]
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (http-0.0.0.0-8080-1) DefaultCallbackErrorHandler[SocketServerInvoker[jbdevapp1:4457]] setting callback handler to ServerInvokerCallbackHandler[4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo+4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr]
                            2009-06-19 09:43:40,385 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (http-0.0.0.0-8080-1) adding callback handler ServerInvokerCallbackHandler[4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo+4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr]
                            2009-06-19 09:43:40,386 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (http-0.0.0.0-8080-1) found calllback handler for remoting session ...-fw4nm1g4-jo UID=4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo
                            2009-06-19 09:43:40,417 ERROR [org.jboss.messaging.util.ExceptionUtil] (http-0.0.0.0-8080-1) ConnectionFactoryEndpoint[jboss.messaging.connectionfactory:service=ConnectionFactory] createFailoverConnectionDelegate [uj-dh1mn4wf-1-ylp9t3wf-hb44uw-b53gs4]
                            javax.jms.JMSSecurityException: User null is NOT authenticated
                             at org.jboss.jms.server.jbosssx.JBossASSecurityMetadataStore.authenticate(JBossASSecurityMetadataStore.java:223)
                             at sun.reflect.GeneratedMethodAccessor316.invoke(Unknown Source)
                             at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
                             at java.lang.reflect.Method.invoke(Unknown Source)
                             at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
                             at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
                             at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(Unknown Source)
                             at com.sun.jmx.mbeanserver.PerInterface.invoke(Unknown Source)
                             at com.sun.jmx.mbeanserver.MBeanSupport.invoke(Unknown Source)
                             at javax.management.StandardMBean.invoke(Unknown Source)
                             at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164)
                             at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:668)
                             at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
                             at $Proxy106.authenticate(Unknown Source)
                             at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegateInternal(ServerConnectionFactoryEndpoint.java:233)
                             at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegate(ServerConnectionFactoryEndpoint.java:171)
                             at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.org$jboss$jms$server$endpoint$advised$ConnectionFactoryAdvised$createConnectionDelegate$aop(ConnectionFactoryAdvised.java:108)
                             at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.createConnectionDelegate(ConnectionFactoryAdvised.java)
                             at org.jboss.jms.wireformat.ConnectionFactoryCreateConnectionDelegateRequest.serverInvoke(ConnectionFactoryCreateConnectionDelegateRequest.java:91)
                             at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:143)
                             at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:908)
                             at org.jboss.remoting.transport.local.LocalClientInvoker.invoke(LocalClientInvoker.java:106)
                             at org.jboss.remoting.Client.invoke(Client.java:1708)
                             at org.jboss.remoting.Client.invoke(Client.java:612)
                             at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.org$jboss$jms$client$delegate$ClientConnectionFactoryDelegate$createConnectionDelegate$aop(ClientConnectionFactoryDelegate.java:171)
                             at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.invokeTarget(ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.java)
                             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111)
                             at org.jboss.jms.client.container.StateCreationAspect.handleCreateConnectionDelegate(StateCreationAspect.java:81)
                             at org.jboss.aop.advice.org.jboss.jms.client.container.StateCreationAspect_z_handleCreateConnectionDelegate_26294606.invoke(StateCreationAspect_z_handleCreateConnectionDelegate_26294606.java)
                             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
                             at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.createConnectionDelegate(ClientConnectionFactoryDelegate.java)
                             at org.jboss.jms.client.JBossConnectionFactory.createConnectionInternal(JBossConnectionFactory.java:205)
                             at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:87)
                             at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:82)
                             at com.paddypower.phase.api.InputMessageSender.sendMessage(InputMessageSender.java:60)
                             at com.paddypower.phase.test.servlet.TestMessageOneServlet.doGet(TestMessageOneServlet.java:99)
                             at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
                             at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                             at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                             at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                             at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
                             at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                             at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                             at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)
                             at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                             at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)
                             at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)
                             at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)
                             at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)
                             at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                             at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                             at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)
                             at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                             at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)
                             at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829)
                             at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:601)
                             at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
                             at java.lang.Thread.run(Unknown Source)
                            2009-06-19 09:43:40,419 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (http-0.0.0.0-8080-1) removing callback handler ServerInvokerCallbackHandler[4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo+4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr]
                            2009-06-19 09:43:40,419 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-1) removed org.jboss.remoting.transport.local.LocalClientInvoker@a5853c from registry
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.ServerInvoker] (http-0.0.0.0-8080-1) ServerInvoker (SocketServerInvoker[172.16.113.11:871825415]) removing client callback handler with session id of 4sg35b-wu44bh-fw3t9ply-1-fw4nm1g4-jo+4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr.
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (http-0.0.0.0-8080-1) unrecognized listener ID: 4sg35b-wu44bh-fw3t9ply-1-fw4nm1gh-jr
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-1) removed org.jboss.remoting.transport.local.LocalClientInvoker@ce2ca0 from registry
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] stopped threads in clientpool
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] stopped threads in threadpool
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] exiting
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.ServerInvoker] (http-0.0.0.0-8080-1) SocketServerInvoker[172.16.113.11:871825415] stopped
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-1) decremented org.jboss.remoting.transport.local.LocalClientInvoker@1e98793's count, current count 8
                            2009-06-19 09:43:40,420 DEBUG [org.jboss.remoting.InvokerRegistry] (http-0.0.0.0-8080-1) decremented org.jboss.remoting.transport.local.LocalClientInvoker@c3cb07's count, current count 8
                            


                            2009-06-19 09:44:15,554 FINE [sun.rmi.transport.tcp] (HDScanner) HDScanner: reuse connection
                            2009-06-19 09:44:15,556 FINE [sun.rmi.loader] (HDScanner) HDScanner: name = "org.jnp.interfaces.MarshalledValuePair", codebase = "http://jbdevapp1:8083/", defaultLoader = BaseClassLoader@186a6af{vfsfile:/opt/jboss-5.1.0.Beta1-jdk6/server/default/deploy/messaging/bridge-input-to-engine-service.xml}
                            2009-06-19 09:44:15,557 FINE [sun.rmi.loader] (HDScanner) HDScanner: name = "java.rmi.MarshalledObject", codebase = "http://jbdevapp1:8083/", defaultLoader = BaseClassLoader@186a6af{vfsfile:/opt/jboss-5.1.0.Beta1-jdk6/server/default/deploy/messaging/bridge-input-to-engine-service.xml}
                            2009-06-19 09:44:15,557 FINE [sun.rmi.loader] (HDScanner) HDScanner: name = "[B", codebase = "", defaultLoader = BaseClassLoader@186a6af{vfsfile:/opt/jboss-5.1.0.Beta1-jdk6/server/default/deploy/messaging/bridge-input-to-engine-service.xml}
                            2009-06-19 09:44:15,558 FINE [sun.rmi.client.ref] (HDScanner) HDScanner: free connection (reuse = true)
                            2009-06-19 09:44:15,558 FINE [sun.rmi.transport.tcp] (HDScanner) HDScanner: reuse connection
                            2009-06-19 09:44:15,558 FINE [sun.rmi.loader] (HDScanner) HDScanner: name = "org.jboss.jms.client.JBossConnectionFactory", codebase = "http://jbdevapp1:8083/", defaultLoader = BaseClassLoader@186a6af{vfsfile:/opt/jboss-5.1.0.Beta1-jdk6/server/default/deploy/messaging/bridge-input-to-engine-service.xml}
                            2009-06-19 09:44:15,561 FINE [sun.rmi.loader] (HDScanner) HDScanner: name = "org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate", codebase = "http://jbdevapp1:8083/", defaultLoader = BaseClassLoader@186a6af{vfsfile:/opt/jboss-5.1.0.Beta1-jdk6/server/default/deploy/messaging/bridge-input-to-engine-service.xml}
                            2009-06-19 09:44:15,562 FINE [sun.rmi.loader] (HDScanner) HDScanner: name = "org.jboss.jms.client.delegate.DelegateSupport", codebase = "http://jbdevapp1:8083/", defaultLoader = BaseClassLoader@186a6af{vfsfile:/opt/jboss-5.1.0.Beta1-jdk6/server/default/deploy/messaging/bridge-input-to-engine-service.xml}
                            2009-06-19 09:44:15,565 FINE [sun.rmi.loader] (HDScanner) HDScanner: name = "org.jboss.messaging.util.Version", codebase = "http://jbdevapp1:8083/", defaultLoader = BaseClassLoader@186a6af{vfsfile:/opt/jboss-5.1.0.Beta1-jdk6/server/default/deploy/messaging/bridge-input-to-engine-service.xml}
                            2009-06-19 09:44:15,571 DEBUG [org.jboss.remoting.MicroRemoteClientInvoker] (HDScanner) SocketClientInvoker[44a5e1, bisocket://jbdevapp1:4457] added client with session ID 4sg35m-ly74q9-fw3tcotx-1-fw4nmslr-nu to the lease pinger
                            2009-06-19 09:44:15,572 DEBUG [org.jboss.remoting.Client] (HDScanner) starting callback Connector: InvokerLocator [bisocket://172.16.113.22:396696380/callback?callbackServerHost=172.16.113.22&callbackServerPort=396696380&callbackServerProtocol=bisocket&clientMaxPoolSize=1&clientSocketClass=org.jboss.jms.client.remoting.ClientSocketWrapper&datatype=jms&guid=4sg35m-ly74q9-fw3tcotx-1-fw4nmslw-nw&isCallbackServer=true&onewayThreadPool=org.jboss.jms.server.remoting.DirectThreadPool&serverSocketClass=org.jboss.jms.server.remoting.ServerSocketWrapper]
                            2009-06-19 09:44:15,581 DEBUG [org.jboss.remoting.ServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] did not find server socket factory configuration as mbean service or classname. Creating default server socket factory.
                            2009-06-19 09:44:15,582 DEBUG [org.jboss.remoting.ServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] created server socket factory javax.net.DefaultServerSocketFactory@d6f833
                            2009-06-19 09:44:15,582 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] setting pingFrequency to 214748364
                            2009-06-19 09:44:15,582 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] setting pingWindowFactor to 10
                            2009-06-19 09:44:15,582 DEBUG [org.jboss.remoting.transport.Connector] (HDScanner) org.jboss.remoting.transport.Connector@ce6ecd started
                            2009-06-19 09:44:15,582 DEBUG [org.jboss.remoting.ServerInvoker] (HDScanner) ServerInvoker (SocketServerInvoker[172.16.113.22:396696380]) added client callback handler CallbackManager[13d4257] with session id of 4sg35m-ly74q9-fw3tcotx-1-fw4nmslr-nu+4sg35m-ly74q9-fw3tcotx-1-fw4nmsm6-nx and callback handle object of null.
                            2009-06-19 09:44:15,582 DEBUG [org.jboss.remoting.InvokerRegistry] (HDScanner) removed org.jboss.remoting.transport.local.LocalClientInvoker@1ab182a from registry
                            2009-06-19 09:44:15,582 DEBUG [org.jboss.remoting.transport.bisocket.BisocketClientInvoker] (HDScanner) getting secondary locator
                            2009-06-19 09:44:15,601 DEBUG [org.jboss.remoting.transport.bisocket.BisocketClientInvoker] (HDScanner) secondary locator: InvokerLocator [null://jbdevapp1:12746/?]
                            2009-06-19 09:44:15,601 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (HDScanner) creating control connection: InvokerLocator [null://jbdevapp1:12746/?]
                            2009-06-19 09:44:15,602 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] created control connection (4sg35m-ly74q9-fw3tcotx-1-fw4nmsm6-nx): Socket[addr=jbdevapp1/172.16.113.11,port=12746,localport=48393]
                            2009-06-19 09:44:15,718 DEBUG [org.jboss.remoting.ServerInvoker] (HDScanner) ServerInvoker (SocketServerInvoker[172.16.113.22:396696380]) removing client callback handler with session id of 4sg35m-ly74q9-fw3tcotx-1-fw4nmslr-nu+4sg35m-ly74q9-fw3tcotx-1-fw4nmsm6-nx.
                            2009-06-19 09:44:15,721 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] shutting down control connection: 4sg35m-ly74q9-fw3tcotx-1-fw4nmsm6-nx
                            2009-06-19 09:44:15,721 DEBUG [org.jboss.remoting.InvokerRegistry] (HDScanner) removed org.jboss.remoting.transport.local.LocalClientInvoker@1bd982 from registry
                            2009-06-19 09:44:15,721 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] stopped threads in clientpool
                            2009-06-19 09:44:15,722 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] stopped threads in threadpool
                            2009-06-19 09:44:15,722 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] exiting
                            2009-06-19 09:44:15,722 DEBUG [org.jboss.remoting.ServerInvoker] (HDScanner) SocketServerInvoker[172.16.113.22:396696380] stopped
                            2009-06-19 09:44:15,722 DEBUG [org.jboss.remoting.LeasePinger] (HDScanner) LeasePinger[SocketClientInvoker[44a5e1, bisocket://jbdevapp1:4457](4sg35m-ly74q9-fw3tcotx-1-fw3te7td-a1)] setting disconnect timeout to: -1
                            2009-06-19 09:44:15,737 DEBUG [org.jboss.remoting.InvokerRegistry] (HDScanner) decremented SocketClientInvoker[44a5e1, bisocket://jbdevapp1:4457]'s count, current count 3
                            2009-06-19 09:44:15,737 DEBUG [org.jboss.remoting.InvokerRegistry] (HDScanner) decremented SocketClientInvoker[1876083, bisocket://jbdevapp1:4457]'s count, current count 3
                            2009-06-19 09:44:15,737 WARN [org.jboss.jms.server.bridge.Bridge] (HDScanner) jboss.messaging:name=InputToEngineBridge,service=Bridge Failed to set up connections
                            javax.jms.JMSSecurityException: User null is NOT authenticated
                             at org.jboss.jms.server.jbosssx.JBossASSecurityMetadataStore.authenticate(JBossASSecurityMetadataStore.java:223)
                             at sun.reflect.GeneratedMethodAccessor316.invoke(Unknown Source)
                             at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
                             at java.lang.reflect.Method.invoke(Unknown Source)
                             at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
                             at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source)
                             at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(Unknown Source)
                             at com.sun.jmx.mbeanserver.PerInterface.invoke(Unknown Source)
                             at com.sun.jmx.mbeanserver.MBeanSupport.invoke(Unknown Source)
                             at javax.management.StandardMBean.invoke(Unknown Source)
                             at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164)
                             at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:668)
                             at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
                             at $Proxy106.authenticate(Unknown Source)
                             at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegateInternal(ServerConnectionFactoryEndpoint.java:233)
                             at org.jboss.jms.server.endpoint.ServerConnectionFactoryEndpoint.createConnectionDelegate(ServerConnectionFactoryEndpoint.java:171)
                             at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.org$jboss$jms$server$endpoint$advised$ConnectionFactoryAdvised$createConnectionDelegate$aop(ConnectionFactoryAdvised.java:108)
                             at org.jboss.jms.server.endpoint.advised.ConnectionFactoryAdvised.createConnectionDelegate(ConnectionFactoryAdvised.java)
                             at org.jboss.jms.wireformat.ConnectionFactoryCreateConnectionDelegateRequest.serverInvoke(ConnectionFactoryCreateConnectionDelegateRequest.java:91)
                             at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:143)
                             at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:908)
                             at org.jboss.remoting.transport.socket.ServerThread.completeInvocation(ServerThread.java:742)
                             at org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:695)
                             at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:549)
                             at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:230)
                             at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:206)
                             at org.jboss.remoting.Client.invoke(Client.java:1708)
                             at org.jboss.remoting.Client.invoke(Client.java:612)
                             at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.org$jboss$jms$client$delegate$ClientConnectionFactoryDelegate$createConnectionDelegate$aop(ClientConnectionFactoryDelegate.java:171)
                             at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.invokeTarget(ClientConnectionFactoryDelegate$createConnectionDelegate_N3019492359065420858.java)
                             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111)
                             at org.jboss.jms.client.container.StateCreationAspect.handleCreateConnectionDelegate(StateCreationAspect.java:81)
                             at org.jboss.aop.advice.org.jboss.jms.client.container.StateCreationAspect_z_handleCreateConnectionDelegate_11160700.invoke(StateCreationAspect_z_handleCreateConnectionDelegate_11160700.java)
                             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
                             at org.jboss.jms.client.delegate.ClientConnectionFactoryDelegate.createConnectionDelegate(ClientConnectionFactoryDelegate.java)
                             at org.jboss.jms.client.JBossConnectionFactory.createConnectionInternal(JBossConnectionFactory.java:205)
                             at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:87)
                             at org.jboss.jms.client.JBossConnectionFactory.createConnection(JBossConnectionFactory.java:82)
                             at org.jboss.jms.server.bridge.Bridge.createConnection(Bridge.java:893)
                             at org.jboss.jms.server.bridge.Bridge.setupJMSObjects(Bridge.java:1011)
                             at org.jboss.jms.server.bridge.Bridge.start(Bridge.java:320)
                             at org.jboss.jms.server.bridge.BridgeService.startService(BridgeService.java:336)
                             at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:376)
                             at org.jboss.system.ServiceMBeanSupport.start(ServiceMBeanSupport.java:269)
                             at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                             at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
                             at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
                             at java.lang.reflect.Method.invoke(Unknown Source)
                             at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:157)
                             at org.jboss.mx.server.Invocation.dispatch(Invocation.java:96)
                             at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:138)
                             at org.jboss.mx.server.Invocation.invoke(Invocation.java:90)
                             at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:140)
                             at org.jboss.mx.server.Invocation.invoke(Invocation.java:90)
                             at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
                             at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:668)
                             at org.jboss.system.microcontainer.ServiceProxy.invoke(ServiceProxy.java:206)
                             at $Proxy36.start(Unknown Source)
                             at org.jboss.system.microcontainer.StartStopLifecycleAction.installAction(StartStopLifecycleAction.java:42)
                             at org.jboss.system.microcontainer.StartStopLifecycleAction.installAction(StartStopLifecycleAction.java:37)
                             at org.jboss.dependency.plugins.action.SimpleControllerContextAction.simpleInstallAction(SimpleControllerContextAction.java:62)
                             at org.jboss.dependency.plugins.action.AccessControllerContextAction.install(AccessControllerContextAction.java:71)
                             at org.jboss.dependency.plugins.AbstractControllerContextActions.install(AbstractControllerContextActions.java:51)
                             at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:348)
                             at org.jboss.system.microcontainer.ServiceControllerContext.install(ServiceControllerContext.java:286)
                             at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:1598)
                             at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:934)
                             at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1062)
                             at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:984)
                             at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:822)
                             at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:553)
                             at org.jboss.system.ServiceController.doChange(ServiceController.java:688)
                             at org.jboss.system.ServiceController.start(ServiceController.java:460)
                             at org.jboss.system.deployers.ServiceDeployer.start(ServiceDeployer.java:163)
                             at org.jboss.system.deployers.ServiceDeployer.deploy(ServiceDeployer.java:99)
                             at org.jboss.system.deployers.ServiceDeployer.deploy(ServiceDeployer.java:46)
                             at org.jboss.deployers.spi.deployer.helpers.AbstractSimpleRealDeployer.internalDeploy(AbstractSimpleRealDeployer.java:62)
                             at org.jboss.deployers.spi.deployer.helpers.AbstractRealDeployer.deploy(AbstractRealDeployer.java:50)
                             at org.jboss.deployers.plugins.deployers.DeployerWrapper.deploy(DeployerWrapper.java:171)
                             at org.jboss.deployers.plugins.deployers.DeployersImpl.doDeploy(DeployersImpl.java:1439)
                             at org.jboss.deployers.plugins.deployers.DeployersImpl.doInstallParentFirst(DeployersImpl.java:1157)
                             at org.jboss.deployers.plugins.deployers.DeployersImpl.doInstallParentFirst(DeployersImpl.java:1178)
                             at org.jboss.deployers.plugins.deployers.DeployersImpl.install(DeployersImpl.java:1098)
                             at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:348)
                             at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:1598)
                             at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:934)
                             at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1062)
                             at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:984)
                             at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:822)
                             at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:553)
                             at org.jboss.deployers.plugins.deployers.DeployersImpl.process(DeployersImpl.java:781)
                             at org.jboss.deployers.plugins.main.MainDeployerImpl.process(MainDeployerImpl.java:698)
                             at org.jboss.system.server.profileservice.repository.MainDeployerAdapter.process(MainDeployerAdapter.java:117)
                             at org.jboss.system.server.profileservice.hotdeploy.HDScanner.scan(HDScanner.java:334)
                             at org.jboss.system.server.profileservice.hotdeploy.HDScanner.run(HDScanner.java:229)
                             at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
                             at java.util.concurrent.FutureTask$Sync.innerRunAndReset(Unknown Source)
                             at java.util.concurrent.FutureTask.runAndReset(Unknown Source)
                             at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(Unknown Source)
                             at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(Unknown Source)
                             at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
                             at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
                             at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
                             at java.lang.Thread.run(Unknown Source)
                            


                            • 11. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                              rnicholson10

                              Hey Howard,

                              Got a little further on figuring this out.

                              What I did is write a keep alive generator for the bridges so I could monitor them. Each bridge has a timer bean which send a message across the bridge at 10 second interval. Unfortunately this did not stop the bridges from failing but did let me highlight the point where the bridge went down.

                              2009-06-30 06:40:15,015 ERROR [org.jboss.remoting.transport.socket.ServerThread](WorkerThread#2[172.16.113.11:65011]) WorkerThread#2[172.16.113.11:65011] exception occurred during first invocation
                              
                              2009-06-30 06:42:48,530 ERROR [STDERR] (Timer-3) Exception in thread "Timer-3"
                              2009-06-30 06:42:48,530 ERROR [STDERR] (Timer-3) java.lang.IllegalStateException: org.jboss.remoting.ConnectionValidator.run() should not be called directly; use org.jboss.remoting.ConnectionValidator.addConnectionListener() instead.
                              
                              2009-06-30 06:42:48,531 ERROR [STDERR] (Timer-3) at org.jboss.remoting.ConnectionValidator.run(ConnectionValidator.java:289)
                              
                              2009-06-30 06:42:48,531 ERROR [STDERR] (Timer-3) at java.util.TimerThread.mainLoop(Unknown Source)
                              2009-06-30 06:42:48,531 ERROR [STDERR] (Timer-3) at java.util.TimerThread.run(Unknown Source)
                              2009-06-30 06:44:43,967 ERROR [STDERR] (Timer-12) Exception in thread "Timer-12"
                              2009-06-30 06:44:43,968 ERROR [STDERR] (Timer-12) java.lang.IllegalStateException: org.jboss.remoting.ConnectionValidator.run() should not be called directly; use org.jboss.remoting.ConnectionValidator.addConnectionListener() instead.
                              
                              2009-06-30 06:44:43,968 ERROR [STDERR] (Timer-12) at org.jboss.remoting.ConnectionValidator.run(ConnectionValidator.java:289)
                              
                              2009-06-30 06:44:43,968 ERROR [STDERR] (Timer-12) at java.util.TimerThread.mainLoop(Unknown Source)
                              2009-06-30 06:44:43,968 ERROR [STDERR] (Timer-12) at java.util.TimerThread.run(Unknown Source)
                              2009-06-30 07:03:06,112 ERROR [STDERR] (Timer-15) Exception in thread "Timer-15"
                              2009-06-30 07:03:06,112 ERROR [STDERR] (Timer-15) java.lang.IllegalStateException: org.jboss.remoting.ConnectionValidator.run() should not be called directly; use org.jboss.remoting.ConnectionValidator.addConnectionListener() instead.
                              
                              2009-06-30 07:03:06,226 ERROR [STDERR] (Timer-15) at org.jboss.remoting.ConnectionValidator.run(ConnectionValidator.java:289)
                              
                              2009-06-30 07:03:06,226 ERROR [STDERR] (Timer-15) at java.util.TimerThread.mainLoop(Unknown Source)
                              2009-06-30 07:03:06,227 ERROR [STDERR] (Timer-15) at java.util.TimerThread.run(Unknown Source)
                              2009-06-30 07:04:33,427 ERROR [org.jboss.jms.server.bridge.Bridge] (Thread-281) Failed to start source connection
                              


                              Hopefully this will give you enough info to help pinpoint where the error occurs. If you have any ideas for further tests let me know.

                              Cheers,

                              R.

                              • 12. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                                gaohoward

                                Hi, Thanks for the good info, I'll investigate.

                                Howard

                                • 13. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                                  rnicholson10

                                  Howard,

                                  Here's another error for you.

                                  This ones a little different to the others but happens occasionally.

                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.remoting.ServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) ServerInvoker (SocketServerInvoker[172.16.113.22:1241677967]) added client callback handler CallbackManager[15d09a2] with session id of 4sg35m-rs9red-fxcbs2e1-1-fxcvn6ar-20ot+4sg35m-rs9red-fxcbs2e1-1-fxcvn6b3-20ow and callback handle object of null.
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.remoting.InvokerRegistry] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) removed org.jboss.remoting.transport.local.LocalClientInvoker@bccf2c from registry
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) Session id for callback handler is 4sg35m-rs9red-fxcbs2e1-1-fxcvn6ar-20ot+4sg35m-rs9red-fxcbs2e1-1-fxcvn6b3-20ow
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6ar-20ot+4sg35m-rs9red-fxcbs2e1-1-fxcvn6b3-20ow] using callbackTimeout value 10000
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) DefaultCallbackErrorHandler[UNITIALIZED] setting server invoker to SocketServerInvoker[jbdevapp2:4457]
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) DefaultCallbackErrorHandler[SocketServerInvoker[jbdevapp2:4457]] setting callback handler to ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6ar-20ot+4sg35m-rs9red-fxcbs2e1-1-fxcvn6b3-20ow]
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) adding callback handler ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6ar-20ot+4sg35m-rs9red-fxcbs2e1-1-fxcvn6b3-20ow]
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) found calllback handler for remoting session ...-fxcvn6ar-20ot UID=4sg35m-rs9red-fxcbs2e1-1-fxcvn6ar-20ot
                                  2009-07-20 08:30:22,001 DEBUG [org.jboss.jms.server.connectionmanager.SimpleConnectionManager] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) registered connection ConnectionEndpoint[zo02-5b6nvcxf-1-1e2sbcxf-der9sr-m53gs4] as ...-fxcvn6ar-20ot
                                  2009-07-20 08:30:22,002 DEBUG [org.jboss.jms.server.jbosssx.JBossASSecurityMetadataStore] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) No SecurityMetadadata was available for phaseQueueToHandler, using default security config
                                  2009-07-20 08:30:22,013 DEBUG [org.jboss.remoting.Client] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) starting callback Connector: InvokerLocator [bisocket://172.16.113.22:640465832/callback?callbackServerHost=172.16.113.22&callbackServerPort=640465832&callbackServerProtocol=bisocket&clientMaxPoolSize=1&clientSocketClass=org.jboss.jms.client.remoting.ClientSocketWrapper&datatype=jms&guid=4sg35m-rs9red-fxcbs2e1-1-fxcvn6bh-20p3&isCallbackServer=true&onewayThreadPool=org.jboss.jms.server.remoting.DirectThreadPool&serverSocketClass=org.jboss.jms.server.remoting.ServerSocketWrapper]
                                  2009-07-20 08:30:22,017 DEBUG [org.jboss.remoting.ServerInvoker] (Thread-301) ServerInvoker (SocketServerInvoker[172.16.113.22:1340483958]) removing client callback handler with session id of 4sg35m-rs9red-fxcbs2e1-1-fxcvklqp-20gk+4sg35m-rs9red-fxcbs2e1-1-fxcvkq01-20gn.
                                  2009-07-20 08:30:22,020 DEBUG [org.jboss.remoting.ServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:640465832] did not find server socket factory configuration as mbean service or classname. Creating default server socket factory.
                                  2009-07-20 08:30:22,020 DEBUG [org.jboss.remoting.ServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:640465832] created server socket factory javax.net.DefaultServerSocketFactory@1ab05a3
                                  2009-07-20 08:30:22,020 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:640465832] setting pingFrequency to 214748364
                                  2009-07-20 08:30:22,020 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:640465832] setting pingWindowFactor to 10
                                  2009-07-20 08:30:22,020 DEBUG [org.jboss.remoting.transport.Connector] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) org.jboss.remoting.transport.Connector@1877170 started
                                  2009-07-20 08:30:22,026 DEBUG [org.jboss.remoting.ServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) ServerInvoker (SocketServerInvoker[172.16.113.22:640465832]) added client callback handler CallbackManager[1d38bec] with session id of 4sg35m-rs9red-fxcbs2e1-1-fxcvn6bh-20p1+4sg35m-rs9red-fxcbs2e1-1-fxcvn6bu-20p5 and callback handle object of null.
                                  2009-07-20 08:30:22,026 DEBUG [org.jboss.remoting.InvokerRegistry] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) removed org.jboss.remoting.transport.local.LocalClientInvoker@18675d1 from registry
                                  2009-07-20 08:30:22,026 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) Session id for callback handler is 4sg35m-rs9red-fxcbs2e1-1-fxcvn6bh-20p1+4sg35m-rs9red-fxcbs2e1-1-fxcvn6bu-20p5
                                  2009-07-20 08:30:22,026 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6bh-20p1+4sg35m-rs9red-fxcbs2e1-1-fxcvn6bu-20p5] using callbackTimeout value 10000
                                  2009-07-20 08:30:22,027 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) DefaultCallbackErrorHandler[UNITIALIZED] setting server invoker to SocketServerInvoker[jbdevapp2:4457]
                                  2009-07-20 08:30:22,027 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) DefaultCallbackErrorHandler[SocketServerInvoker[jbdevapp2:4457]] setting callback handler to ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6bh-20p1+4sg35m-rs9red-fxcbs2e1-1-fxcvn6bu-20p5]
                                  2009-07-20 08:30:22,027 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) adding callback handler ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6bh-20p1+4sg35m-rs9red-fxcbs2e1-1-fxcvn6bu-20p5]
                                  2009-07-20 08:30:22,027 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) found calllback handler for remoting session ...-fxcvn6bh-20p1 UID=4sg35m-rs9red-fxcbs2e1-1-fxcvn6bh-20p1
                                  2009-07-20 08:30:22,027 DEBUG [org.jboss.jms.server.connectionmanager.SimpleConnectionManager] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) registered connection ConnectionEndpoint[8p02-vb6nvcxf-1-1e2sbcxf-der9sr-m53gs4] as ...-fxcvn6bh-20p1
                                  2009-07-20 08:30:22,028 DEBUG [org.jboss.jms.server.jbosssx.JBossASSecurityMetadataStore] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) No SecurityMetadadata was available for phaseQueueToHandler, using default security config
                                  2009-07-20 08:30:22,029 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:1340483958] shutting down control connection: 4sg35m-rs9red-fxcbs2e1-1-fxcvkq01-20gn
                                  2009-07-20 08:30:22,030 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-301) removed org.jboss.remoting.transport.local.LocalClientInvoker@997c69 from registry
                                  2009-07-20 08:30:22,032 DEBUG [org.jboss.jms.server.remoting.ServerSocketWrapper] (Thread-301) wrote CLOSING byte
                                  2009-07-20 08:30:22,032 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (Thread-301) ServerSocketWrapper[Socket[addr=jbdevapp1/172.16.113.11,port=14053,localport=47580].b6d942] closing socket
                                  2009-07-20 08:30:22,032 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (Thread-301) ServerSocketWrapper[Socket[addr=jbdevapp1/172.16.113.11,port=14053,localport=47580].b6d942] closed socket
                                  2009-07-20 08:30:22,032 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:1340483958] stopped threads in clientpool
                                  2009-07-20 08:30:22,032 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:1340483958] stopped threads in threadpool
                                  2009-07-20 08:30:22,032 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:1340483958] exiting
                                  2009-07-20 08:30:22,034 DEBUG [org.jboss.remoting.ServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:1340483958] stopped
                                  2009-07-20 08:30:22,034 DEBUG [org.jboss.remoting.Client] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) starting callback Connector: InvokerLocator [bisocket://172.16.113.22:1327565408/callback?callbackServerHost=172.16.113.22&callbackServerPort=1327565408&callbackServerProtocol=bisocket&clientMaxPoolSize=1&clientSocketClass=org.jboss.jms.client.remoting.ClientSocketWrapper&datatype=jms&guid=4sg35m-rs9red-fxcbs2e1-1-fxcvn6c1-20pc&isCallbackServer=true&onewayThreadPool=org.jboss.jms.server.remoting.DirectThreadPool&serverSocketClass=org.jboss.jms.server.remoting.ServerSocketWrapper]
                                  2009-07-20 08:30:22,034 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-301) decremented SocketClientInvoker[499e67, bisocket://jbdevapp1:4457]'s count, current count 2
                                  2009-07-20 08:30:22,034 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-301) decremented SocketClientInvoker[9f7e61, bisocket://jbdevapp1:4457]'s count, current count 2
                                  2009-07-20 08:30:22,037 DEBUG [org.jboss.jms.server.connectionmanager.SimpleConnectionManager] (Thread-301) unregistered connection ConnectionEndpoint[ci02-zf5lvcxf-1-1e2sbcxf-der9sr-m53gs4] with remoting session ID ...-fxcvl5fn-20i6
                                  2009-07-20 08:30:22,039 ERROR [org.jboss.remoting.transport.socket.ServerThread] (WorkerThread#5[172.16.113.11:14053]) WorkerThread#5[172.16.113.11:14053] exception occurred during first invocation
                                  java.net.SocketException: Socket closed
                                   at java.net.SocketInputStream.socketRead0(Native Method)
                                   at java.net.SocketInputStream.read(Unknown Source)
                                   at java.io.BufferedInputStream.fill(Unknown Source)
                                   at java.io.BufferedInputStream.read(Unknown Source)
                                   at java.io.FilterInputStream.read(Unknown Source)
                                   at org.jboss.remoting.transport.socket.ServerThread.readVersion(ServerThread.java:1030)
                                   at org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:671)
                                   at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:522)
                                   at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:230)
                                  2009-07-20 08:30:22,045 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (Thread-301) removing callback handler ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvl5fn-20i6+4sg35m-rs9red-fxcbs2e1-1-fxcvl5fz-20i9]
                                  2009-07-20 08:30:22,047 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-301) removed org.jboss.remoting.transport.local.LocalClientInvoker@103591d from registry
                                  2009-07-20 08:30:22,047 DEBUG [org.jboss.remoting.ServerInvoker] (Thread-301) ServerInvoker (SocketServerInvoker[172.16.113.22:658454881]) removing client callback handler with session id of 4sg35m-rs9red-fxcbs2e1-1-fxcvl5fn-20i6+4sg35m-rs9red-fxcbs2e1-1-fxcvl5fz-20i9.
                                  2009-07-20 08:30:22,047 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (Thread-301) unrecognized listener ID: 4sg35m-rs9red-fxcbs2e1-1-fxcvl5fz-20i9
                                  2009-07-20 08:30:22,047 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-301) removed org.jboss.remoting.transport.local.LocalClientInvoker@cfa250 from registry
                                  2009-07-20 08:30:22,047 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:658454881] stopped threads in clientpool
                                  2009-07-20 08:30:22,047 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:658454881] stopped threads in threadpool
                                  2009-07-20 08:30:22,047 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:658454881] exiting
                                  2009-07-20 08:30:22,048 DEBUG [org.jboss.remoting.ServerInvoker] (Thread-301) SocketServerInvoker[172.16.113.22:658454881] stopped
                                  2009-07-20 08:30:22,049 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-301) decremented org.jboss.remoting.transport.local.LocalClientInvoker@1409d6c's count, current count 10045
                                  2009-07-20 08:30:22,049 DEBUG [org.jboss.remoting.InvokerRegistry] (Thread-301) decremented org.jboss.remoting.transport.local.LocalClientInvoker@11f38c4's count, current count 10045
                                  2009-07-20 08:30:22,049 WARN [org.jboss.jms.server.bridge.Bridge] (Thread-301) jboss.messaging:name=InputToEngineBridge,service=Bridge Will retry after a pause of 5000 ms
                                  2009-07-20 08:30:22,055 DEBUG [org.jboss.remoting.ServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:1327565408] did not find server socket factory configuration as mbean service or classname. Creating default server socket factory.
                                  2009-07-20 08:30:22,055 DEBUG [org.jboss.remoting.ServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:1327565408] created server socket factory javax.net.DefaultServerSocketFactory@1ab05a3
                                  2009-07-20 08:30:22,055 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:1327565408] setting pingFrequency to 214748364
                                  2009-07-20 08:30:22,055 DEBUG [org.jboss.remoting.transport.bisocket.BisocketServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) SocketServerInvoker[172.16.113.22:1327565408] setting pingWindowFactor to 10
                                  2009-07-20 08:30:22,055 DEBUG [org.jboss.remoting.transport.Connector] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) org.jboss.remoting.transport.Connector@af8552 started
                                  2009-07-20 08:30:22,060 DEBUG [org.jboss.ejb3.interceptors.aop.InterceptorSequencer] (WorkManager(2)-7) aroundInvoke [advisedMethod=public void com.paddypower.phase.engine.bean.mdb.HandlerAckMDB.onMessage(javax.jms.Message), unadvisedMethod=public void com.paddypower.phase.engine.bean.mdb.HandlerAckMDB.onMessage(javax.jms.Message), metadata=null, targetObject=com.paddypower.phase.engine.bean.mdb.HandlerAckMDB@14a1209, arguments=[Ljava.lang.Object;@1ed4999]
                                  2009-07-20 08:30:22,060 INFO [com.paddypower.phase.engine.bean.mdb.HandlerAckMDB] (WorkManager(2)-7) DestBridgeCheck:3:390139:344064:46075
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.remoting.ServerInvoker] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) ServerInvoker (SocketServerInvoker[172.16.113.22:1327565408]) added client callback handler CallbackManager[e252e2] with session id of 4sg35m-rs9red-fxcbs2e1-1-fxcvn6c1-20pa+4sg35m-rs9red-fxcbs2e1-1-fxcvn6cu-20pf and callback handle object of null.
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.remoting.InvokerRegistry] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) removed org.jboss.remoting.transport.local.LocalClientInvoker@1fd45e4 from registry
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) Session id for callback handler is 4sg35m-rs9red-fxcbs2e1-1-fxcvn6c1-20pa+4sg35m-rs9red-fxcbs2e1-1-fxcvn6cu-20pf
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.remoting.callback.ServerInvokerCallbackHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6c1-20pa+4sg35m-rs9red-fxcbs2e1-1-fxcvn6cu-20pf] using callbackTimeout value 10000
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) DefaultCallbackErrorHandler[UNITIALIZED] setting server invoker to SocketServerInvoker[jbdevapp2:4457]
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.remoting.callback.DefaultCallbackErrorHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) DefaultCallbackErrorHandler[SocketServerInvoker[jbdevapp2:4457]] setting callback handler to ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6c1-20pa+4sg35m-rs9red-fxcbs2e1-1-fxcvn6cu-20pf]
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) adding callback handler ServerInvokerCallbackHandler[4sg35m-rs9red-fxcbs2e1-1-fxcvn6c1-20pa+4sg35m-rs9red-fxcbs2e1-1-fxcvn6cu-20pf]
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.jms.server.remoting.JMSServerInvocationHandler] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) found calllback handler for remoting session ...-fxcvn6c1-20pa UID=4sg35m-rs9red-fxcbs2e1-1-fxcvn6c1-20pa
                                  2009-07-20 08:30:22,062 DEBUG [org.jboss.jms.server.connectionmanager.SimpleConnectionManager] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) registered connection ConnectionEndpoint[ip02-uc6nvcxf-1-1e2sbcxf-der9sr-m53gs4] as ...-fxcvn6c1-20pa
                                  2009-07-20 08:30:22,064 DEBUG [org.jboss.jms.server.jbosssx.JBossASSecurityMetadataStore] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) No SecurityMetadadata was available for phaseQueueToHandler, using default security config
                                  2009-07-20 08:30:22,064 DEBUG [org.jboss.jms.server.remoting.ServerSocketWrapper] (WorkerThread#5[172.16.113.11:14053]) cannot write CLOSING byte
                                  java.net.SocketException: Socket closed
                                   at java.net.SocketOutputStream.socketWrite(Unknown Source)
                                   at java.net.SocketOutputStream.write(Unknown Source)
                                   at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
                                   at java.io.BufferedOutputStream.flush(Unknown Source)
                                   at java.io.DataOutputStream.flush(Unknown Source)
                                   at org.jboss.jms.server.remoting.ServerSocketWrapper.close(ServerSocketWrapper.java:74)
                                   at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:653)
                                   at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:230)
                                  2009-07-20 08:30:22,065 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (WorkerThread#5[172.16.113.11:14053]) ServerSocketWrapper[Socket[addr=jbdevapp1/172.16.113.11,port=14053,localport=47580].b6d942] closing socket
                                  2009-07-20 08:30:22,065 DEBUG [org.jboss.remoting.transport.socket.SocketWrapper] (WorkerThread#5[172.16.113.11:14053]) ServerSocketWrapper[Socket[addr=jbdevapp1/172.16.113.11,port=14053,localport=47580].b6d942] closed socket
                                  2009-07-20 08:30:22,065 DEBUG [org.jboss.remoting.transport.socket.ServerThread] (WorkerThread#5[172.16.113.11:14053]) WorkerThread#5[172.16.113.11:14053] closed socketWrapper: ServerSocketWrapper[Socket[addr=jbdevapp1/172.16.113.11,port=14053,localport=47580].b6d942]
                                  2009-07-20 08:30:22,066 DEBUG [org.jboss.ejb.txtimer.TimerImpl] (EJB-Timer-1248041699774[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3]) Timer was not registered with Tx, resetting state: [id=1248041699774,target=[target=jboss.j2ee:ear=phase-engine.ear,jar=phase-engine.jar,name=DestBridgeCheckTimerBean,service=EJB3],remaining=83,periode=10000,in_timeout]
                                  


                                  • 14. Re: Serious idle problem with Bridges on AS 5.1.0.Beta
                                    gaohoward

                                    Sorry I haven't got time to go further with your log, I'll hopeuflly come back soon. On a glimpse at the info I think it showed some network problem.

                                    Thanks!

                                    Howard

                                    1 2 Previous Next