5 Replies Latest reply on May 30, 2012 1:17 PM by Andy Taylor

    java.lang.IllegalStateException: Connection is null -> at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)

    Lukasz Kaleta Newbie

      Hi

       

      We are having some trouble with JMS Queue.

      We are using Seam-JMS for sending messages and MDB for recivig messages

       

      This is our configuration for Hornet

      
      <subsystem xmlns="urn:jboss:domain:messaging:1.1">
      
      
      <hornetq-server>
      
      
      <persistence-enabled>true</persistence-enabled>
      
      
      <journal-file-size>102400</journal-file-size>
      
      
      <journal-min-files>2</journal-min-files>
      
      
      
      
      <connectors>
      
      
      <netty-connector name="netty" socket-binding="messaging"/>
      
      
      <netty-connector name="netty-throughput" socket-binding="messaging-throughput">
      
      
      <param key="batch-delay" value="50"/>
      
      
      </netty-connector>
      
      
      <in-vm-connector name="in-vm" server-id="0"/>
      
      
      </connectors>
      
      
      
      
      <acceptors>
      
      
      <netty-acceptor name="netty" socket-binding="messaging"/>
      
      
      <netty-acceptor name="netty-throughput" socket-binding="messaging-throughput">
      
      
      <param key="batch-delay" value="50"/>
      
      
      <param key="direct-deliver" value="false"/>
      
      
      </netty-acceptor>
      
      
      <in-vm-acceptor name="in-vm" server-id="0"/>
      
      
      </acceptors>
      
      
      
      
      <security-settings>
      
      
      <security-setting match="#">
      
      
      <permission type="send" roles="guest"/>
      
      
      <permission type="consume" roles="guest"/>
      
      
      <permission type="createNonDurableQueue" roles="guest"/>
      
      
      <permission type="deleteNonDurableQueue" roles="guest"/>
      
      
      </security-setting>
      
      
      </security-settings>
      
      
      
      
      <address-settings>
      
      
      <address-setting match="#">
      
      
      <dead-letter-address>jms.queue.DLQ</dead-letter-address>
      
      
      <expiry-address>jms.queue.ExpiryQueue</expiry-address>
      
      
      <redelivery-delay>0</redelivery-delay>
      
      
      <max-size-bytes>10485760</max-size-bytes>
      
      
      <page-size-bytes>1048576</page-size-bytes>
      
      
      <address-full-policy>PAGE</address-full-policy>
      
      
      <message-counter-history-day-limit>10</message-counter-history-day-limit>
      
      
      </address-setting>
      
      
      </address-settings>
      
      
      
      
      <jms-connection-factories>
      
      
      <connection-factory name="InVmConnectionFactory">
      
      
      <connectors>
      
      
      <connector-ref connector-name="in-vm"/>
      
      
      </connectors>
      
      
      <entries>
      
      
      <entry name="java:/ConnectionFactory"/>
      
      
      </entries>
      
      
      </connection-factory>
      
      
      <connection-factory name="RemoteConnectionFactory">
      
      
      <connectors>
      
      
      <connector-ref connector-name="netty"/>
      
      
      </connectors>
      
      
      <entries>
      
      
      <entry name="RemoteConnectionFactory"/>
      
      
      <entry name="java:jboss/exported/jms/RemoteConnectionFactory"/>
      
      
      </entries>
      
      
      </connection-factory>
      
      
      <pooled-connection-factory name="hornetq-ra">
      
      
      <transaction mode="xa"/>
      
      
      <connectors>
      
      
      <connector-ref connector-name="in-vm"/>
      
      
      </connectors>
      
      
      <entries>
      
      
      <entry name="java:/JmsXA"/>
      
      
      </entries>
      
      
      </pooled-connection-factory>
      
      
      </jms-connection-factories>
      
      
      
      
      <jms-destinations>
      
      
      <jms-queue name="testQueue">
      
      
      <entry name="queue/test"/>
      
      
      <entry name="java:jboss/exported/jms/queue/test"/>
      
      
      </jms-queue>
      
      
      <jms-queue name="sendMailQueue">
      
      
      <entry name="queue/sendMail"/>
      
      
      <entry name="java:jboss/exported/jms/queue/sendMail"/>
      
      
      </jms-queue>
      
      
      <jms-topic name="testTopic">
      
      
      <entry name="topic/test"/>
      
      
      <entry name="java:jboss/exported/jms/topic/test"/>
      
      
      </jms-topic>
      
      
      </jms-destinations>
      
      
      </hornetq-server>
      
      
      </subsystem>
      
      

       

      This is the code responsible for sending JMS Message:

       

      
      final static String MAIL_JMS_DESTINATION = "queue/sendMail";
      
      
      
      
      @EventRouting
      
      
      public Route registerMyEventRoute(RouteManager routeManager) {
      
      
      return routeManager.createRoute(RouteType.EGRESS, AsyncEmailMessage.class).addDestinationJndiName(MAIL_JMS_DESTINATION);
      
      
      }
      
      

       

      Seam JMS have application scoped Connection, and it create new JMS Session on each send:

       

       

      
      @Inject
      
      
      Connection connection;
      
      
      
      
      @Produces
      
      
      @Dependent
      
      
      @JmsDefault("session")
      
      
      public Session produceSession() throws JMSException {
      
      
      return connection.createSession(false, Session.AUTO_ACKNOWLEDGE);
      
      
      }
      
      

       

      The consequence of current problem, is that we need to restart server every 3rd day.

      The following exception is thrown:

       

       

      java.lang.IllegalStateException: Connection is null
       at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)
       at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSession(ClientSessionFactoryImpl.java:279)
       at org.hornetq.jms.client.HornetQConnection.createSessionInternal(HornetQConnection.java:513)
       at org.hornetq.jms.client.HornetQConnection.createSession(HornetQConnection.java:161)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.weld.bean.proxy.AbstractBeanInstance.invoke(AbstractBeanInstance.java:44)
       at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:105)
       at org.jboss.weld.proxies.Connection$-805239239$Proxy$$$_WeldClientProxy.createSession(Connection$-805239239$Proxy$$$_WeldClientProxy.java)
       at org.jboss.seam.jms.inject.JmsSessionProducer.produceSession(JmsSessionProducer.java:33)
       at sun.reflect.GeneratedMethodAccessor1660.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.weld.util.reflection.SecureReflections$13.work(SecureReflections.java:264)
       at org.jboss.weld.util.reflection.SecureReflectionAccess.run(SecureReflectionAccess.java:52)
       at org.jboss.weld.util.reflection.SecureReflectionAccess.runAsInvocation(SecureReflectionAccess.java:137)
       at org.jboss.weld.util.reflection.SecureReflections.invoke(SecureReflections.java:260)
       at org.jboss.weld.introspector.jlr.WeldMethodImpl.invokeOnInstance(WeldMethodImpl.java:170)
       at org.jboss.weld.injection.MethodInjectionPoint.invokeOnInstance(MethodInjectionPoint.java:137)
       at org.jboss.weld.bean.ProducerMethod$1.produce(ProducerMethod.java:133)
       at org.jboss.weld.bean.AbstractProducerBean.create(AbstractProducerBean.java:299)
       at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:61)
       at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:616)
       at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:681)
       at org.jboss.weld.injection.FieldInjectionPoint.inject(FieldInjectionPoint.java:118)
       at org.jboss.weld.util.Beans.injectBoundFields(Beans.java:703)
       at org.jboss.weld.util.Beans.injectFieldsAndInitializers(Beans.java:712)
       at org.jboss.weld.bean.ManagedBean$ManagedBeanInjectionTarget$1$1.proceed(ManagedBean.java:161)
       at org.jboss.weld.injection.InjectionContextImpl.run(InjectionContextImpl.java:48)
       at org.jboss.weld.bean.ManagedBean$ManagedBeanInjectionTarget$1.work(ManagedBean.java:157)
       at org.jboss.weld.bean.ManagedBean$FixInjectionPoint.run(ManagedBean.java:131)
       at org.jboss.weld.bean.ManagedBean$ManagedBeanInjectionTarget.inject(ManagedBean.java:153)
       at org.jboss.weld.bean.ManagedBean.create(ManagedBean.java:290)
       at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:61)
       at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:616)
       at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:643)
       at org.jboss.seam.jms.bridge.EgressRoutingObserver.getMessageBuilder(EgressRoutingObserver.java:118)
       at org.jboss.seam.jms.bridge.EgressRoutingObserver.forwardEvent(EgressRoutingObserver.java:159)
       at org.jboss.seam.jms.bridge.EgressRoutingObserver.notify(EgressRoutingObserver.java:106)
       at org.jboss.weld.manager.BeanManagerImpl.notifyObservers(BeanManagerImpl.java:569)
       at org.jboss.weld.manager.BeanManagerImpl.fireEvent(BeanManagerImpl.java:564)
       at org.jboss.weld.event.EventImpl.fire(EventImpl.java:68)
       at com.parts.profile.registration.PrincipalRegistrationProcess.sendSuccessMail(PrincipalRegistrationProcess.java:145)
       at com.parts.profile.registration.PrincipalRegistrationProcess.save(PrincipalRegistrationProcess.java:105)
       at com.parts.profile.registration.PrincipalRegistrationProcess$Proxy$$$_WeldClientProxy.save(PrincipalRegistrationProcess$Proxy$$$_WeldClientProxy.java)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.apache.el.parser.AstValue.invoke(AstValue.java:262)
       at org.apache.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:278)
       at org.jboss.weld.util.el.ForwardingMethodExpression.invoke(ForwardingMethodExpression.java:39)
       at org.jboss.weld.el.WeldMethodExpression.invoke(WeldMethodExpression.java:50)
       at com.sun.faces.facelets.el.TagMethodExpression.invoke(TagMethodExpression.java:105)
       at javax.faces.component.MethodBindingMethodExpressionAdapter.invoke(MethodBindingMethodExpressionAdapter.java:88)
       at com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:102)
       at javax.faces.component.UICommand.broadcast(UICommand.java:315)
       at javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:794)
       at javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:1259)
       at com.sun.faces.lifecycle.InvokeApplicationPhase.execute(InvokeApplicationPhase.java:81)
       at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)
       at com.sun.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:118)
       at javax.faces.webapp.FacesServlet.service(FacesServlet.java:593)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at org.primefaces.webapp.filter.FileUploadFilter.doFilter(FileUploadFilter.java:79)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at com.musific.webapp.filter.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:23)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at org.jboss.weld.servlet.ConversationPropagationFilter.doFilter(ConversationPropagationFilter.java:62)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at org.jboss.solder.servlet.exception.CatchExceptionFilter.doFilter(CatchExceptionFilter.java:65)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at org.jboss.solder.servlet.event.ServletEventBridgeFilter.doFilter(ServletEventBridgeFilter.java:74)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at com.ocpsoft.pretty.PrettyFilter.doFilter(PrettyFilter.java:145)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at com.musific.webapp.filter.ResponseTimeLoggingFilter.doFilter(ResponseTimeLoggingFilter.java:32)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at com.musific.webapp.filter.DisableUrlSessionFilter.doFilter(DisableUrlSessionFilter.java:130)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at com.musific.webapp.filter.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:23)
       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
       at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275)
       at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161)
       at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50)
       at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153)
       at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155)
       at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
       at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
       at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368)
       at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:505)
       at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:445)
       at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930)
       at java.lang.Thread.run(Thread.java:662)
      

       

      Please give me some hints how this can be solved.

        • 1. Re: java.lang.IllegalStateException: Connection is null -> at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)
          Andy Taylor Master

          It looks like the connection is being closed at some point, maybe a network issue? are there anyother errors in the server log?

          • 2. Re: java.lang.IllegalStateException: Connection is null -> at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)
            Lukasz Kaleta Newbie

            Yes, there is something which may be interested. The hornet WARNING/ERROR activity i logs starts day before:

             

             

            16:06:36,873 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1bf02e6-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,008 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findPreferredCommunicationChannelByUsernameAndType was 100 [ms]
            16:06:37,060 INFO  [com.musific.dashboard.bean.DashboardManager] (ajp--127.0.0.1-8009-5) The Session Timeout was set to '1200' during onLogin
            16:06:37,151 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1bf02e6-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,520 INFO  [com.musific.webapp.session.DefaultLocaleService] (ajp--127.0.0.1-8009-9) Session fou9ydEhUlqVLIw2PXMaAjWw.undefined Initialized isNew: true
            16:06:37,537 INFO  [com.musific.dashboard.bean.DashboardManager] (ajp--127.0.0.1-8009-5) The Default Conversation Timeout was set from '900000'ms to '900000'ms during onLogin
            16:06:37,540 INFO  [com.musific.webapp.session.DefaultLocaleService] (ajp--127.0.0.1-8009-9) Cookie Locale is set to: null
            16:06:37,577 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-16) Request completed in [1.004] seconds: [/login]
            16:06:37,588 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:37,599 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) Event fires observer for current user onLogin 'Mortn'
            16:06:37,609 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session d107281c-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,617 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session d107281c-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,619 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findDistinctNarrowDataForBusinessUnitsInIdentityObjectRelationshipsByUsername was 0 [ms]
            16:06:37,638 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:37,659 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1c0b098-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,671 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1c0b098-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,677 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:37,695 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1e80ebe-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,703 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1e80ebe-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,710 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:37,645 WARN  [org.hornetq.jms.server.recovery.HornetQXAResourceWrapper] (Thread-391 (HornetQ-client-global-threads-1717898838)) Notified of connection failure in xa recovery connectionFactory for provider ClientSessionFactoryImpl [serverLocator=ServerLocatorImpl [initialConnectors=[org-hornetq-core-remoting-impl-invm-InVMConnectorFactory?server-id=0], discoveryGroupConfiguration=null], connectorConfig=org-hornetq-core-remoting-impl-invm-InVMConnectorFactory?server-id=0, backupConfig=null] will attempt reconnect on next pass: HornetQException[errorCode=2 message=Channel disconnected]
                at org.hornetq.core.client.impl.ClientSessionFactoryImpl.connectionDestroyed(ClientSessionFactoryImpl.java:380) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.core.remoting.impl.invm.InVMConnector$Listener$1.run(InVMConnector.java:203) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.utils.OrderedExecutorFactory$OrderedExecutor$1.run(OrderedExecutorFactory.java:100) [hornetq-core-2.2.13.Final.jar:]
                at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_26]
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_26]
                at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_26]
            
            16:06:37,748 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f20e3466-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,733 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User is member in 1 number of units
            16:06:37,774 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User 'Mortn' has default business unit 'Musific's Dummy Manager'
            16:06:37,777 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f20e3466-a4d2-11e1-a02a-8e4bfde28217
            16:06:37,980 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitById was 1 [ms]
            16:06:38,018 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,046 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1f29610-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,049 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1f29610-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,065 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,074 INFO  [com.musific.timezone.bean.LocaleSwitcherBean] (ajp--127.0.0.1-8009-9) Cookie Locale was set to: null
            16:06:38,097 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f7ebf98d-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,099 ERROR [com.musific.webapp.session.DefaultLocaleService] (ajp--127.0.0.1-8009-9) RESTORE: Attempted to inject an HttpServletResponse before it has been initialized.
            16:06:38,115 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findIdentityObjectRelationships was 35 [ms]
            16:06:38,112 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f7ebf98d-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,143 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User: Mortn is GRANTED for unitId: 1031 with RoleType: CommunicationResponsible, GroupName: Unit, GroupType: GROUP
            16:06:38,149 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User: Mortn is GRANTED for unitId: 1031 with RoleType: Member, GroupName: Unit, GroupType: GROUP
            16:06:38,149 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f7f4d32e-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,177 INFO  [com.parts.security.authentication.PartsIdmAuthenticator] (ajp--127.0.0.1-8009-5) Login successful for user mortn
            16:06:38,197 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f7f4d32e-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,220 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session fcf704bf-a527-11e1-a02a-8e4bfde28217
            16:06:38,225 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-9) Request completed in [1.628] seconds: [/search]
            16:06:38,243 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session fcf704bf-a527-11e1-a02a-8e4bfde28217
            16:06:38,247 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session fd5d8ec1-a527-11e1-a02a-8e4bfde28217
            16:06:38,252 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session fd5d8ec1-a527-11e1-a02a-8e4bfde28217
            16:06:38,262 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session e81527d3-a52c-11e1-a02a-8e4bfde28217
            16:06:38,271 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session e81527d3-a52c-11e1-a02a-8e4bfde28217
            16:06:38,275 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session e833fa75-a52c-11e1-a02a-8e4bfde28217
            16:06:38,280 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session e833fa75-a52c-11e1-a02a-8e4bfde28217
            16:06:38,284 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 1aabcf87-a566-11e1-a02a-8e4bfde28217
            16:06:38,288 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 1aabcf87-a566-11e1-a02a-8e4bfde28217
            16:06:38,292 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 28cd5d49-a566-11e1-a02a-8e4bfde28217
            16:06:38,297 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 28cd5d49-a566-11e1-a02a-8e4bfde28217
            16:06:38,301 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 2d9e946b-a566-11e1-a02a-8e4bfde28217
            16:06:38,313 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) Call to onUserUpdateComplete for user Mortn
            16:06:38,322 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [157.088] seconds: [/login]
            16:06:38,328 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 2d9e946b-a566-11e1-a02a-8e4bfde28217
            16:06:38,332 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 31681f8d-a566-11e1-a02a-8e4bfde28217
            16:06:38,337 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 31681f8d-a566-11e1-a02a-8e4bfde28217
            16:06:38,342 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 3752b5ef-a566-11e1-a02a-8e4bfde28217
            16:06:38,347 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 3752b5ef-a566-11e1-a02a-8e4bfde28217
            16:06:38,351 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 1c38ddc1-a59e-11e1-a02a-8e4bfde28217
            16:06:38,355 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 1c38ddc1-a59e-11e1-a02a-8e4bfde28217
            16:06:38,360 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 1c53dfd3-a59e-11e1-a02a-8e4bfde28217
            16:06:38,365 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 1c53dfd3-a59e-11e1-a02a-8e4bfde28217
            16:06:38,369 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f90d2335-a5a5-11e1-a02a-8e4bfde28217
            16:06:38,373 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f90d2335-a5a5-11e1-a02a-8e4bfde28217
            16:06:38,377 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f92a2117-a5a5-11e1-a02a-8e4bfde28217
            16:06:38,382 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f92a2117-a5a5-11e1-a02a-8e4bfde28217
            16:06:38,386 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session a6753ec9-a5e9-11e1-a02a-8e4bfde28217
            16:06:38,391 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session a6753ec9-a5e9-11e1-a02a-8e4bfde28217
            16:06:38,395 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 9991c72b-a669-11e1-a02a-8e4bfde28217
            16:06:38,399 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 9991c72b-a669-11e1-a02a-8e4bfde28217
            16:06:38,404 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session ec7f054d-a89b-11e1-a02a-8e4bfde28217
            16:06:38,408 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session ec7f054d-a89b-11e1-a02a-8e4bfde28217
            16:06:38,414 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,426 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1a2ef60-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,439 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1a2ef60-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,443 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,462 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1b47b92-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,466 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1b47b92-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,480 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,488 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1d54a0c-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,502 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1d54a0c-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,506 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,541 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1ca9baa-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,545 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1ca9baa-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,558 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,568 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f2175c28-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,577 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f2175c28-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,590 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,610 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f0de18be-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,615 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f0de18be-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,630 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
            16:06:38,656 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f22abd1a-a4d2-11e1-a02a-8e4bfde28217
            16:06:38,671 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f22abd1a-a4d2-11e1-a02a-8e4bfde28217
            16:06:46,790 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
            Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
                at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
                ... 7 more
            
            16:08:56,840 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
            Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
                at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
                ... 7 more
            
            16:10:16,334 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
            16:10:16,347 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
            16:10:16,459 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.127] seconds: [/login]
            16:11:06,923 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
            Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
                at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
                ... 7 more
            
            16:13:01,148 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
            16:13:01,160 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
            16:13:01,197 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.052] seconds: [/login]
            16:13:04,468 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /index.jsf 
            16:13:04,473 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) Authorized request to: /index.jsf. Will be redirected to home!
            16:13:04,480 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /index.jsf 
            16:13:04,485 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) Authorized request to: /index.jsf. Will be redirected to home!
            16:13:04,491 WARN  [com.musific.exception.ConversationExceptionHandler] (ajp--127.0.0.1-8009-5) Something bad happened IllegalStateException: null
            16:13:04,500 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.034] seconds: [/index]
            16:13:04,590 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /protected/dashboard/home.jsf 
            16:13:04,607 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /protected/dashboard/home.jsf 
            16:13:04,645 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 22 [ms]
            16:13:04,670 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 7 [ms]
            16:13:04,693 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 1 [ms]
            16:13:04,719 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 1 [ms]
            16:13:04,801 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) Count unread query for userId: 1017, unitId: 1031
            16:13:04,823 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) prepareMessageStatement: userId: 1017, unitId: 1031, includeSenderStatement: false, types: DRAFT, SENDING, PENDING
            16:13:04,926 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) Inbox query for userId: 1017, unitId: 1031
            16:13:04,934 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) prepareMessageStatement: userId: 1017, unitId: 1031, includeSenderStatement: false, types: DRAFT, SENDING, PENDING
            16:13:04,992 INFO  [com.parts.contract.bean.PerformanceContractInbox] (ajp--127.0.0.1-8009-5) Contract Inbox loaded for Musific's Dummy Manager
            16:13:05,006 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findDistinctNarrowDataForBusinessUnitsInIdentityObjectRelationshipsByUsername was 0 [ms]
            16:13:05,016 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findDistinctMemberPriveligesForBusinessUnitsInIdentityObjectRelationships was 0 [ms]
            16:13:05,025 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findCommunicationChannelsByUserId was 0 [ms]
            16:13:05,030 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findCommunicationChannelsByUserId was 0 [ms]
            16:13:05,037 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findAddressesForUnit was 0 [ms]
            16:13:05,042 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitProfileImageCount was 1 [ms]
            16:13:05,060 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.472] seconds: [/home]
            16:13:05,571 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.0010] seconds: [/seam/resource/remoting/resource/remote.js]
            16:13:05,723 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-16) Request completed in [0.0010] seconds: [/seam/resource/remoting/interface.js]
            16:13:05,737 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.0010] seconds: [/seam/resource/remoting/interface.js]
            16:13:16,981 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
                at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
            Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
                at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
                at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
                ... 7 more
            
            16:13:32,311 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-16) path: /protected/dashboard/home.jsf 
            16:13:32,317 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-16) path: /protected/dashboard/home.jsf 
            16:13:32,330 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-16) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 6 [ms]
            

             

            Please advise how to proced ?

            • 3. Re: java.lang.IllegalStateException: Connection is null -> at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)
              Andy Taylor Master

              this line here

               

              Client connection failed, clearing up resources for session f1bf02e6-a4d2-11e1-a02a-8e4bfde28217

              Tells me that for some reason the connection has been destroyed, there are many reasons for this, network issue, memory issues, bad code etc, I can't really help you without more info, you will need to inverstigate why the connection is being destroyed

              • 4. Re: java.lang.IllegalStateException: Connection is null -> at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)
                Lukasz Kaleta Newbie

                There is also one line which I miss in mine previous paste:

                 

                16:06:36,835 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
                

                 

                Maybe it will tell more (?)

                • 5. Re: java.lang.IllegalStateException: Connection is null -> at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)
                  Andy Taylor Master

                  it tells me the same thing, the client connection is being closed, you need to tune your app to deal with  what ever problems you are having, I dont know what your app is doing so cant really help you.