java.lang.IllegalStateException: Connection is null -> at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)

[lukaszk]

Hi

We are having some trouble with JMS Queue.

We are using Seam-JMS for sending messages and MDB for recivig messages

This is our configuration for Hornet

<subsystem xmlns="urn:jboss:domain:messaging:1.1">


<hornetq-server>


<persistence-enabled>true</persistence-enabled>


<journal-file-size>102400</journal-file-size>


<journal-min-files>2</journal-min-files>




<connectors>


<netty-connector name="netty" socket-binding="messaging"/>


<netty-connector name="netty-throughput" socket-binding="messaging-throughput">


<param key="batch-delay" value="50"/>


</netty-connector>


<in-vm-connector name="in-vm" server-id="0"/>


</connectors>




<acceptors>


<netty-acceptor name="netty" socket-binding="messaging"/>


<netty-acceptor name="netty-throughput" socket-binding="messaging-throughput">


<param key="batch-delay" value="50"/>


<param key="direct-deliver" value="false"/>


</netty-acceptor>


<in-vm-acceptor name="in-vm" server-id="0"/>


</acceptors>




<security-settings>


<security-setting match="#">


<permission type="send" roles="guest"/>


<permission type="consume" roles="guest"/>


<permission type="createNonDurableQueue" roles="guest"/>


<permission type="deleteNonDurableQueue" roles="guest"/>


</security-setting>


</security-settings>




<address-settings>


<address-setting match="#">


<dead-letter-address>jms.queue.DLQ</dead-letter-address>


<expiry-address>jms.queue.ExpiryQueue</expiry-address>


<redelivery-delay>0</redelivery-delay>


<max-size-bytes>10485760</max-size-bytes>


<page-size-bytes>1048576</page-size-bytes>


<address-full-policy>PAGE</address-full-policy>


<message-counter-history-day-limit>10</message-counter-history-day-limit>


</address-setting>


</address-settings>




<jms-connection-factories>


<connection-factory name="InVmConnectionFactory">


<connectors>


<connector-ref connector-name="in-vm"/>


</connectors>


<entries>


<entry name="java:/ConnectionFactory"/>


</entries>


</connection-factory>


<connection-factory name="RemoteConnectionFactory">


<connectors>


<connector-ref connector-name="netty"/>


</connectors>


<entries>


<entry name="RemoteConnectionFactory"/>


<entry name="java:jboss/exported/jms/RemoteConnectionFactory"/>


</entries>


</connection-factory>


<pooled-connection-factory name="hornetq-ra">


<transaction mode="xa"/>


<connectors>


<connector-ref connector-name="in-vm"/>


</connectors>


<entries>


<entry name="java:/JmsXA"/>


</entries>


</pooled-connection-factory>


</jms-connection-factories>




<jms-destinations>


<jms-queue name="testQueue">


<entry name="queue/test"/>


<entry name="java:jboss/exported/jms/queue/test"/>


</jms-queue>


<jms-queue name="sendMailQueue">


<entry name="queue/sendMail"/>


<entry name="java:jboss/exported/jms/queue/sendMail"/>


</jms-queue>


<jms-topic name="testTopic">


<entry name="topic/test"/>


<entry name="java:jboss/exported/jms/topic/test"/>


</jms-topic>


</jms-destinations>


</hornetq-server>


</subsystem>

This is the code responsible for sending JMS Message:

final static String MAIL_JMS_DESTINATION = "queue/sendMail";




@EventRouting


public Route registerMyEventRoute(RouteManager routeManager) {


return routeManager.createRoute(RouteType.EGRESS, AsyncEmailMessage.class).addDestinationJndiName(MAIL_JMS_DESTINATION);


}

Seam JMS have application scoped Connection, and it create new JMS Session on each send:

@Inject


Connection connection;




@Produces


@Dependent


@JmsDefault("session")


public Session produceSession() throws JMSException {


return connection.createSession(false, Session.AUTO_ACKNOWLEDGE);


}

The consequence of current problem, is that we need to restart server every 3rd day.

The following exception is thrown:

java.lang.IllegalStateException: Connection is null
 at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSessionInternal(ClientSessionFactoryImpl.java:745)
 at org.hornetq.core.client.impl.ClientSessionFactoryImpl.createSession(ClientSessionFactoryImpl.java:279)
 at org.hornetq.jms.client.HornetQConnection.createSessionInternal(HornetQConnection.java:513)
 at org.hornetq.jms.client.HornetQConnection.createSession(HornetQConnection.java:161)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
 at org.jboss.weld.bean.proxy.AbstractBeanInstance.invoke(AbstractBeanInstance.java:44)
 at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:105)
 at org.jboss.weld.proxies.Connection$-805239239$Proxy$$$_WeldClientProxy.createSession(Connection$-805239239$Proxy$$$_WeldClientProxy.java)
 at org.jboss.seam.jms.inject.JmsSessionProducer.produceSession(JmsSessionProducer.java:33)
 at sun.reflect.GeneratedMethodAccessor1660.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
 at org.jboss.weld.util.reflection.SecureReflections$13.work(SecureReflections.java:264)
 at org.jboss.weld.util.reflection.SecureReflectionAccess.run(SecureReflectionAccess.java:52)
 at org.jboss.weld.util.reflection.SecureReflectionAccess.runAsInvocation(SecureReflectionAccess.java:137)
 at org.jboss.weld.util.reflection.SecureReflections.invoke(SecureReflections.java:260)
 at org.jboss.weld.introspector.jlr.WeldMethodImpl.invokeOnInstance(WeldMethodImpl.java:170)
 at org.jboss.weld.injection.MethodInjectionPoint.invokeOnInstance(MethodInjectionPoint.java:137)
 at org.jboss.weld.bean.ProducerMethod$1.produce(ProducerMethod.java:133)
 at org.jboss.weld.bean.AbstractProducerBean.create(AbstractProducerBean.java:299)
 at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:61)
 at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:616)
 at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:681)
 at org.jboss.weld.injection.FieldInjectionPoint.inject(FieldInjectionPoint.java:118)
 at org.jboss.weld.util.Beans.injectBoundFields(Beans.java:703)
 at org.jboss.weld.util.Beans.injectFieldsAndInitializers(Beans.java:712)
 at org.jboss.weld.bean.ManagedBean$ManagedBeanInjectionTarget$1$1.proceed(ManagedBean.java:161)
 at org.jboss.weld.injection.InjectionContextImpl.run(InjectionContextImpl.java:48)
 at org.jboss.weld.bean.ManagedBean$ManagedBeanInjectionTarget$1.work(ManagedBean.java:157)
 at org.jboss.weld.bean.ManagedBean$FixInjectionPoint.run(ManagedBean.java:131)
 at org.jboss.weld.bean.ManagedBean$ManagedBeanInjectionTarget.inject(ManagedBean.java:153)
 at org.jboss.weld.bean.ManagedBean.create(ManagedBean.java:290)
 at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:61)
 at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:616)
 at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:643)
 at org.jboss.seam.jms.bridge.EgressRoutingObserver.getMessageBuilder(EgressRoutingObserver.java:118)
 at org.jboss.seam.jms.bridge.EgressRoutingObserver.forwardEvent(EgressRoutingObserver.java:159)
 at org.jboss.seam.jms.bridge.EgressRoutingObserver.notify(EgressRoutingObserver.java:106)
 at org.jboss.weld.manager.BeanManagerImpl.notifyObservers(BeanManagerImpl.java:569)
 at org.jboss.weld.manager.BeanManagerImpl.fireEvent(BeanManagerImpl.java:564)
 at org.jboss.weld.event.EventImpl.fire(EventImpl.java:68)
 at com.parts.profile.registration.PrincipalRegistrationProcess.sendSuccessMail(PrincipalRegistrationProcess.java:145)
 at com.parts.profile.registration.PrincipalRegistrationProcess.save(PrincipalRegistrationProcess.java:105)
 at com.parts.profile.registration.PrincipalRegistrationProcess$Proxy$$$_WeldClientProxy.save(PrincipalRegistrationProcess$Proxy$$$_WeldClientProxy.java)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
 at org.apache.el.parser.AstValue.invoke(AstValue.java:262)
 at org.apache.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:278)
 at org.jboss.weld.util.el.ForwardingMethodExpression.invoke(ForwardingMethodExpression.java:39)
 at org.jboss.weld.el.WeldMethodExpression.invoke(WeldMethodExpression.java:50)
 at com.sun.faces.facelets.el.TagMethodExpression.invoke(TagMethodExpression.java:105)
 at javax.faces.component.MethodBindingMethodExpressionAdapter.invoke(MethodBindingMethodExpressionAdapter.java:88)
 at com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:102)
 at javax.faces.component.UICommand.broadcast(UICommand.java:315)
 at javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:794)
 at javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:1259)
 at com.sun.faces.lifecycle.InvokeApplicationPhase.execute(InvokeApplicationPhase.java:81)
 at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)
 at com.sun.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:118)
 at javax.faces.webapp.FacesServlet.service(FacesServlet.java:593)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at org.primefaces.webapp.filter.FileUploadFilter.doFilter(FileUploadFilter.java:79)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at com.musific.webapp.filter.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:23)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at org.jboss.weld.servlet.ConversationPropagationFilter.doFilter(ConversationPropagationFilter.java:62)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at org.jboss.solder.servlet.exception.CatchExceptionFilter.doFilter(CatchExceptionFilter.java:65)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at org.jboss.solder.servlet.event.ServletEventBridgeFilter.doFilter(ServletEventBridgeFilter.java:74)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at com.ocpsoft.pretty.PrettyFilter.doFilter(PrettyFilter.java:145)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at com.musific.webapp.filter.ResponseTimeLoggingFilter.doFilter(ResponseTimeLoggingFilter.java:32)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at com.musific.webapp.filter.DisableUrlSessionFilter.doFilter(DisableUrlSessionFilter.java:130)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at com.musific.webapp.filter.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:23)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
 at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275)
 at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161)
 at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50)
 at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153)
 at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155)
 at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
 at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
 at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368)
 at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:505)
 at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:445)
 at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930)
 at java.lang.Thread.run(Thread.java:662)

Please give me some hints how this can be solved.

[ataylor]

It looks like the connection is being closed at some point, maybe a network issue? are there anyother errors in the server log?

[lukaszk]

Yes, there is something which may be interested. The hornet WARNING/ERROR activity i logs starts day before:

16:06:36,873 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1bf02e6-a4d2-11e1-a02a-8e4bfde28217
16:06:37,008 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findPreferredCommunicationChannelByUsernameAndType was 100 [ms]
16:06:37,060 INFO  [com.musific.dashboard.bean.DashboardManager] (ajp--127.0.0.1-8009-5) The Session Timeout was set to '1200' during onLogin
16:06:37,151 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1bf02e6-a4d2-11e1-a02a-8e4bfde28217
16:06:37,520 INFO  [com.musific.webapp.session.DefaultLocaleService] (ajp--127.0.0.1-8009-9) Session fou9ydEhUlqVLIw2PXMaAjWw.undefined Initialized isNew: true
16:06:37,537 INFO  [com.musific.dashboard.bean.DashboardManager] (ajp--127.0.0.1-8009-5) The Default Conversation Timeout was set from '900000'ms to '900000'ms during onLogin
16:06:37,540 INFO  [com.musific.webapp.session.DefaultLocaleService] (ajp--127.0.0.1-8009-9) Cookie Locale is set to: null
16:06:37,577 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-16) Request completed in [1.004] seconds: [/login]
16:06:37,588 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:37,599 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) Event fires observer for current user onLogin 'Mortn'
16:06:37,609 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session d107281c-a4d2-11e1-a02a-8e4bfde28217
16:06:37,617 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session d107281c-a4d2-11e1-a02a-8e4bfde28217
16:06:37,619 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findDistinctNarrowDataForBusinessUnitsInIdentityObjectRelationshipsByUsername was 0 [ms]
16:06:37,638 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:37,659 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1c0b098-a4d2-11e1-a02a-8e4bfde28217
16:06:37,671 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1c0b098-a4d2-11e1-a02a-8e4bfde28217
16:06:37,677 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:37,695 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1e80ebe-a4d2-11e1-a02a-8e4bfde28217
16:06:37,703 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1e80ebe-a4d2-11e1-a02a-8e4bfde28217
16:06:37,710 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:37,645 WARN  [org.hornetq.jms.server.recovery.HornetQXAResourceWrapper] (Thread-391 (HornetQ-client-global-threads-1717898838)) Notified of connection failure in xa recovery connectionFactory for provider ClientSessionFactoryImpl [serverLocator=ServerLocatorImpl [initialConnectors=[org-hornetq-core-remoting-impl-invm-InVMConnectorFactory?server-id=0], discoveryGroupConfiguration=null], connectorConfig=org-hornetq-core-remoting-impl-invm-InVMConnectorFactory?server-id=0, backupConfig=null] will attempt reconnect on next pass: HornetQException[errorCode=2 message=Channel disconnected]
    at org.hornetq.core.client.impl.ClientSessionFactoryImpl.connectionDestroyed(ClientSessionFactoryImpl.java:380) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.core.remoting.impl.invm.InVMConnector$Listener$1.run(InVMConnector.java:203) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.utils.OrderedExecutorFactory$OrderedExecutor$1.run(OrderedExecutorFactory.java:100) [hornetq-core-2.2.13.Final.jar:]
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_26]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_26]
    at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_26]

16:06:37,748 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f20e3466-a4d2-11e1-a02a-8e4bfde28217
16:06:37,733 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User is member in 1 number of units
16:06:37,774 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User 'Mortn' has default business unit 'Musific's Dummy Manager'
16:06:37,777 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f20e3466-a4d2-11e1-a02a-8e4bfde28217
16:06:37,980 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitById was 1 [ms]
16:06:38,018 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,046 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1f29610-a4d2-11e1-a02a-8e4bfde28217
16:06:38,049 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1f29610-a4d2-11e1-a02a-8e4bfde28217
16:06:38,065 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,074 INFO  [com.musific.timezone.bean.LocaleSwitcherBean] (ajp--127.0.0.1-8009-9) Cookie Locale was set to: null
16:06:38,097 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f7ebf98d-a4d2-11e1-a02a-8e4bfde28217
16:06:38,099 ERROR [com.musific.webapp.session.DefaultLocaleService] (ajp--127.0.0.1-8009-9) RESTORE: Attempted to inject an HttpServletResponse before it has been initialized.
16:06:38,115 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findIdentityObjectRelationships was 35 [ms]
16:06:38,112 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f7ebf98d-a4d2-11e1-a02a-8e4bfde28217
16:06:38,143 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User: Mortn is GRANTED for unitId: 1031 with RoleType: CommunicationResponsible, GroupName: Unit, GroupType: GROUP
16:06:38,149 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) User: Mortn is GRANTED for unitId: 1031 with RoleType: Member, GroupName: Unit, GroupType: GROUP
16:06:38,149 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f7f4d32e-a4d2-11e1-a02a-8e4bfde28217
16:06:38,177 INFO  [com.parts.security.authentication.PartsIdmAuthenticator] (ajp--127.0.0.1-8009-5) Login successful for user mortn
16:06:38,197 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f7f4d32e-a4d2-11e1-a02a-8e4bfde28217
16:06:38,220 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session fcf704bf-a527-11e1-a02a-8e4bfde28217
16:06:38,225 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-9) Request completed in [1.628] seconds: [/search]
16:06:38,243 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session fcf704bf-a527-11e1-a02a-8e4bfde28217
16:06:38,247 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session fd5d8ec1-a527-11e1-a02a-8e4bfde28217
16:06:38,252 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session fd5d8ec1-a527-11e1-a02a-8e4bfde28217
16:06:38,262 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session e81527d3-a52c-11e1-a02a-8e4bfde28217
16:06:38,271 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session e81527d3-a52c-11e1-a02a-8e4bfde28217
16:06:38,275 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session e833fa75-a52c-11e1-a02a-8e4bfde28217
16:06:38,280 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session e833fa75-a52c-11e1-a02a-8e4bfde28217
16:06:38,284 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 1aabcf87-a566-11e1-a02a-8e4bfde28217
16:06:38,288 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 1aabcf87-a566-11e1-a02a-8e4bfde28217
16:06:38,292 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 28cd5d49-a566-11e1-a02a-8e4bfde28217
16:06:38,297 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 28cd5d49-a566-11e1-a02a-8e4bfde28217
16:06:38,301 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 2d9e946b-a566-11e1-a02a-8e4bfde28217
16:06:38,313 INFO  [com.parts.profile.bean.ProfileManager] (ajp--127.0.0.1-8009-5) Call to onUserUpdateComplete for user Mortn
16:06:38,322 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [157.088] seconds: [/login]
16:06:38,328 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 2d9e946b-a566-11e1-a02a-8e4bfde28217
16:06:38,332 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 31681f8d-a566-11e1-a02a-8e4bfde28217
16:06:38,337 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 31681f8d-a566-11e1-a02a-8e4bfde28217
16:06:38,342 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 3752b5ef-a566-11e1-a02a-8e4bfde28217
16:06:38,347 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 3752b5ef-a566-11e1-a02a-8e4bfde28217
16:06:38,351 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 1c38ddc1-a59e-11e1-a02a-8e4bfde28217
16:06:38,355 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 1c38ddc1-a59e-11e1-a02a-8e4bfde28217
16:06:38,360 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 1c53dfd3-a59e-11e1-a02a-8e4bfde28217
16:06:38,365 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 1c53dfd3-a59e-11e1-a02a-8e4bfde28217
16:06:38,369 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f90d2335-a5a5-11e1-a02a-8e4bfde28217
16:06:38,373 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f90d2335-a5a5-11e1-a02a-8e4bfde28217
16:06:38,377 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f92a2117-a5a5-11e1-a02a-8e4bfde28217
16:06:38,382 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f92a2117-a5a5-11e1-a02a-8e4bfde28217
16:06:38,386 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session a6753ec9-a5e9-11e1-a02a-8e4bfde28217
16:06:38,391 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session a6753ec9-a5e9-11e1-a02a-8e4bfde28217
16:06:38,395 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 9991c72b-a669-11e1-a02a-8e4bfde28217
16:06:38,399 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 9991c72b-a669-11e1-a02a-8e4bfde28217
16:06:38,404 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session ec7f054d-a89b-11e1-a02a-8e4bfde28217
16:06:38,408 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session ec7f054d-a89b-11e1-a02a-8e4bfde28217
16:06:38,414 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,426 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1a2ef60-a4d2-11e1-a02a-8e4bfde28217
16:06:38,439 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1a2ef60-a4d2-11e1-a02a-8e4bfde28217
16:06:38,443 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,462 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1b47b92-a4d2-11e1-a02a-8e4bfde28217
16:06:38,466 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1b47b92-a4d2-11e1-a02a-8e4bfde28217
16:06:38,480 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,488 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1d54a0c-a4d2-11e1-a02a-8e4bfde28217
16:06:38,502 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1d54a0c-a4d2-11e1-a02a-8e4bfde28217
16:06:38,506 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,541 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f1ca9baa-a4d2-11e1-a02a-8e4bfde28217
16:06:38,545 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f1ca9baa-a4d2-11e1-a02a-8e4bfde28217
16:06:38,558 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,568 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f2175c28-a4d2-11e1-a02a-8e4bfde28217
16:06:38,577 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f2175c28-a4d2-11e1-a02a-8e4bfde28217
16:06:38,590 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,610 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f0de18be-a4d2-11e1-a02a-8e4bfde28217
16:06:38,615 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f0de18be-a4d2-11e1-a02a-8e4bfde28217
16:06:38,630 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
16:06:38,656 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session f22abd1a-a4d2-11e1-a02a-8e4bfde28217
16:06:38,671 WARN  [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session f22abd1a-a4d2-11e1-a02a-8e4bfde28217
16:06:46,790 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
    at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
    ... 7 more

16:08:56,840 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
    at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
    ... 7 more

16:10:16,334 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
16:10:16,347 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
16:10:16,459 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.127] seconds: [/login]
16:11:06,923 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
    at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
    ... 7 more

16:13:01,148 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
16:13:01,160 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /public/account/login.jsf 
16:13:01,197 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.052] seconds: [/login]
16:13:04,468 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /index.jsf 
16:13:04,473 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) Authorized request to: /index.jsf. Will be redirected to home!
16:13:04,480 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /index.jsf 
16:13:04,485 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) Authorized request to: /index.jsf. Will be redirected to home!
16:13:04,491 WARN  [com.musific.exception.ConversationExceptionHandler] (ajp--127.0.0.1-8009-5) Something bad happened IllegalStateException: null
16:13:04,500 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.034] seconds: [/index]
16:13:04,590 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /protected/dashboard/home.jsf 
16:13:04,607 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-5) path: /protected/dashboard/home.jsf 
16:13:04,645 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 22 [ms]
16:13:04,670 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 7 [ms]
16:13:04,693 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 1 [ms]
16:13:04,719 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 1 [ms]
16:13:04,801 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) Count unread query for userId: 1017, unitId: 1031
16:13:04,823 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) prepareMessageStatement: userId: 1017, unitId: 1031, includeSenderStatement: false, types: DRAFT, SENDING, PENDING
16:13:04,926 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) Inbox query for userId: 1017, unitId: 1031
16:13:04,934 INFO  [com.parts.messenger.management.SmartMessageLoader] (ajp--127.0.0.1-8009-5) prepareMessageStatement: userId: 1017, unitId: 1031, includeSenderStatement: false, types: DRAFT, SENDING, PENDING
16:13:04,992 INFO  [com.parts.contract.bean.PerformanceContractInbox] (ajp--127.0.0.1-8009-5) Contract Inbox loaded for Musific's Dummy Manager
16:13:05,006 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findDistinctNarrowDataForBusinessUnitsInIdentityObjectRelationshipsByUsername was 0 [ms]
16:13:05,016 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findDistinctMemberPriveligesForBusinessUnitsInIdentityObjectRelationships was 0 [ms]
16:13:05,025 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findCommunicationChannelsByUserId was 0 [ms]
16:13:05,030 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findCommunicationChannelsByUserId was 0 [ms]
16:13:05,037 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findAddressesForUnit was 0 [ms]
16:13:05,042 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-5) PROFILE: execution time of findBusinessUnitProfileImageCount was 1 [ms]
16:13:05,060 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.472] seconds: [/home]
16:13:05,571 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.0010] seconds: [/seam/resource/remoting/resource/remote.js]
16:13:05,723 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-16) Request completed in [0.0010] seconds: [/seam/resource/remoting/interface.js]
16:13:05,737 INFO  [com.musific.webapp.filter.ResponseTimeLoggingFilter] (ajp--127.0.0.1-8009-5) Request completed in [0.0010] seconds: [/seam/resource/remoting/interface.js]
16:13:16,981 WARN  [com.arjuna.ats.jta] (Periodic Recovery) ARJUNA016027: Local XARecoveryModule.xaRecovery got XA exception XAException.XAER_RMERR: javax.transaction.xa.XAException: Error trying to connect to any providers for xa recovery
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:275) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.recover(HornetQXAResourceWrapper.java:77) [hornetq-jms-2.2.13.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecovery(XARecoveryModule.java:503) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.resourceInitiatedRecoveryForRecoveryHelpers(XARecoveryModule.java:471) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.bottomUpRecovery(XARecoveryModule.java:385) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkSecondPass(XARecoveryModule.java:166) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:789) [jbossjts-4.16.2.Final.jar:]
    at com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:371) [jbossjts-4.16.2.Final.jar:]
Caused by: java.lang.IllegalStateException: Cannot create session factory, server locator is closed (maybe it has been garbage collected)
    at org.hornetq.core.client.impl.ServerLocatorImpl.assertOpen(ServerLocatorImpl.java:1823) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:699) [hornetq-core-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.connect(HornetQXAResourceWrapper.java:321) [hornetq-jms-2.2.13.Final.jar:]
    at org.hornetq.jms.server.recovery.HornetQXAResourceWrapper.getDelegate(HornetQXAResourceWrapper.java:251) [hornetq-jms-2.2.13.Final.jar:]
    ... 7 more

16:13:32,311 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-16) path: /protected/dashboard/home.jsf 
16:13:32,317 INFO  [com.musific.webapp.session.HttpRequestWatcher] (ajp--127.0.0.1-8009-16) path: /protected/dashboard/home.jsf 
16:13:32,330 INFO  [com.parts.persistence.query.QueryHandler] (ajp--127.0.0.1-8009-16) PROFILE: execution time of findBusinessUnitCountInIdentityObjectRelationshipsByGroupAndAnyRole was 6 [ms]

Please advise how to proced ?

[ataylor]

this line here

Client connection failed, clearing up resources for session f1bf02e6-a4d2-11e1-a02a-8e4bfde28217

Tells me that for some reason the connection has been destroyed, there are many reasons for this, network issue, memory issues, bad code etc, I can't really help you without more info, you will need to inverstigate why the connection is being destroyed

[lukaszk]

There is also one line which I miss in mine previous paste:

16:06:36,835 WARN  [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]

Maybe it will tell more (?)

[ataylor]

it tells me the same thing, the client connection is being closed, you need to tune your app to deal with  what ever problems you are having, I dont know what your app is doing so cant really help you.