HornetQ client blocked opening connection
Hello,
We hit a strange situation on our application that uses HornetQ as its message queue.
Our setup is two WildFly processes, one for the application server an another for the HornetQ, both running on the same machine.
We are using:
WildFly 8.2.0.Final "Tweek" starting and
HornetQ Server version 2.4.5.FINAL
Our client application got blocked in the following stack:
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at io.netty.util.concurrent.DefaultPromise.awaitUninterruptibly(DefaultPromise.java:279)
- locked <0x00000000ac639358> (a io.netty.channel.DefaultChannelPromise)
at io.netty.channel.DefaultChannelPromise.awaitUninterruptibly(DefaultChannelPromise.java:135)
at io.netty.channel.DefaultChannelPromise.awaitUninterruptibly(DefaultChannelPromise.java:28)
at org.hornetq.core.remoting.impl.netty.NettyConnector.createConnection(NettyConnector.java:718)
at org.hornetq.core.client.impl.ClientSessionFactoryImpl.getConnection(ClientSessionFactoryImpl.java:1275)
- locked <0x00000000ac62bf40> (a java.lang.Object)
at org.hornetq.core.client.impl.ClientSessionFactoryImpl.getConnectionWithRetry(ClientSessionFactoryImpl.java:1121)
at org.hornetq.core.client.impl.ClientSessionFactoryImpl.connect(ClientSessionFactoryImpl.java:266)
at org.hornetq.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:881)
- locked <0x00000000ac62ab98> (a org.hornetq.core.client.impl.ServerLocatorImpl)
at org.hornetq.jms.client.HornetQConnectionFactory.createConnectionInternal(HornetQConnectionFactory.java:669)
- locked <0x00000000ac62ab50> (a org.hornetq.jms.client.HornetQJMSConnectionFactory)
at org.hornetq.jms.client.HornetQConnectionFactory.createConnection(HornetQConnectionFactory.java:112)
at org.hornetq.jms.client.HornetQConnectionFactory.createConnection(HornetQConnectionFactory.java:107)
Near the time our application got blocked we see no errors on the HornetQ logs.
In our application we see this error:
Exception: HornetQNotConnectedException[errorType=NOT_CONNECTED message=HQ119007: Cannot connect to server(s). Tried with all available servers.]
javax.jms.IllegalStateException: Unable to create QueueSession because connection not initialized
Restarting all services resumed normal operation, however we were not able to determine the cause of this block.
Can anyone provide guidance on how we can troubleshoot this issue.
What information or tests should we collect in a future occurrence.
Thank you,
Best Regards,
Filipe Rodrigues