JBoss MDB not receiving messages from HornetQ
zcabir Oct 15, 2013 8:47 PMWe are seeing a weird issue in the JBoss that intermittently MDB's are not receiving messages from HornetQ. This happens when we are run JBoss in a KVM (16 GB RAM, 2 vCpu) and the problem goes away when we restart the jboss. In bare metal, this issue is not seen. Below is our environment details
- JBoss EAP 6.0.0.GA (AS 7.1.2.Final-redhat-1)
- HornetQ Server version 2.2.16.Final
- JDK 1.7.0_25 (Oracle)
- Cent OS: Linux xsd-mvdclnx57 2.6.32-358.18.1.el6.x86_64 #1 SMP Wed Aug 28 17:19:38 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
We have two MDB's with queue as destination (jms/queue/Q1 and jms/queue/Q2) and one MDB with topic as destination (jms/topic/T1). None of them receives messages in this state.
Noticed that MDB's and hornetQ started properly.
14-Oct-2013 21:33:04,053 INFO [org.hornetq.core.server.impl.HornetQServerImpl] (MSC service thread 1-4) HornetQ Server version 2.2.16.Final (HQ_2_2_16_FINAL, 122) [349a958f-3518-11e3-891d-8bed1a580245]) started
:
14-Oct-2013 21:33:19,966 INFO [org.jboss.as.ejb3] (MSC service thread 1-2) JBAS014142: Started message driven bean 'Q1MDB' with 'hornetq-ra' resource adapter
14-Oct-2013 21:33:19,966 INFO [org.jboss.as.ejb3] (MSC service thread 1-4) JBAS014142: Started message driven bean 'Q2MDB' with 'hornetq-ra' resource adapter
When the messages got published, we do not see any error messages in the server.log, but there are warning messages like below.
14-Oct-2013 21:39:57,673 WARN [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
14-Oct-2013 21:39:57,675 WARN [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 45b0aac0-3518-11e3-891d-8bed1a580245
14-Oct-2013 21:39:57,679 WARN [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 45b0aac0-3518-11e3-891d-8bed1a580245
14-Oct-2013 21:39:57,709 WARN [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
14-Oct-2013 21:39:57,709 WARN [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Client connection failed, clearing up resources for session 456a2c91-3518-11e3-891d-8bed1a580245
14-Oct-2013 21:39:57,710 WARN [org.hornetq.core.server.impl.ServerSessionImpl] (hornetq-failure-check-thread) Cleared up resources for session 456a2c91-3518-11e3-891d-8bed1a580245
14-Oct-2013 21:39:57,710 WARN [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] (hornetq-failure-check-thread) Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3]
If anyone has seen this issue, please share your thoughts.