Dedicated JBoss HornetQ Server

[troymuma]

We have a setup where we have a series of related applications all deployed in a single EAP 6.1 container and a major part of the application involves messaging for which we are using HornetQ. In addition to upgrading to EAP 6.4 we want to separate the applications into different containers to reduce performance impacts. One consideration is, since HornetQ is such a large part of the application, moving the HornetQ components into their own app server container. I'm pretty sure this is doable but the question is, is this a logical setup and in what cases would it make sense to do it? Has anyone seen this type of setup before and have some insight on the best way to maintain a separate HornetQ container and what would justify this type of setup? My other concern is then how to transfer all that message data to the app servers that will consume it. Seems like we might need another custom component to handle that. Any suggestions?

[jbertram]

I'm pretty sure this is doable but the question is, is this a logical setup and in what cases would it make sense to do it?

Yes, it's logical.  It makes sense in a use-case like yours.

Has anyone seen this type of setup before and have some insight on the best way to maintain a separate HornetQ container and what would justify this type of setup?

Having a dedicated messaging server is common.  It doesn't require any special maintenance.  There are lots of justifications for having a dedicated messaging server.  Your use-case is one such justification.

My other concern is then how to transfer all that message data to the app servers that will consume it. Seems like we might need another custom component to handle that. Any suggestions?

There's a few ways you could do this:

• Simply copy your current HornetQ configuration and data (in the server's "data" directory) to the dedicated server while the servers are shut-down.
• Use the XML export/import utility that ships with HornetQ.
• Create bridges to move messages from the existing queues to the queues on the dedicated server.

[troymuma]

Justin,

Thanks for the response. I think you might have misunderstood my last question as I'm not sure the first two options would solve it (unless I'm missing something). What I'm asking is, in a live, running "hornetq server" that is actively receiving messages, how would I allow that message data to be consumed in real-time by my application containers? I want my application to continuously consume messages that are received but only host my hornetq server in its own dedicated container.

I believe a bridge would solve this and allow me to create only the necessary queues for each application in its own container. The bridge would effectively serve as a filter so only the messages that are pertinent to each app will be received in that container. Is that what you were suggesting? My question then is, if I wanted to remove hornetq altogether from those other app containers, is there a solution that allows me to not have any hornetq presence in those other containers? Can I create some sort of bridge or remote call to retrieve messages from my hornetq server without having any queues defined in each of my app containers? Let me know if my question is unclear.

[jbertram]

I think you might have misunderstood my last question as I'm not sure the first two options would solve it (unless I'm missing something). What I'm asking is, in a live, running "hornetq server" that is actively receiving messages, how would I allow that message data to be consumed in real-time by my application containers? I want my application to continuously consume messages that are received but only host my hornetq server in its own dedicated container.

Yes, I believe I misunderstood your question.  I thought you were asking how you could migrate your existing message data to your new, dedicated messaging server.

If you want your application on a remote server to consume messages from your messaging server then you simply need to point your application to the remote messaging server rather than the local one.

I believe a bridge would solve this and allow me to create only the necessary queues for each application in its own container. The bridge would effectively serve as a filter so only the messages that are pertinent to each app will be received in that container. Is that what you were suggesting?

My suggestion was made under the aforementioned (and incorrect) assumption that you wanted to migrate your data from one server to another.

...if I wanted to remove hornetq altogether from those other app containers, is there a solution that allows me to not have any hornetq presence in those other containers?

Yes.  However, the integration between HornetQ and the application server provides some advantages that you might not want to give up - namely the pooled-connection-factory which could boost performance considerably depending on how your application is written.

Can I create some sort of bridge or remote call to retrieve messages from my hornetq server without having any queues defined in each of my app containers?

There's no need to create any bridges.  You can simply point your clients directly to the remote messaging server or use a local pooled-connection-factory which is, in turn, pointing to the remote messaging server.  Which you choose will depend on how your application is written, what it's doing, and your performance requirements.

[troymuma]

Justin,

Thanks for your help on this. I think I understand how to implement this now. I'll update the thread if we have any issues with the implementation.