bridge configuration causing out of memory

[xpromache]

Hello,

I'm running two HornetQ  servers with a manually configured bridge between them. I noticed that when the destination server goes down, the source server runs out of memory. I configured paging on all addresses that are forwarded.

Doing a java memory dump, I observed about 6 millions instances of these two classes:

- org.hornetq.core.remoting.server.impl.RemotingServiceImpl$FailureCheckAndFlushThread

- java.util.concurrent.ConcurrentLinkedQueue$Node

These are linked together and seem to be the main culprit for the memory consumption.

The HornetQ version is 2.4.6.Final.

I can provide more info from the heap dump or from my configuration if necessary.

thanks for any hint

nicolae

[xpromache]

Poking more through the heap dump and through the HornetQ code, I see that the thing that accumulates is the runnable tasks that are added to the flushExecutor while it is stuck in a conn.flush() call.

Then looking further I see that RemotingConnectionImpl.flush is waiting for  transferLock which is acquired by another thread in doBufferReceived and this one is blocked in PagingStoreImpl and then it becomes not very easy to track...

I uploaded here the thread dump:

http://pastebin.com/SVHKpPef

[jbertram]

At this point I'd recommend you try to reproduce this on the latest release of Apache ActiveMQ Artemis.  HornetQ hasn't been actively developed in over a year now since the donation of the code-base to the Apache ActiveMQ project (where it became Artemis).

[xpromache]

That's certainly what I was going to do but I was looking for confirmation that there is a chance that this kind of problems (robustness against network problems) have been solved in the Artemis version.

[jbertram]

Since the donation there have been over 2,200 commits to the code-base and over 430 JIRAs resolved so I definitely think there's a chance this issue has been resolved.  Furthermore, if it hasn't been resolved then it's likely to be fixed relatively quickly vs. extremely unlikely to be fixed in HornetQ.

[xpromache]

Indeed. One question though: will an Artemis server communicate with an HornetQ one?

I'm using only the core things, no JMS.

[jbertram]

Artemis supports HornetQ clients so I would expect a HornetQ server would be able to bridge to an Artemis server.  I'm not sure if an Artemis server could bridge to a HornetQ server, though.