Core API Client load balancing

[yairogen]

I've found this section in the manual but I am experiencing some strange behavior:

HashMap<String, Object> map = new HashMap<String, Object>();
map.put("host", "myhost");
map.put("port", "5445");
TransportConfiguration server1 = new TransportConfiguration(NettyConnectorFactory.class.getName(), map);
HashMap<String, Object> map2 = new HashMap<String, Object>();
map2.put("host", "myhost2");
map2.put("port", "5446");
TransportConfiguration server2 = new TransportConfiguration(NettyConnectorFactory.class.getName(), map2);


ServerLocator locator = HornetQClient.createServerLocatorWithHA(server1, server2);
ClientSessionFactory factory = locator.createSessionFactory();
ClientSession session = factory.createSession();

Assuming I have a 4 node cluster. 2 live servers and 2 backups. All are in the same group.

What I though I need to do is like above, create 4 transports. One for each node.

I then create multiple producers sending messages concurrently, but instead of seeing a round robin behavior, I see the producer sends twice the messages. I think it is once for each live server. So, if I start 2 consumers and I expected each to handle half of the messages, they both get the same messages.

What am I missing here?

[jbertram]

It's not clear to me exactly what you're doing when you send the messages.  Are you creating multiple sessions using the ClientSessionFactory you declared in the code you pasted and using a different session for each of your concurrent producers?

And what specifically do you mean by, "I see the producer sends twice the messages"?

As always, a reproducible test-case is welcome.

BTW, have you read the documentation about client-side load-balancing?

[yairogen]

I run concurrently and I create (base don teh same locator) new factories and new sessions per thread (once for each new thread and then re-use using ThreadLocal). The same applies for concurrent producers and consumers.

I see that although I have a loop of 10000 iterations, instead of only having 10000 in the queue -  I see 20000. Either the producer is sending to both live servers OR server side is duplicating the messages?

[jbertram]

I'm not sure.  Do you have test-case or example I could use to reproduce the issue?

[yairogen]

can we connect privately and I'll share my github access info?

yairogen AT gmail DOT com

[jbertram]

At this point it would probably be best for you to investigate purchasing a support subscription from Red Hat.  That's likely the only way you'll get the kind of support you need. 

In any kind of support situation it's typically best to make it as easy as possible to receive the help you want.  Usually the most effective way to do that is with code that's easy for one of the developers to take and run and see exactly the problem you're facing.  That will, of course, require some work on your end to distill the problem to its simplest form and write something that's easy to run.  However, HornetQ has a rich test-suite that you can use for this as well as a lot of examples that could serve as a template.

[yairogen]

Last time I checked RedHat didn't have an option for HornetQ stand-alone support. Only when run as part of AS. Is that still true?

If not, please send me info on the support package.

[ataylor]

you can trim down eap to be basically just HornetQ and any other sub systems you want.

[yairogen]

Isn't that an overkill? Why isn't stand alone hornetq treated as first class citizen? If someone provides commercial support for HornetQ on itself - I'm very interested in hearing more details.

I've had trouble in the past getting such a stripped product. It is also not something I can deploy on customer site.

[ataylor]

nope, its no different from using HornetQ standalone apart from its a different container and configuration. this is how Wildfly/eap is written, its extremely light weight.

[ataylor]

actually its probably lighter as we ship the old microcontainer and jndi server for standalone.

[yairogen]

1. can you explain how to create an EAP version that only holds HornetQ?

2. can we progress with this forum if I supply a working sample that demonstrates the problem?

[ataylor]

1. can you explain how to create an EAP version that only holds HornetQ?

simply strip out the subsystems you dont need or want

2. can we progress with this forum if I supply a working sample that demonstrates the problem?

if you can provide a simple, easily runnable example then when we have time we will take a look. remember we all have day jobs and the support we give here is free and takes up quite a bit of time as we answer lots of questions from a lot of users.

[yairogen]

what is the list of modules I need to keep in EAP to test out hornetq as part of EAP?

I am trying to follow the tip from here:

https://stackoverflow.com/questions/13449535/how-to-disable-modules-in-eap-6/18978774#18978774

But I don't know which modules to disable.

[ataylor]

what is the list of modules I need to keep in EAP to test out hornetq as part of EAP?

I have no idea, thats a task for you to work out.

I am trying to follow the tip from here:

https://stackoverflow.com/questions/13449535/how-to-disable-modules-in-eap-6/18978774#18978774

or you could just remove then from the config file.