Using Stomp::Receipt - Performance is slow

[ameyamk]

Hi,

We are trying to get hornetQ in as reliable setting as we can. Currently we are running it as follows:

1. We are using stomp client. However, we are using safe_send approch than just simple send according to this documentation:

http://search.cpan.org/~huguei/Net-Stomp-Receipt-0.36/lib/Net/Stomp/Receipt.pm

2. Messages are persistent. Also, paging is enabled.

In above settings we are seeing performance of only about 200-300 messages per second. I have almost 10 producers producing data, and their combined performance is only around ~200-300 messages per second.

We want to run the Q in as reliable setting as we possibly can. So I have 2 questions:

1. Is this performance optimal? Can we improve the speed?

2. We will be using stomp for our clients. Is there any more reliable way of producer sending data other than protocol mentioned here?

http://search.cpan.org/~huguei/Net-Stomp-Receipt-0.36/lib/Net/Stomp/Receipt.pm

Thanks,

Ameya

[clebert.suconic]

What version?

[ameyamk]

2.2.5 Final

[ataylor]

have you tried another client to see if the performance issue is client side?

[ameyamk]

I tried using Stomp Client from different machines, using perl and Ruby client. I have not tried Java client yet. But I see similar performance from both the stomp clients from different machines.

[clebert.suconic]

Are you  measuring a single producer with persistent messages?

on that case you need to serialize each message send to wait the server to kick persistence. Multiple producers will use the throughput available at the server.

Isn't that the case that's happening to you?

[ameyamk]

I have 10 different producers from 3 different machines, and a single consumer. I am measuring performance at consumers end, which gives me sort of aggregate performance for all 10 producers, as consumer is much faster than the producers.

I was hoping that single producer might be slow as its esentially blocking on the ack from broker, however total broker capacity would not affect significantly. If I send messages without receipt, broker is able to handle upto ~5000/messages per second, but in receipt mode this is down to ~200-300 messages persecond.

[gaohoward]

Hi ameya,

Is your consumer located in a different machine than the hornetQ server or at the same machine?

Howard

[ataylor]

I have 10 different producers from 3 different machines, and a single consumer. I am measuring performance at consumers end, which gives me sort of aggregate performance for all 10 producers, as consumer is much faster than the producers.

Thats not strictly true, this does not give you the aggregate perf of the producers, it gives you the performance at which a single consumer can run. remember scalability comes with multiple producers/consumers, however since you think the problem is in the send its probably an ok assumption.

I see that this client is a stomp extension and uses some transactionality, i can only assume that this is all done in the client which may be where the extra over head is. If you can provide an *easy* runnable test i will take a look when i get some time