Problem with configuration for high troughput
sejmajnejm Nov 14, 2012 5:48 AMHello,
I am trying to configure a cluster of Jboss servers (7.1.1.Final) with mod_cluster 1.2.
I am able to achieve e.g. 600 http requests/second on a single jboss instance (requests sent directly to this instance) but with mod_cluster it never goes better than e.g. 200 req/sec but only for a minute. Then the performance degrades.
I have 4 instances of jboss in a cluster. RAM and CPU is no issue.
Sample of the domain.xml configuration
subsystem web (of the profile I am using which is full-ha):
<connector name="http" protocol="HTTP/1.1" scheme="http" socket-binding="http" executor="http-blocking" max-connections="20000"/> <connector name="ajp" protocol="AJP/1.3" scheme="http" enable-lookups="false" socket-binding="ajp" executor="http-blocking" max-connections="20000"/>
subsystem threads, e.g.:
<blocking-bounded-queue-thread-pool name="http-blocking" allow-core-timeout="true"> <core-threads count="4000"/> <queue-length count="2"/> <max-threads count="8000"/> <keepalive-time time="10" unit="seconds"/> </blocking-bounded-queue-thread-pool>
<subsystem xmlns="urn:jboss:domain:modcluster:1.0"> <mod-cluster-config advertise-socket="modcluster" proxy-list="172.18.6.160:7777" advertise-security-key="123456789qwerty"> <dynamic-load-provider> <load-metric type="busyness"/> </dynamic-load-provider> </mod-cluster-config> </subsystem>
In the Apache httpd I am using worker.c module for handling connections, but it looks like those values have little effect on the cluster performance.
<IfModule worker.c> StartServers 3 ServerLimit 1000 ThreadLimit 256 MinSpareThreads 75 MaxSpareThreads 250 ThreadsPerChild 256 MaxRequestsPerChild 0 </IfModule> LBstatusRecalTime 1 <VirtualHost 172.18.6.160:7777> <Directory /> Order deny,allow Deny from none Allow from all </Directory> <Location /mod_cluster-manager> SetHandler mod_cluster-manager Order deny,allow Deny from none Allow from all </Location> KeepAliveTimeout 15 MaxKeepAliveRequests 0 ManagerBalancerName other-server-group AdvertiseGroup 224.0.1.106:23364 AdvertiseFrequency 5 EnableMCPMReceive AdvertiseSecurityKey 123456789qwerty </VirtualHost>
Question is how mod_cluster should be configured to get high throughput? Please, I need some advice :-)
Thanks
A.