I have setup a cluster with 2 nodes successfully. However, my iptables log show there are drop packet between the 2 public network interface. The drop packets is between the 2 nodes over a pair of arbitrary high port, in the case of this node, it is 36952 (see attached output).

Each node when startup will listen to an arbitrary high port, in this case port 36952 on this node. I have not able to account for the purpose of this port and how to make it to a fix port so that I can configure iptables to allow the traffic.

Anyone have any idea what is listening on this port.

# lsof -i -n | grep jboss | grep -i listen
Xvfb 985 jboss 0u IPv4 1775 TCP *:6001 (LISTEN)
java 1003 jboss 4u IPv4 39031475 TCP *:1098 (LISTEN)
java 1003 jboss 6u IPv4 39031477 TCP *:1099 (LISTEN)
java 1003 jboss 7u IPv4 39031479 TCP *:8083 (LISTEN)
java 1003 jboss 8u IPv4 39031488 TCP *:krb524 (LISTEN)
java 1003 jboss 9u IPv4 39031497 TCP *:4445 (LISTEN)
java 1003 jboss 12u IPv4 39032152 TCP *:3528 (LISTEN)
java 1003 jboss 17u IPv4 39032116 TCP 192.168.74.121:36931 (LISTEN)
java 1003 jboss 21u IPv4 39032119 TCP 192.168.74.121:1100 (LISTEN)
java 1003 jboss 23u IPv4 39032654 TCP *:5001 (LISTEN)
java 1003 jboss 26u IPv4 39032656 TCP *:8009 (LISTEN)
java 1003 jboss 30u IPv4 39032200 TCP *:49152 (LISTEN)
java 1003 jboss 31u IPv4 39032226 TCP *:8443 (LISTEN)
java 1003 jboss 37u IPv4 39032498 TCP *:8090 (LISTEN)
java 1003 jboss 38u IPv4 39032507 TCP *:36952 (LISTEN)
java 1003 jboss 39u IPv4 39032509 TCP *:8093 (LISTEN)
#