Problem setting up a clustered ESB

[dhoyt]

Hello all,

    I'm trying to setup clustering of Servicemix (apache-servicemix-4.3.1-fuse-02-05 to be exact).  After doing a bit of research, it appears that a "network of brokers" is the best way to accomplish this.  I have tried to follow several tutorials online, but I can't seem to get the a consumer on myHost2 to listen on a topic that is being populated by a producer on myHost1 (I am using two very simple camel routes that are publishing and subscribing to an ActiveMQ topic).  I can telnet to each server from the other on port 61616, so I know the ports are open, but I am not seeing any communication between them. 

    As far as I can tell, the only file that needs to be changed is activemq-broker.xml (included below).  The only changes I made to the activemq-broker.xml file was to change brokerName (they are different for each instance), added the networkConnectors node, and changed localhost to 0.0.0.0 so it could be reached from other servers.  Is there anything else that needs to be done? Any help would be greatly appreciated.

[iocanel]

From what I make from you configuration file you are adding a network connector that is connecting to itself, while it should be pointing to the other broker.

so if for instance you have on broker A the following config:

Then the network connector of broker A should point to 61617.

I hope this helps!

[dhoyt]

I made that change, but now the broker won't come up.  Looking at the log, I see the error listed below.  It seems that no matter where I put the networkConnectors element, I run into problems with the following element.  Any idea what is causing this? Is the networkConnectors element no longer supported?

org.osgi.service.blueprint.container.ComponentDefinitionException: Unable to validate xml

    at org.apache.aries.blueprint.container.Parser.validate(Parser.java:288)[7:org.apache.aries.blueprint:0.2.0.incubating]

    at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:261)[7:org.apache.aries.blueprint:0.2.0.incubating]

    at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:213)[7:org.apache.aries.blueprint:0.2.0.incubating]

    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)[:1.6.0_20]

    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)[:1.6.0_20]

    at java.util.concurrent.FutureTask.run(FutureTask.java:138)[:1.6.0_20]

    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)[:1.6.0_20]

    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:207)[:1.6.0_20]

    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)[:1.6.0_20]

    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)[:1.6.0_20]

    at java.lang.Thread.run(Thread.java:619)[:1.6.0_20]

Caused by: org.xml.sax.SAXParseException: cvc-complex-type.2.4.a: Invalid content was found starting with element 'destinationPolicy'. One of '{"http://activemq.apache.org/schema/core":persistenceAdapter, "http://activemq.apache.org/schema/core":persistenceFactory, "http://activemq.apache.org/schema/core":persistenceTaskRunnerFactory, "http://activemq.apache.org/schema/core":plugins, "http://activemq.apache.org/schema/core":producerSystemUsage, "http://activemq.apache.org/schema/core":proxyConnectors, "http://activemq.apache.org/schema/core":regionBroker, "http://activemq.apache.org/schema/core":services, "http://activemq.apache.org/schema/core":shutdownHooks, "http://activemq.apache.org/schema/core":sslContext, "http://activemq.apache.org/schema/core":systemUsage, "http://activemq.apache.org/schema/core":taskRunnerFactory, "http://activemq.apache.org/schema/core":tempDataStore, "http://activemq.apache.org/schema/core":transportConnectorURIs, "http://activemq.apache.org/schema/core":transportConnectors, WC[##other:"http://activemq.apache.org/schema/core"]}' is expected.

    at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:233)[:]

[davsclaus]

The XML tags in the XML file is sorted A..Z. So make sure you position the tags in correct order.

[dhoyt]

That did it!  My XML tags were not in alphabetical order.  Below is the config (for myHost1) that worked for me.  Thanks for all the help!

[michal.warecki]

I'm little bit confused about this "ESB Clustering".

Is it really ESB clustering or just ActiveMQ clustering? What if I deploy jaxws web service instead of queue? Will it redirect message to slave Servicemix instance? I think no.

Shouldn't we create ActiveMQ cluster and separate database locking based Servicemix cluster (http://fusesource.com/docs/esb/4.4.1/esb_runtime/ESBRuntimeFailoverJdbc.html)?

[dhoyt]

I am doing that as well, but I required an active-active cluster.  To accomplish that, I have a network of brokers where each node has a slave.  This gives me both clustering and HA.  As far as I have seen, clustering of ActiveMQ is what is required to cluster ServiceMix.