12 Replies Latest reply on May 13, 2010 11:20 AM by jaikiran

    JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors

    jaikiran

      Just downloaded AS 6.0.0.M3 and was just testing it out. When my system is not connected to a network, I see that the AS fails with startup errors related to HornetQ clustering configurations. I am booting the "default" AS config, so I don't know whether HornetQ should even be trying to join a cluster group. Here's the error I get: {code} 13:00:21,653 INFO  [AbstractJBossASServerBase] Server Configuration:         JBOSS_HOME URL: file:/home/jpai/jboss-6.0.0.M3/         Bootstrap: $JBOSS_HOME/server/default/conf/bootstrap.xml         Common Base: $JBOSS_HOME/common/         Common Library: $JBOSS_HOME/common/lib/         Server Name: default         Server Base: $JBOSS_HOME/server/         Server Library: $JBOSS_HOME/server/default/lib/         Server Config: $JBOSS_HOME/server/default/conf/         Server Home: $JBOSS_HOME/server/default/         Server Data: $JBOSS_HOME/server/default/data         Server Log: $JBOSS_HOME/server/default/log/         Server Temp: $JBOSS_HOME/server/default/tmp 13:00:21,657 INFO  [AbstractServer] Starting: JBossAS [6.0.0.20100429-M3 "Neo"] 13:00:24,069 INFO  [ServerInfo] Java version: 1.6.0_16,Sun Microsystems Inc. 13:00:24,069 INFO  [ServerInfo] Java Runtime: Java(TM) SE Runtime Environment (build 1.6.0_16-b01) 13:00:24,069 INFO  [ServerInfo] Java VM: Java HotSpot(TM) Server VM 14.2-b01,Sun Microsystems Inc. 13:00:24,069 INFO  [ServerInfo] OS-System: Linux 2.6.18-164.11.1.el5,i386 13:00:24,070 INFO  [ServerInfo] VM arguments: -Xms128m -Xmx512m -XX:MaxPermSize=256m -Dorg.jboss.resolver.warning=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dprogram.name=run.sh -Djava.library.path=/NotBackedUp/jpai/jboss-6.0.0.M3/bin/native/lib -Djava.endorsed.dirs=/NotBackedUp/jpai/jboss-6.0.0.M3/lib/endorsed 13:00:24,112 INFO  [JMXKernel] Legacy JMX core initialized 13:00:30,327 INFO  [AbstractServerConfig] JBoss Web Services - Native Server 3.3.0.CR1.SP2 13:00:38,421 INFO  [JMXConnector] starting JMXConnector on host 0.0.0.0:1090 13:00:39,058 INFO  [MailService] Mail Service bound to java:/Mail 13:00:39,814 INFO  [HornetQServerImpl] live server is starting.. 13:00:39,950 INFO  [JournalStorageManager] Using AIO Journal 13:00:39,975 WARNING [HornetQServerImpl] Security risk! It has been detected that the cluster admin user and password have not been changed from the installation default. Please see the HornetQ user guide, cluster chapter, for instructions on how to do this. 13:00:47,688 ERROR [AbstractKernelController] Error installing to Start: name=JMSServerManager state=Create: java.net.SocketException: No such device         at java.net.PlainDatagramSocketImpl.join(Native Method) [:1.6.0_16]         at java.net.PlainDatagramSocketImpl.join(PlainDatagramSocketImpl.java:172) [:1.6.0_16]         at java.net.MulticastSocket.joinGroup(MulticastSocket.java:276) [:1.6.0_16]         at org.hornetq.core.cluster.impl.DiscoveryGroupImpl.start(DiscoveryGroupImpl.java:124) [:6.0.0.20100429-M3]         at org.hornetq.core.server.cluster.impl.ClusterManagerImpl.deployDiscoveryGroup(ClusterManagerImpl.java:357) [:6.0.0.20100429-M3]         at org.hornetq.core.server.cluster.impl.ClusterManagerImpl.start(ClusterManagerImpl.java:142) [:6.0.0.20100429-M3]         at org.hornetq.core.server.impl.HornetQServerImpl.initialisePart2(HornetQServerImpl.java:1090) [:6.0.0.20100429-M3]         at org.hornetq.core.server.impl.HornetQServerImpl.start(HornetQServerImpl.java:310) [:6.0.0.20100429-M3]         at org.hornetq.jms.server.impl.JMSServerManagerImpl.start(JMSServerManagerImpl.java:233) [:6.0.0.20100429-M3]         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [:1.6.0_16]         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [:1.6.0_16]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [:1.6.0_16]         at java.lang.reflect.Method.invoke(Method.java:597) [:1.6.0_16]         at org.jboss.reflect.plugins.introspection.ReflectionUtils.invoke(ReflectionUtils.java:59) [jboss-reflect.jar:2.2.0.Alpha4]         at org.jboss.reflect.plugins.introspection.ReflectMethodInfoImpl.invoke(ReflectMethodInfoImpl.java:168) [jboss-reflect.jar:2.2.0.Alpha4]         at org.jboss.joinpoint.plugins.BasicMethodJoinPoint.dispatch(BasicMethodJoinPoint.java:66) [jboss-reflect.jar:2.2.0.Alpha4]         at org.jboss.kernel.plugins.dependency.KernelControllerContextAction$JoinpointDispatchWrapper.execute(KernelControllerContextAction.java:257) [jboss-kernel.jar:2.2.0.Alpha9]         at org.jboss.kernel.plugins.dependency.ExecutionWrapper.execute(ExecutionWrapper.java:47) [jboss-kernel.jar:2.2.0.Alpha9]         at org.jboss.kernel.plugins.dependency.KernelControllerContextAction.dispatchExecutionWrapper(KernelControllerContextAction.java:125) [jboss-kernel.jar:2.2.0.Alpha9]         at org.jboss.kernel.plugins.dependency.KernelControllerContextAction.dispatchJoinPoint(KernelControllerContextAction.java:72) [jboss-kernel.jar:2.2.0.Alpha9]         at org.jboss.kernel.plugins.dependency.LifecycleAction.installActionInternal(LifecycleAction.java:202) [jboss-kernel.jar:2.2.0.Alpha9]         at org.jboss.kernel.plugins.dependency.InstallsAwareAction.installAction(InstallsAwareAction.java:54) [jboss-kernel.jar:2.2.0.Alpha9]         at org.jboss.kernel.plugins.dependency.InstallsAwareAction.installAction(InstallsAwareAction.java:42) [jboss-kernel.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.action.SimpleControllerContextAction.simpleInstallAction(SimpleControllerContextAction.java:62) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.action.AccessControllerContextAction.install(AccessControllerContextAction.java:71) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractControllerContextActions.install(AbstractControllerContextActions.java:51) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:377) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:2042) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:1081) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.executeOrIncrementStateDirectly(AbstractController.java:1320) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1244) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1137) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:892) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:639) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.deployers.vfs.deployer.kernel.BeanMetaDataDeployer.deploy(BeanMetaDataDeployer.java:180) [:2.2.0.Alpha4]         at org.jboss.deployers.vfs.deployer.kernel.BeanMetaDataDeployer.deploy(BeanMetaDataDeployer.java:58) [:2.2.0.Alpha4]         at org.jboss.deployers.spi.deployer.helpers.AbstractSimpleRealDeployer.internalDeploy(AbstractSimpleRealDeployer.java:62) [:2.2.0.Alpha4]         at org.jboss.deployers.spi.deployer.helpers.AbstractRealDeployer.deploy(AbstractRealDeployer.java:55) [:2.2.0.Alpha4]         at org.jboss.deployers.plugins.deployers.DeployerWrapper.deploy(DeployerWrapper.java:179) [:2.2.0.Alpha4]         at org.jboss.deployers.plugins.deployers.DeployersImpl.doDeploy(DeployersImpl.java:1857) [:2.2.0.Alpha4]         at org.jboss.deployers.plugins.deployers.DeployersImpl.doInstallParentFirst(DeployersImpl.java:1575) [:2.2.0.Alpha4]         at org.jboss.deployers.plugins.deployers.DeployersImpl.doInstallParentFirst(DeployersImpl.java:1596) [:2.2.0.Alpha4]         at org.jboss.deployers.plugins.deployers.DeployersImpl.install(DeployersImpl.java:1516) [:2.2.0.Alpha4]         at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:377) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:2042) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:1081) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.executeOrIncrementStateDirectly(AbstractController.java:1320) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1244) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1137) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:937) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:652) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.deployers.plugins.deployers.DeployersImpl.change(DeployersImpl.java:2008) [:2.2.0.Alpha4]         at org.jboss.deployers.plugins.deployers.DeployersImpl.process(DeployersImpl.java:1101) [:2.2.0.Alpha4]         at org.jboss.deployers.plugins.main.MainDeployerImpl.process(MainDeployerImpl.java:679) [:2.2.0.Alpha4]         at org.jboss.system.server.profileservice.repository.MainDeployerAdapter.process(MainDeployerAdapter.java:117) [:6.0.0.20100429-M3]         at org.jboss.system.server.profileservice.repository.ProfileDeployAction.install(ProfileDeployAction.java:70) [:6.0.0.20100429-M3]         at org.jboss.system.server.profileservice.repository.AbstractProfileAction.install(AbstractProfileAction.java:53) [:6.0.0.20100429-M3]         at org.jboss.system.server.profileservice.repository.AbstractProfileService.install(AbstractProfileService.java:403) [:6.0.0.20100429-M3]         at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:377) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:2042) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:1081) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.executeOrIncrementStateDirectly(AbstractController.java:1320) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1244) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1137) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:892) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:639) [jboss-dependency.jar:2.2.0.Alpha9]         at org.jboss.system.server.profileservice.repository.AbstractProfileService.registerProfile(AbstractProfileService.java:308) [:6.0.0.20100429-M3]         at org.jboss.system.server.profileservice.ProfileServiceBootstrap.start(ProfileServiceBootstrap.java:256) [:6.0.0.20100429-M3]         at org.jboss.system.server.profileservice.ProfileServiceBootstrap.start(ProfileServiceBootstrap.java:97) [:6.0.0.20100429-M3]         at org.jboss.bootstrap.impl.base.server.AbstractServer.startBootstraps(AbstractServer.java:827) [jboss-bootstrap-impl-base.jar:2.1.0-alpha-5]         at org.jboss.bootstrap.impl.base.server.AbstractServer$StartServerTask.run(AbstractServer.java:417) [jboss-bootstrap-impl-base.jar:2.1.0-alpha-5]         at java.lang.Thread.run(Thread.java:619) [:1.6.0_16] 13:00:47,767 INFO  [WebService] Using RMI server codebase: http://localhost.localdomain:8083/ 13:00:48,530 INFO  [AprLifecycleListener] The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /NotBackedUp/jpai/jboss-6.0.0.M3/bin/native/lib 13:00:48,729 INFO  [TomcatDeployment] deploy, ctxPath=/invoker 13:00:49,318 INFO  [RARDeployment] Required license terms exist, view vfs:/NotBackedUp/jpai/jboss-6.0.0.M3/server/default/deploy/jboss-local-jdbc.rar/META-INF/ra.xml 13:00:49,333 INFO  [RARDeployment] Required license terms exist, view vfs:/NotBackedUp/jpai/jboss-6.0.0.M3/server/default/deploy/jboss-xa-jdbc.rar/META-INF/ra.xml 13:00:49,356 INFO  [RARDeployment] Required license terms exist, view vfs:/NotBackedUp/jpai/jboss-6.0.0.M3/server/default/deploy/jms-ra.rar/META-INF/ra.xml 13:00:49,385 INFO  [HornetQResourceAdapter] HornetQ resource adaptor started 13:00:49,391 INFO  [RARDeployment] Required license terms exist, view vfs:/NotBackedUp/jpai/jboss-6.0.0.M3/server/default/deploy/mail-ra.rar/META-INF/ra.xml 13:00:49,402 INFO  [RARDeployment] Required license terms exist, view vfs:/NotBackedUp/jpai/jboss-6.0.0.M3/server/default/deploy/quartz-ra.rar/META-INF/ra.xml 13:00:49,467 INFO  [SimpleThreadPool] Job execution threads will use class loader of thread: Thread-2 13:00:49,498 INFO  [SchedulerSignalerImpl] Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl 13:00:49,499 INFO  [QuartzScheduler] Quartz Scheduler v.1.7.3 created. 13:00:49,501 INFO  [RAMJobStore] RAMJobStore initialized. 13:00:49,501 INFO  [StdSchedulerFactory] Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz package: 'quartz.properties' 13:00:49,501 INFO  [StdSchedulerFactory] Quartz scheduler version: 1.7.3 13:00:49,505 INFO  [QuartzScheduler] Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED started. 13:00:50,181 INFO  [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=DefaultDS' to JNDI name 'java:DefaultDS' 13:00:50,458 INFO  [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=JmsXA' to JNDI name 'java:JmsXA' 13:00:50,491 INFO  [xnio] XNIO Version 2.1.0.CR2 13:00:50,494 INFO  [nio] XNIO NIO Implementation Version 2.1.0.CR2 13:00:50,893 INFO  [remoting] JBoss Remoting version 3.1.0.Beta2 13:00:50,974 INFO  [TomcatDeployment] deploy, ctxPath=/ 13:00:51,045 INFO  [service] Removing bootstrap log handlers 13:00:51,120 INFO  [org.jboss.system.server.profileservice.ProfileServiceBootstrap] Loading profile: ProfileKey@181f5b[domain=default, server=default, name=default] 13:00:51,123 ERROR [org.jboss.system.server.profileservice.ProfileServiceBootstrap] Failed to load profile: Summary of incomplete deployments (SEE PREVIOUS ERRORS FOR DETAILS): DEPLOYMENTS MISSING DEPENDENCIES:   Deployment "JMSConnectionFactoryManageMO" is missing the following dependencies:     Dependency "" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'JMSServerManager' **")   Deployment "JMSQueueManageMO" is missing the following dependencies:     Dependency "" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'JMSServerManager' **")   Deployment "JMSServerMO" is missing the following dependencies:     Dependency "" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'JMSServerManager' **")   Deployment "JMSTopicManageMO" is missing the following dependencies:     Dependency "" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'JMSServerManager' **")   Deployment "org.hornetq:module=JMS,name="InVMConnectionFactory",type=ConnectionFactory" is missing the following dependencies:     Dependency "JMSServerManager" (should be in state "Installed", but is actually in state "**ERROR**")   Deployment "org.hornetq:module=JMS,name="NettyConnectionFactory",type=ConnectionFactory" is missing the following dependencies:     Dependency "JMSServerManager" (should be in state "Installed", but is actually in state "**ERROR**")   Deployment "org.hornetq:module=JMS,name="NettyThroughputConnectionFactory",type=ConnectionFactory" is missing the following dependencies:     Dependency "JMSServerManager" (should be in state "Installed", but is actually in state "**ERROR**")   Deployment "org.hornetq:module=JMS,type=Queue,name="DLQ"" is missing the following dependencies:     Dependency "JMSServerManager" (should be in state "Installed", but is actually in state "**ERROR**")   Deployment "org.hornetq:module=JMS,type=Queue,name="ExpiryQueue"" is missing the following dependencies:     Dependency "JMSServerManager" (should be in state "Installed", but is actually in state "**ERROR**") DEPLOYMENTS IN ERROR:   Deployment "JMSServerManager" is in error due to the following reason(s): java.net.SocketException: No such device, **ERROR**   Deployment "" is in error due to the following reason(s): ** UNRESOLVED Demands 'JMSServerManager' **   Deployment "" is in error due to the following reason(s): ** UNRESOLVED Demands 'JMSServerManager' **   Deployment "" is in error due to the following reason(s): ** UNRESOLVED Demands 'JMSServerManager' **   Deployment "" is in error due to the following reason(s): ** UNRESOLVED Demands 'JMSServerManager' ** 13:00:51,144 INFO  [org.apache.coyote.http11.Http11Protocol] Starting Coyote HTTP/1.1 on http-0.0.0.0-8080 13:00:51,151 INFO  [org.apache.coyote.ajp.AjpProtocol] Starting Coyote AJP/1.3 on ajp-0.0.0.0-8009 13:00:51,152 INFO  [org.jboss.bootstrap.impl.base.server.AbstractServer] JBossAS [6.0.0.20100429-M3 "Neo"] Started in 29s:478ms 13:00:52,716 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable         at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]         at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]         at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]         at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]         at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]         at java.lang.Thread.run(Thread.java:619) [:1.6.0_16] {code} Looking at the HornetQ configs (and the stacktrace) it appears to be related to the discovery group configuration: {code:xml} <discovery-groups>       <discovery-group name="dg-group1">          <group-address>231.7.7.7</group-address>          <group-port>9876</group-port>          <refresh-timeout>10000</refresh-timeout>       </discovery-group>    </discovery-groups> {code} In addition to finding a solution to preventing the error on bootup (when not connected to network), the other questions I had were: 1) Should HornetQ have clustering capabilities in "default" config of AS? 2) Should those (and other similar) group-address and ports be configured to ServiceBindingManager in AS?

        • 1. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
          jaikiran
          • 2. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
            jmesnil

            jaikiran pai wrote:

             

            1) Should HornetQ have clustering capabilities in "default" config of AS?

            No, it shouldn't. There was a glitch and the same configuration was used for HornetQ both default and all profiles.

            Normally, HornetQ is not clustered in "default" and clustered in "all".

            I'll make sure the configurations are fixed.

             

            I'll also fix HornetQ cluster code to log an error if the network is unreachable and still continue AS boot.

             

            thanks for the report,

            jeff

            • 3. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
              jmesnil

              https://jira.jboss.org/jira/browse/JBAS-7998 to use non-clustered HornetQ for AS default profile

              https://jira.jboss.org/jira/browse/HORNETQ-383 to let HornetQ server start even when the network is unreachable

              • 4. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                jaikiran

                Thanks Jeff.

                 

                Jeff Mesnil wrote:

                 

                https://jira.jboss.org/jira/browse/JBAS-7998

                https://jira.jboss.org/jira/browse/HORNETQ-383 to let HornetQ server start even when the network is unreachable

                 

                A related issue to that is the broadcast implementation which too fails and then keeps printing out error logs every 5 seconds:

                 

                 

                13:01:12,763 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:17,768 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:22,773 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:27,777 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:32,782 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:37,787 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:42,793 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:47,797 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                
                
                
                13:01:52,802 ERROR [org.hornetq.core.server.cluster.impl.BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                        at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_16]
                        at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_16]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                        at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_16]
                        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_16]
                        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_16]
                        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_16]
                        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_16]
                        at java.lang.Thread.run(Thread.java:619) [:1.6.0_16]
                

                 

                 

                Maybe, after logging the first error message (that's going to be incorporated in HORNETQ-383), subsequent printing of stacktrace could perhaps be avoided?

                • 5. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                  jmesnil

                  I have fixed the 2 underlying issues (clustered config in default profile &unreachable network preventing hornetq to start).

                   

                  I'm not sure about your suggestion to log only once if the broadcast fails. If the user sets up a clustered configuration and it can not use the network, I'd consider this as a recurring error. If we log the error only once, it may not be apparent to the user that something is really going wrong...

                  • 6. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                    jaikiran

                    Jeff Mesnil wrote:

                     

                    I have fixed the 2 underlying issues (clustered config in default profile &unreachable network preventing hornetq to start).

                    Thank you.

                     

                    Jeff Mesnil wrote:

                     

                     

                     

                    I'm not sure about your suggestion to log only once if the broadcast fails. If the user sets up a clustered configuration and it can not use the network, I'd consider this as a recurring error. If we log the error only once, it may not be apparent to the user that something is really going wrong...

                    I haven't looked at the HornetQ code, but since its a valid usecase to start the "all" profile on a system which is not connected to the network, I was thinking that we should not be priniting out the exception stacktrace every few seconds when the broadcast fails. Maybe if there's some way to identify whether or not to broadcast, then we could perhaps disable the BroadcastGroupImpl?

                    • 7. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                      chrismeadows

                      Hmmm, I see the same error occuring when I AM on a network.

                      Ubuntu 8.04 64 bit, AIO not installed

                       

                       

                      {code}

                      14:00:42,095 INFO  [AbstractJBossASServerBase] Server Configuration:

                       

                          JBOSS_HOME URL: file:/usr/local/jboss-6.0.0.20100429-M3/
                          Bootstrap: $JBOSS_HOME/server/all/conf/bootstrap.xml
                          Common Base: $JBOSS_HOME/common/
                          Common Library: $JBOSS_HOME/common/lib/
                          Server Name: all
                          Server Base: $JBOSS_HOME/server/
                          Server Library: $JBOSS_HOME/server/all/lib/
                          Server Config: $JBOSS_HOME/server/all/conf/
                          Server Home: $JBOSS_HOME/server/all/
                          Server Data: $JBOSS_HOME/server/all/data
                          Server Log: $JBOSS_HOME/server/all/log/
                          Server Temp: $JBOSS_HOME/server/all/tmp

                       

                      14:00:42,097 INFO  [AbstractServer] Starting: JBossAS [6.0.0.20100429-M3 "Neo"]
                      14:00:43,253 INFO  [ServerInfo] Java version: 1.6.0_10,Sun Microsystems Inc.
                      14:00:43,253 INFO  [ServerInfo] Java Runtime: Java(TM) SE Runtime Environment (build 1.6.0_10-b33)
                      14:00:43,253 INFO  [ServerInfo] Java VM: Java HotSpot(TM) 64-Bit Server VM 11.0-b15,Sun Microsystems Inc.
                      14:00:43,253 INFO  [ServerInfo] OS-System: Linux 2.6.24-24-server,amd64
                      14:00:43,254 INFO  [ServerInfo] VM arguments: -Xms128m -Xmx512m -XX:MaxPermSize=256m -Dorg.jboss.resolver.warning=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dprogram.name=run.sh -Djava.library.path=/usr/local/jboss-6.0.0.20100429-M3/bin/native/lib64:/opt/apps/oracle/instantclient_10_2 -Djava.endorsed.dirs=/usr/local/jboss-6.0.0.20100429-M3/lib/endorsed
                      14:00:43,254 DEBUG [ServerInfo] Full System Properties Dump
                      14:00:43,254 DEBUG [ServerInfo]     bind.address: 10.3.94.132
                      14:00:43,254 DEBUG [ServerInfo]     file.encoding: UTF-8
                      14:00:43,254 DEBUG [ServerInfo]     file.encoding.pkg: sun.io
                      14:00:43,255 DEBUG [ServerInfo]     file.separator: /
                      14:00:43,255 DEBUG [ServerInfo]     java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
                      14:00:43,255 DEBUG [ServerInfo]     java.awt.printerjob: sun.print.PSPrinterJob
                      14:00:43,255 DEBUG [ServerInfo]     java.class.path: /usr/local/jboss-6.0.0.20100429-M3/bin/run.jar
                      14:00:43,255 DEBUG [ServerInfo]     java.class.version: 50.0
                      14:00:43,255 DEBUG [ServerInfo]     java.endorsed.dirs: /usr/local/jboss-6.0.0.20100429-M3/lib/endorsed
                      14:00:43,255 DEBUG [ServerInfo]     java.ext.dirs: /usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/ext:/usr/java/packages/lib/ext
                      14:00:43,255 DEBUG [ServerInfo]     java.home: /usr/lib/jvm/java-6-sun-1.6.0.10/jre
                      14:00:43,255 DEBUG [ServerInfo]     java.io.tmpdir: /tmp
                      14:00:43,255 DEBUG [ServerInfo]     java.library.path: /usr/local/jboss-6.0.0.20100429-M3/bin/native/lib64:/opt/apps/oracle/instantclient_10_2
                      14:00:43,255 DEBUG [ServerInfo]     java.net.preferIPv4Stack: true
                      14:00:43,256 DEBUG [ServerInfo]     java.protocol.handler.pkgs: org.jboss.net.protocol|org.jboss.vfs.protocol
                      14:00:43,256 DEBUG [ServerInfo]     java.rmi.server.RMIClassLoaderSpi: org.jboss.system.JBossRMIClassLoader
                      14:00:43,256 DEBUG [ServerInfo]     java.rmi.server.hostname: 10.3.94.132
                      14:00:43,256 DEBUG [ServerInfo]     java.runtime.name: Java(TM) SE Runtime Environment
                      14:00:43,256 DEBUG [ServerInfo]     java.runtime.version: 1.6.0_10-b33
                      14:00:43,256 DEBUG [ServerInfo]     java.specification.name: Java Platform API Specification
                      14:00:43,256 DEBUG [ServerInfo]     java.specification.vendor: Sun Microsystems Inc.
                      14:00:43,256 DEBUG [ServerInfo]     java.specification.version: 1.6
                      14:00:43,256 DEBUG [ServerInfo]     java.util.logging.manager: org.jboss.logmanager.LogManager
                      14:00:43,256 DEBUG [ServerInfo]     java.vendor: Sun Microsystems Inc.
                      14:00:43,257 DEBUG [ServerInfo]     java.vendor.url: http://java.sun.com/
                      14:00:43,257 DEBUG [ServerInfo]     java.vendor.url.bug: http://java.sun.com/cgi-bin/bugreport.cgi
                      14:00:43,257 DEBUG [ServerInfo]     java.version: 1.6.0_10
                      14:00:43,257 DEBUG [ServerInfo]     java.vm.info: mixed mode
                      14:00:43,257 DEBUG [ServerInfo]     java.vm.name: Java HotSpot(TM) 64-Bit Server VM
                      14:00:43,257 DEBUG [ServerInfo]     java.vm.specification.name: Java Virtual Machine Specification
                      14:00:43,257 DEBUG [ServerInfo]     java.vm.specification.vendor: Sun Microsystems Inc.
                      14:00:43,257 DEBUG [ServerInfo]     java.vm.specification.version: 1.0
                      14:00:43,257 DEBUG [ServerInfo]     java.vm.vendor: Sun Microsystems Inc.
                      14:00:43,257 DEBUG [ServerInfo]     java.vm.version: 11.0-b15
                      14:00:43,258 DEBUG [ServerInfo]     javax.management.builder.initial: org.jboss.mx.server.MBeanServerBuilderImpl
                      14:00:43,258 DEBUG [ServerInfo]     jboss.bind.address: 10.3.94.132
                      14:00:43,258 DEBUG [ServerInfo]     jboss.boot.server.log.dir: /usr/local/jboss-6.0.0.20100429-M3/server/all/log
                      14:00:43,258 DEBUG [ServerInfo]     jboss.bootstrap.home.url: file:/usr/local/jboss-6.0.0.20100429-M3/server/all/conf/
                      14:00:43,258 DEBUG [ServerInfo]     jboss.bootstrap.name: bootstrap.xml
                      14:00:43,258 DEBUG [ServerInfo]     jboss.bootstrap.url: file:/usr/local/jboss-6.0.0.20100429-M3/server/all/conf/bootstrap.xml
                      14:00:43,258 DEBUG [ServerInfo]     jboss.common.base.url: file:/usr/local/jboss-6.0.0.20100429-M3/common/
                      14:00:43,258 DEBUG [ServerInfo]     jboss.common.lib.url: file:/usr/local/jboss-6.0.0.20100429-M3/common/lib/
                      14:00:43,258 DEBUG [ServerInfo]     jboss.home: /usr/local/jboss-6.0.0.20100429-M3
                      14:00:43,258 DEBUG [ServerInfo]     jboss.home.dir: /usr/local/jboss-6.0.0.20100429-M3
                      14:00:43,259 DEBUG [ServerInfo]     jboss.home.url: file:/usr/local/jboss-6.0.0.20100429-M3/
                      14:00:43,259 DEBUG [ServerInfo]     jboss.host.name: jbossone
                      14:00:43,259 DEBUG [ServerInfo]     jboss.lib.url: file:/usr/local/jboss-6.0.0.20100429-M3/lib/
                      14:00:43,259 DEBUG [ServerInfo]     jboss.native.dir: /usr/local/jboss-6.0.0.20100429-M3/server/all/tmp/native
                      14:00:43,259 DEBUG [ServerInfo]     jboss.native.load: false
                      14:00:43,259 DEBUG [ServerInfo]     jboss.node.name: jbossone
                      14:00:43,259 DEBUG [ServerInfo]     jboss.partition.name: DefaultPartition
                      14:00:43,259 DEBUG [ServerInfo]     jboss.platform.mbeanserver: true
                      14:00:43,259 DEBUG [ServerInfo]     jboss.qualified.host.name: jbossone.onyx.com
                      14:00:43,259 DEBUG [ServerInfo]     jboss.server.base.dir: /usr/local/jboss-6.0.0.20100429-M3/server
                      14:00:43,259 DEBUG [ServerInfo]     jboss.server.base.url: file:/usr/local/jboss-6.0.0.20100429-M3/server/
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.config.url: file:/usr/local/jboss-6.0.0.20100429-M3/server/all/conf/
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.data.dir: /usr/local/jboss-6.0.0.20100429-M3/server/all/data
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.home.dir: /usr/local/jboss-6.0.0.20100429-M3/server/all
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.home.url: file:/usr/local/jboss-6.0.0.20100429-M3/server/all/
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.lib.url: file:/usr/local/jboss-6.0.0.20100429-M3/server/all/lib/
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.log.dir: /usr/local/jboss-6.0.0.20100429-M3/server/all/log
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.name: all
                      14:00:43,260 DEBUG [ServerInfo]     jboss.server.temp.dir: /usr/local/jboss-6.0.0.20100429-M3/server/all/tmp
                      14:00:43,260 DEBUG [ServerInfo]     jboss.vfs.forceCopy: true
                      14:00:43,260 DEBUG [ServerInfo]     jbossmx.loader.repository.class: org.jboss.mx.loading.UnifiedLoaderRepository3
                      14:00:43,261 DEBUG [ServerInfo]     jgroups.bind_addr: 10.3.94.132
                      14:00:43,261 DEBUG [ServerInfo]     line.separator:

                       

                      14:00:43,261 DEBUG [ServerInfo]     log4j.defaultInitOverride: true
                      14:00:43,261 DEBUG [ServerInfo]     org.jboss.logging.Logger.pluginClass: org.jboss.logging.logmanager.LoggerPluginImpl
                      14:00:43,261 DEBUG [ServerInfo]     org.jboss.resolver.warning: true
                      14:00:43,261 DEBUG [ServerInfo]     os.arch: amd64
                      14:00:43,261 DEBUG [ServerInfo]     os.name: Linux
                      14:00:43,261 DEBUG [ServerInfo]     os.version: 2.6.24-24-server
                      14:00:43,261 DEBUG [ServerInfo]     path.separator: :
                      14:00:43,261 DEBUG [ServerInfo]     program.name: run.sh
                      14:00:43,262 DEBUG [ServerInfo]     sun.arch.data.model: 64
                      14:00:43,262 DEBUG [ServerInfo]     sun.boot.class.path: /usr/local/jboss-6.0.0.20100429-M3/lib/endorsed/stax-api.jar:/usr/local/jboss-6.0.0.20100429-M3/lib/endorsed/jaxws-api.jar:/usr/local/jboss-6.0.0.20100429-M3/lib/endorsed/activation.jar:/usr/local/jboss-6.0.0.20100429-M3/lib/endorsed/jbossws-native-factories.jar:/usr/local/jboss-6.0.0.20100429-M3/lib/endorsed/jaxb-api.jar:/usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/resources.jar:/usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/rt.jar:/usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/jsse.jar:/usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/jce.jar:/usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/charsets.jar:/usr/lib/jvm/java-6-sun-1.6.0.10/jre/classes
                      14:00:43,262 DEBUG [ServerInfo]     sun.boot.library.path: /usr/lib/jvm/java-6-sun-1.6.0.10/jre/lib/amd64
                      14:00:43,262 DEBUG [ServerInfo]     sun.cpu.endian: little
                      14:00:43,262 DEBUG [ServerInfo]     sun.cpu.isalist:
                      14:00:43,262 DEBUG [ServerInfo]     sun.io.unicode.encoding: UnicodeLittle
                      14:00:43,262 DEBUG [ServerInfo]     sun.java.launcher: SUN_STANDARD
                      14:00:43,262 DEBUG [ServerInfo]     sun.jnu.encoding: UTF-8
                      14:00:43,262 DEBUG [ServerInfo]     sun.management.compiler: HotSpot 64-Bit Server Compiler
                      14:00:43,262 DEBUG [ServerInfo]     sun.os.patch.level: unknown
                      14:00:43,263 DEBUG [ServerInfo]     sun.rmi.dgc.client.gcInterval: 3600000
                      14:00:43,263 DEBUG [ServerInfo]     sun.rmi.dgc.server.gcInterval: 3600000
                      14:00:43,263 DEBUG [ServerInfo]     user.country: GB
                      14:00:43,263 DEBUG [ServerInfo]     user.dir: /home/jboss
                      14:00:43,263 DEBUG [ServerInfo]     user.home: /home/jboss
                      14:00:43,263 DEBUG [ServerInfo]     user.language: en
                      14:00:43,263 DEBUG [ServerInfo]     user.name: jboss
                      14:00:43,263 DEBUG [ServerInfo]     user.timezone: UTC
                      14:00:43,263 DEBUG [ServerInfo]     xb.builder.repeatableParticleHandlers: false
                      14:00:43,263 DEBUG [ServerInfo]     xb.builder.useUnorderedSequence: true
                      14:00:43,281 INFO  [JMXKernel] Legacy JMX core initialized
                      14:00:46,040 INFO  [AbstractServerConfig] JBoss Web Services - Native Server 3.3.0.CR1.SP2
                      14:00:48,311 WARNING [FileConfigurationParser] AIO wasn't located on this platform, it will fall back to using pure Java NIO. If your platform is Linux, install LibAIO to enable the AIO journal
                      14:00:54,908 WARN  [config] jacorb.home unset! Will use '.'
                      14:00:54,908 WARN  [config] File ./jacorb.properties for configuration jacorb not found
                      14:00:54,908 INFO  [config] configuration jacorb loaded from classpath
                      14:00:54,919 INFO  [orb] Property "jacorb.hashtable_class" is set to: java.util.Hashtable
                      14:00:54,923 WARN  [config] jacorb.home unset! Will use '.'
                      14:00:54,923 WARN  [config] File ./jacorb.properties for configuration jacorb not found
                      14:00:54,923 INFO  [config] configuration jacorb loaded from classpath
                      14:00:54,923 INFO  [singleton] created ORBSingleton
                      14:00:54,948 INFO  [interceptors] InterceptorManager started with 2 Server Interceptors, 2 Client Interceptors and 4 IOR Interceptors
                      14:00:54,967 INFO  [orb] ORB run
                      14:00:55,769 INFO  [SnmpAgentService] SNMP agent going active
                      14:00:56,210 WARNING [FileConfigurationParser] AIO wasn't located on this platform, it will fall back to using pure Java NIO. If your platform is Linux, install LibAIO to enable the AIO journal
                      14:00:56,327 INFO  [JMXConnector] starting JMXConnector on host 10.3.94.132:1090
                      14:00:56,464 INFO  [poa] oid:
                      72 6F 6F 74                                                 root
                      object is activated
                      14:00:56,476 INFO  [CorbaNamingService] CORBA Naming Started
                      14:00:56,482 INFO  [MailService] Mail Service bound to java:/Mail
                      14:00:57,443 DEBUG [CacheJmxWrapper] Registered in JMX under jboss.cache:config=ha-partition,service=Cache
                      14:00:57,462 INFO  [JChannel] JGroups version: 2.10.0.Alpha3
                      14:00:57,700 INFO  [DefaultPartition] Initializing partition DefaultPartition
                      14:00:57,741 INFO  [STDOUT]
                      14:00:57,742 INFO  [STDOUT] -------------------------------------------------------------------
                      14:00:57,742 INFO  [STDOUT] GMS: address=jbossone-13216, cluster=DefaultPartition, physical address=10.3.94.132:55200
                      14:00:57,742 INFO  [STDOUT] -------------------------------------------------------------------
                      14:00:59,775 INFO  [DefaultPartition] Number of cluster members: 1
                      14:00:59,776 INFO  [DefaultPartition] Other members: 0
                      14:00:59,782 DEBUG [CacheStatus] start() called while current state is INSTANTIATED -- call create() first
                      14:00:59,815 DEBUG [RegionManagerImpl] Not using an EvictionPolicy
                      14:00:59,828 DEBUG [JmxRegistrationManager] Base name is: jboss.cache:service=JBossCache,cluster=DefaultPartition-HAPartitionCache
                      14:00:59,856 INFO  [PlatformMBeanServerRegistration] JBossCache MBeans were successfully registered to the platform mbean server.
                      14:00:59,859 INFO  [JChannel] JGroups version: 2.10.0.Alpha3
                      14:00:59,929 WARN  [JChannel] Option AUTO_RECONNECT has been deprecated and is ignored
                      14:00:59,929 WARN  [JChannel] Option AUTO_GETSTATE has been deprecated and is ignored
                      14:00:59,934 INFO  [STDOUT]
                      14:00:59,934 INFO  [STDOUT] -------------------------------------------------------------------
                      14:00:59,934 INFO  [STDOUT] GMS: address=jbossone-3577, cluster=DefaultPartition-HAPartitionCache, physical address=10.3.94.132:55200
                      14:00:59,934 INFO  [STDOUT] -------------------------------------------------------------------
                      14:01:01,936 INFO  [RPCManagerImpl] Received new cluster view: [jbossone-3577|0] [jbossone-3577]
                      14:01:01,938 INFO  [RPCManagerImpl] Cache local address is jbossone-3577
                      14:01:01,940 INFO  [RPCManagerImpl] state was retrieved successfully (in 2 seconds)
                      14:01:01,948 DEBUG [CacheStatus] start() called while current state is INSTANTIATED -- call create() first
                      14:01:01,949 DEBUG [CacheJmxWrapper] Registering jmx resources
                      14:01:01,949 DEBUG [JmxRegistrationManager] Base name is: jboss.cache:config=ha-partition,service=Cache
                      14:01:01,957 INFO  [ComponentRegistry] JBoss Cache version: JBossCache 'Malagueta' 3.2.1.GA
                      14:01:01,958 INFO  [DefaultPartition] Fetching serviceState (will wait for 30000 milliseconds):
                      14:01:01,959 INFO  [DefaultPartition] State could not be retrieved (we are the first member in group)
                      14:01:02,198 INFO  [UnifiedInvokerHA] Service name is jboss:service=invoker,type=unifiedha
                      14:01:02,544 INFO  [HornetQServerImpl] live server is starting..
                      14:01:02,596 INFO  [JournalStorageManager] Using NIO Journal
                      14:01:02,634 WARNING [HornetQServerImpl] Security risk! It has been detected that the cluster admin user and password have not been changed from the installation default. Please see the HornetQ user guide, cluster chapter, for instructions on how to do this.
                      14:01:06,398 ERROR [AbstractKernelController] Error installing to Start: name=JMSServerManager state=Create: java.net.SocketException: No such device
                          at java.net.PlainDatagramSocketImpl.join(Native Method) [:1.6.0_10]
                          at java.net.PlainDatagramSocketImpl.join(PlainDatagramSocketImpl.java:172) [:1.6.0_10]
                          at java.net.MulticastSocket.joinGroup(MulticastSocket.java:276) [:1.6.0_10]
                          at org.hornetq.core.cluster.impl.DiscoveryGroupImpl.start(DiscoveryGroupImpl.java:124) [:6.0.0.20100429-M3]
                          at org.hornetq.core.server.cluster.impl.ClusterManagerImpl.deployDiscoveryGroup(ClusterManagerImpl.java:357) [:6.0.0.20100429-M3]
                          at org.hornetq.core.server.cluster.impl.ClusterManagerImpl.start(ClusterManagerImpl.java:142) [:6.0.0.20100429-M3]
                          at org.hornetq.core.server.impl.HornetQServerImpl.initialisePart2(HornetQServerImpl.java:1090) [:6.0.0.20100429-M3]
                          at org.hornetq.core.server.impl.HornetQServerImpl.start(HornetQServerImpl.java:310) [:6.0.0.20100429-M3]
                          at org.hornetq.jms.server.impl.JMSServerManagerImpl.start(JMSServerManagerImpl.java:233) [:6.0.0.20100429-M3]
                          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [:1.6.0_10]
                          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [:1.6.0_10]
                          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [:1.6.0_10]
                          at java.lang.reflect.Method.invoke(Method.java:597) [:1.6.0_10]
                          at org.jboss.reflect.plugins.introspection.ReflectionUtils.invoke(ReflectionUtils.java:59) [jboss-reflect.jar:2.2.0.Alpha4]
                          at org.jboss.reflect.plugins.introspection.ReflectMethodInfoImpl.invoke(ReflectMethodInfoImpl.java:168) [jboss-reflect.jar:2.2.0.Alpha4]
                          at org.jboss.joinpoint.plugins.BasicMethodJoinPoint.dispatch(BasicMethodJoinPoint.java:66) [jboss-reflect.jar:2.2.0.Alpha4]
                          at org.jboss.kernel.plugins.dependency.KernelControllerContextAction$JoinpointDispatchWrapper.execute(KernelControllerContextAction.java:257) [jboss-kernel.jar:2.2.0.Alpha9]
                          at org.jboss.kernel.plugins.dependency.ExecutionWrapper.execute(ExecutionWrapper.java:47) [jboss-kernel.jar:2.2.0.Alpha9]
                          at org.jboss.kernel.plugins.dependency.KernelControllerContextAction.dispatchExecutionWrapper(KernelControllerContextAction.java:125) [jboss-kernel.jar:2.2.0.Alpha9]
                          at org.jboss.kernel.plugins.dependency.KernelControllerContextAction.dispatchJoinPoint(KernelControllerContextAction.java:72) [jboss-kernel.jar:2.2.0.Alpha9]
                          at org.jboss.kernel.plugins.dependency.LifecycleAction.installActionInternal(LifecycleAction.java:202) [jboss-kernel.jar:2.2.0.Alpha9]
                          at org.jboss.kernel.plugins.dependency.InstallsAwareAction.installAction(InstallsAwareAction.java:54) [jboss-kernel.jar:2.2.0.Alpha9]
                          at org.jboss.kernel.plugins.dependency.InstallsAwareAction.installAction(InstallsAwareAction.java:42) [jboss-kernel.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.action.SimpleControllerContextAction.simpleInstallAction(SimpleControllerContextAction.java:62) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.action.AccessControllerContextAction.install(AccessControllerContextAction.java:71) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractControllerContextActions.install(AbstractControllerContextActions.java:51) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:377) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:2042) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:1081) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.executeOrIncrementStateDirectly(AbstractController.java:1320) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1244) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1137) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:892) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:639) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.deployers.vfs.deployer.kernel.BeanMetaDataDeployer.deploy(BeanMetaDataDeployer.java:180) [:2.2.0.Alpha4]
                          at org.jboss.deployers.vfs.deployer.kernel.BeanMetaDataDeployer.deploy(BeanMetaDataDeployer.java:58) [:2.2.0.Alpha4]
                          at org.jboss.deployers.spi.deployer.helpers.AbstractSimpleRealDeployer.internalDeploy(AbstractSimpleRealDeployer.java:62) [:2.2.0.Alpha4]
                          at org.jboss.deployers.spi.deployer.helpers.AbstractRealDeployer.deploy(AbstractRealDeployer.java:55) [:2.2.0.Alpha4]
                          at org.jboss.deployers.plugins.deployers.DeployerWrapper.deploy(DeployerWrapper.java:179) [:2.2.0.Alpha4]
                          at org.jboss.deployers.plugins.deployers.DeployersImpl.doDeploy(DeployersImpl.java:1857) [:2.2.0.Alpha4]
                          at org.jboss.deployers.plugins.deployers.DeployersImpl.doInstallParentFirst(DeployersImpl.java:1575) [:2.2.0.Alpha4]
                          at org.jboss.deployers.plugins.deployers.DeployersImpl.doInstallParentFirst(DeployersImpl.java:1596) [:2.2.0.Alpha4]
                          at org.jboss.deployers.plugins.deployers.DeployersImpl.install(DeployersImpl.java:1516) [:2.2.0.Alpha4]
                          at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:377) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:2042) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:1081) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.executeOrIncrementStateDirectly(AbstractController.java:1320) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1244) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1137) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:937) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:652) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.deployers.plugins.deployers.DeployersImpl.change(DeployersImpl.java:2008) [:2.2.0.Alpha4]
                          at org.jboss.deployers.plugins.deployers.DeployersImpl.process(DeployersImpl.java:1101) [:2.2.0.Alpha4]
                          at org.jboss.deployers.plugins.main.MainDeployerImpl.process(MainDeployerImpl.java:679) [:2.2.0.Alpha4]
                          at org.jboss.system.server.profileservice.repository.MainDeployerAdapter.process(MainDeployerAdapter.java:117) [:6.0.0.20100429-M3]
                          at org.jboss.system.server.profileservice.repository.ProfileDeployAction.install(ProfileDeployAction.java:70) [:6.0.0.20100429-M3]
                          at org.jboss.system.server.profileservice.repository.AbstractProfileAction.install(AbstractProfileAction.java:53) [:6.0.0.20100429-M3]
                          at org.jboss.system.server.profileservice.repository.AbstractProfileService.install(AbstractProfileService.java:403) [:6.0.0.20100429-M3]
                          at org.jboss.dependency.plugins.AbstractControllerContext.install(AbstractControllerContext.java:377) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:2042) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.incrementState(AbstractController.java:1081) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.executeOrIncrementStateDirectly(AbstractController.java:1320) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1244) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.resolveContexts(AbstractController.java:1137) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:892) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.dependency.plugins.AbstractController.install(AbstractController.java:639) [jboss-dependency.jar:2.2.0.Alpha9]
                          at org.jboss.system.server.profileservice.repository.AbstractProfileService.registerProfile(AbstractProfileService.java:308) [:6.0.0.20100429-M3]
                          at org.jboss.system.server.profileservice.ProfileServiceBootstrap.start(ProfileServiceBootstrap.java:256) [:6.0.0.20100429-M3]
                          at org.jboss.system.server.profileservice.ProfileServiceBootstrap.start(ProfileServiceBootstrap.java:97) [:6.0.0.20100429-M3]
                          at org.jboss.bootstrap.impl.base.server.AbstractServer.startBootstraps(AbstractServer.java:827) [jboss-bootstrap-impl-base.jar:2.1.0-alpha-5]
                          at org.jboss.bootstrap.impl.base.server.AbstractServer$StartServerTask.run(AbstractServer.java:417) [jboss-bootstrap-impl-base.jar:2.1.0-alpha-5]
                          at java.lang.Thread.run(Thread.java:619) [:1.6.0_10]

                       

                      14:01:06,468 INFO  [WebService] Using RMI server codebase: http://10.3.94.132:8083/
                      14:01:06,504 INFO  [HANamingService] Started HAJNDI bootstrap; jnpPort=1100, backlog=50, bindAddress=/10.3.94.132
                      14:01:06,511 INFO  [DetachedHANamingService$AutomaticDiscovery] Listening on /10.3.94.132:1102, group=230.0.0.4, HA-JNDI address=10.3.94.132:1100
                      14:01:07,146 INFO  [AprLifecycleListener] The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/local/jboss-6.0.0.20100429-M3/bin/native/lib64:/opt/apps/oracle/instantclient_10_2
                      14:01:07,254 INFO  [TomcatDeployment] deploy, ctxPath=/invoker
                      14:01:07,618 INFO  [TomcatDeployment] deploy, ctxPath=/juddi
                      14:01:07,643 INFO  [RegistryServlet] Loading jUDDI configuration.
                      14:01:07,643 INFO  [RegistryServlet] Resources loaded from: /WEB-INF/juddi.properties
                      14:01:07,644 INFO  [RegistryServlet] Initializing jUDDI components.
                      14:01:07,674 INFO  [RARDeployment] Required license terms exist, view vfs:/usr/local/jboss-6.0.0.20100429-M3/server/all/deploy/jboss-local-jdbc.rar/META-INF/ra.xml
                      14:01:07,720 INFO  [RARDeployment] Required license terms exist, view vfs:/usr/local/jboss-6.0.0.20100429-M3/server/all/deploy/jboss-xa-jdbc.rar/META-INF/ra.xml
                      14:01:07,725 INFO  [RARDeployment] Required license terms exist, view vfs:/usr/local/jboss-6.0.0.20100429-M3/server/all/deploy/jms-ra.rar/META-INF/ra.xml
                      14:01:07,737 INFO  [HornetQResourceAdapter] HornetQ resource adaptor started
                      14:01:07,743 INFO  [RARDeployment] Required license terms exist, view vfs:/usr/local/jboss-6.0.0.20100429-M3/server/all/deploy/mail-ra.rar/META-INF/ra.xml
                      14:01:07,752 INFO  [RARDeployment] Required license terms exist, view vfs:/usr/local/jboss-6.0.0.20100429-M3/server/all/deploy/quartz-ra.rar/META-INF/ra.xml
                      14:01:07,799 INFO  [SimpleThreadPool] Job execution threads will use class loader of thread: Thread-2
                      14:01:07,818 INFO  [SchedulerSignalerImpl] Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
                      14:01:07,819 INFO  [QuartzScheduler] Quartz Scheduler v.1.7.3 created.
                      14:01:07,821 DEBUG [UpdateChecker] Checking for update...
                      14:01:07,821 INFO  [RAMJobStore] RAMJobStore initialized.
                      14:01:07,821 INFO  [StdSchedulerFactory] Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz package: 'quartz.properties'
                      14:01:07,821 INFO  [StdSchedulerFactory] Quartz scheduler version: 1.7.3
                      14:01:07,822 INFO  [QuartzScheduler] Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED started.
                      14:01:07,832 DEBUG [UpdateChecker] Update check failed: java.net.UnknownHostException: www.terracotta.org
                      14:01:07,898 INFO  [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=JmsXA' to JNDI name 'java:JmsXA'
                      14:01:07,944 INFO  [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=OracleDS' to JNDI name 'java:OracleDS'
                      14:01:08,531 INFO  [xnio] XNIO Version 2.1.0.CR2
                      14:01:08,535 INFO  [nio] XNIO NIO Implementation Version 2.1.0.CR2
                      14:01:08,697 INFO  [remoting] JBoss Remoting version 3.1.0.Beta2
                      14:01:08,776 INFO  [TomcatDeployment] deploy, ctxPath=/
                      14:01:08,849 INFO  [service] Removing bootstrap log handlers
                      14:01:45,328 INFO  [service] Restored bootstrap log handlers
                      14:01:45,340 INFO  [TomcatDeployment] undeploy, ctxPath=/
                      14:01:45,421 INFO  [ConnectionFactoryBindingService] Unbound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=OracleDS' from JNDI name 'java:OracleDS'
                      14:01:45,620 INFO  [ConnectionFactoryBindingService] Unbound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=JmsXA' from JNDI name 'java:JmsXA'
                      14:01:45,627 INFO  [QuartzScheduler] Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutting down.
                      14:01:45,627 INFO  [QuartzScheduler] Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED paused.
                      14:01:45,627 DEBUG [SimpleThreadPool] shutdown complete
                      14:01:45,628 INFO  [QuartzScheduler] Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutdown complete.
                      14:01:45,633 INFO  [HornetQResourceAdapter] HornetQ resource adapter stopped
                      14:01:45,649 INFO  [TomcatDeployment] undeploy, ctxPath=/invoker
                      14:01:45,656 INFO  [TomcatDeployment] undeploy, ctxPath=/juddi
                      14:01:45,657 INFO  [RegistryServlet] jUDDI Stopping: Cleaning up existing resources.
                      14:01:45,781 INFO  [DefaultPartition] Stopping partition DefaultPartition
                      14:01:45,782 DEBUG [CacheStatus] Ignoring call to stop() as current state is STOPPING
                      14:01:45,782 INFO  [RPCManagerImpl] Disconnecting and closing the Channel
                      14:01:45,790 INFO  [RPCManagerImpl] Stopping the RpcDispatcher
                      14:01:45,798 DEBUG [CacheJmxWrapper] Unregistering interceptors
                      14:01:45,798 DEBUG [JmxRegistrationManager] Base name is: jboss.cache:config=ha-partition,service=Cache
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,805 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,804 DEBUG [SimpleThreadPool] WorkerThread is shut down.
                      14:01:45,831 INFO  [DefaultPartition] Partition DefaultPartition stopped.
                      14:01:45,836 INFO  [DefaultPartition] Partition DefaultPartition destroyed.
                      14:01:45,842 INFO  [poa] POA TPOA destroyed
                      14:01:45,843 INFO  [poa] POA PPOA destroyed
                      14:01:45,843 INFO  [poa] POA Naming destroyed
                      14:01:45,844 INFO  [MailService] Mail service 'java:/Mail' removed from JNDI
                      14:01:45,849 INFO  [JMXConnector] JMXConnector stopped
                      14:01:45,916 INFO  [SnmpAgentService] SNMP agent stopped
                      14:01:45,975 INFO  [orb] prepare ORB for shutdown...
                      14:01:45,976 INFO  [orb] ORB going down...
                      14:01:45,976 INFO  [poa] POA IR destroyed
                      14:01:45,976 INFO  [poa] POA OTSResources destroyed
                      14:01:45,984 INFO  [poa] POA OTS destroyed
                      14:01:45,984 INFO  [poa] POA RootPOA destroyed
                      14:01:45,991 INFO  [iiop] Listener exited
                      14:01:45,991 INFO  [orb] ORB run, exit
                      14:01:45,991 INFO  [orb] ORB shutdown complete
                      14:01:46,408 ERROR [BroadcastGroupImpl] Failed to broadcast connector configs: java.io.IOException: Network is unreachable
                          at java.net.PlainDatagramSocketImpl.send(Native Method) [:1.6.0_10]
                          at java.net.DatagramSocket.send(DatagramSocket.java:612) [:1.6.0_10]
                          at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.broadcastConnectors(BroadcastGroupImpl.java:239) [:6.0.0.20100429-M3]
                          at org.hornetq.core.server.cluster.impl.BroadcastGroupImpl.run(BroadcastGroupImpl.java:251) [:6.0.0.20100429-M3]
                          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_10]
                          at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_10]
                          at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_10]
                          at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_10]
                          at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181) [:1.6.0_10]
                          at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205) [:1.6.0_10]
                          at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_10]
                          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_10]
                          at java.lang.Thread.run(Thread.java:619) [:1.6.0_10]

                       

                      14:01:46,657 INFO  [AbstractServer] Stopped: JBossAS [6.0.0.20100429-M3 "Neo"] in 1s:422ms

                       

                      {code}

                      • 8. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                        jaikiran

                        What exact command do you use to start the "all" config?

                         

                        P.S: I hate this crazy editor. I had to struggle with that scroll bar to move to the correct line, to view that exception stacktrace in the log.

                        • 9. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                          chrismeadows

                          Bit contorted, but it's

                           

                           

                          {code}

                          sudo su - jboss -c '/usr/local/jboss/bin/run.sh -c all -b 10.3.94.132'

                          {code}

                          • 10. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                            jaikiran

                            Looking at the stacktrace and the configurations, it appears that you are having some issue where the HornetQ discovery group tries to join a group. The group address and the port are currently configured in JBOSS_HOME/server/< servername>/deploy/hornetq/hornetq-configuration.xml:

                             

                            <broadcast-groups>
                                  <broadcast-group name="bg-group1">
                                     <group-address>231.7.7.7</group-address>
                                     <group-port>9876</group-port>
                                     <broadcast-period>5000</broadcast-period>
                                     <connector-ref connector-name="netty"/>
                                  </broadcast-group>
                               </broadcast-groups>
                            
                               <discovery-groups>
                                  <discovery-group name="dg-group1">
                                     <group-address>231.7.7.7</group-address>
                                     <group-port>9876</group-port>
                                     <refresh-timeout>10000</refresh-timeout>
                                  </discovery-group>
                               </discovery-groups>
                            

                             

                            Are you behind some firewall, which might be blocking that 9876 port?

                             

                            One workaround you could try is - if you do not want clustering for HornetQ, then you can disable this altogether by setting the following in the hornetq-configuration.xml:

                             

                            <clustered>false</clustered>

                             

                            By default, in AS, it is set to true.

                             

                            P.S: These group-address and group-ports should ultimately come from ServiceBindingManger in AS. Do we already have a JIRA for this?

                            • 11. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                              chrismeadows

                              Thanks Jaikiran

                               

                              Problem solved.

                              I'm not behind a firewall, but am on a small private network that has no DNS or a gateway.

                              I've given the servers a default gateway and they're both much happier now

                               

                              FWIW, I didn't hit this problem with MQ or JBM

                              I appreciate HornetQ is a completely different messaging system though

                              • 12. Re: JBoss AS 6.0.0.M3 - Fails to boot when not on network, with HornetQ errors
                                jaikiran

                                jaikiran pai wrote:

                                 


                                 

                                P.S: These group-address and group-ports should ultimately come from ServiceBindingManger in AS. Do we already have a JIRA for this?

                                Created https://jira.jboss.org/jira/browse/JBAS-8026