1 Reply Latest reply on Apr 29, 2008 3:53 PM by brian.stansberry

    Channel.getState() failed

      Hi,

      One of our customers reported a very strange behaviour of the jboss-cluster today. The cluster contains 8 server-nodes (jbossas-4.05) running in the same subnet.
      Everytime one of the nodes starts up the exception below occurs.
      The most funny thing is that everything worked fine when I left the customer last Friday afternoon. My first idea was that either network-settings or configuration-stuff must have change since Friday but the customer claimed that this hasn't happen. The setup of the jboss-instances itself seem to be unchanged anyway.

      2008-04-29 06:33:43,371 INFO [org.jboss.ws.server.ServiceEndpointManager] WebServices: jbossws-1.0.3.SP1 (date=200609291417)
      2008-04-29 06:33:44,958 INFO [org.jboss.jmx.adaptor.snmp.agent.SnmpAgentService] SNMP agent going active
      2008-04-29 06:33:45,541 INFO [org.jboss.cache.factories.InterceptorChainFactory] interceptor chain is:
      class org.jboss.cache.interceptors.CallInterceptor
      class org.jboss.cache.interceptors.PessimisticLockInterceptor
      class org.jboss.cache.interceptors.UnlockInterceptor
      class org.jboss.cache.interceptors.ReplicationInterceptor
      class org.jboss.cache.interceptors.TxInterceptor
      class org.jboss.cache.interceptors.CacheMgmtInterceptor
      2008-04-29 06:33:45,792 INFO [STDOUT]
      -------------------------------------------------------
      GMS: address is xss-b1-4:33014
      -------------------------------------------------------
      2008-04-29 06:33:46,066 INFO [org.jboss.cache.TreeCache] TreeCache local address is xss-b1-4:33014
      2008-04-29 06:33:46,073 INFO [org.jboss.cache.TreeCache] viewAccepted(): [141.209.26.30:33145|43] [141.209.26.30:33145, 141.209.26.29:32774, xss-b2-6:32774, 141.209.26.47:32776, 141.209.26.48:32967, xss-b1-4:33014]
      2008-04-29 06:34:01,073 WARN [org.jboss.system.ServiceController] Problem starting service jboss.cache:service=TomcatClusteringCache
      org.jboss.cache.CacheException: Initial state transfer failed: Channel.getState() returned false
       at org.jboss.cache.TreeCache.fetchStateOnStartup(TreeCache.java:3191)
       at org.jboss.cache.TreeCache.startService(TreeCache.java:1429)
       at org.jboss.cache.aop.PojoCache.startService(PojoCache.java:94)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy8.deploy(Unknown Source)
       at org.jboss.deployment.scanner.URLDeploymentScanner.deploy(URLDeploymentScanner.java:421)
       at org.jboss.deployment.scanner.URLDeploymentScanner.scan(URLDeploymentScanner.java:634)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.doScan(AbstractDeploymentScanner.java:263)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner.startService(AbstractDeploymentScanner.java:336)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:766)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy5.deploy(Unknown Source)
       at org.jboss.system.server.ServerImpl.doStart(ServerImpl.java:482)
       at org.jboss.system.server.ServerImpl.start(ServerImpl.java:362)
       at org.jboss.Main.boot(Main.java:200)
       at org.jboss.Main$1.run(Main.java:490)
       at java.lang.Thread.run(Thread.java:595)
      2008-04-29 06:34:07,822 INFO [at.innovations.configuration.jboss.ConfigServiceLauncher] The JBossBindAddress is: 0.0.0.0
      2008-04-29 06:34:08,467 INFO [org.jboss.ha.framework.interfaces.HAPartition.TestPartition] Initializing
      2008-04-29 06:34:08,508 INFO [STDOUT]
      -------------------------------------------------------
      GMS: address is xss-b1-4:33018 (additional data: 18 bytes)
      -------------------------------------------------------
      2008-04-29 06:34:10,549 INFO [org.jboss.ha.framework.interfaces.HAPartition.TestPartition] Number of cluster members: 2
      2008-04-29 06:34:10,549 INFO [org.jboss.ha.framework.interfaces.HAPartition.TestPartition] Other members: 1
      2008-04-29 06:34:10,550 INFO [org.jboss.ha.framework.interfaces.HAPartition.TestPartition] Fetching state (will wait for 30000 milliseconds):
      2008-04-29 06:34:40,860 WARN [org.jboss.system.ServiceController] Problem starting service jboss:service=TestPartition
      java.lang.IllegalStateException: Initial state transfer failed: Channel.getState() returned false
       at org.jboss.ha.framework.server.HAPartitionImpl.fetchState(HAPartitionImpl.java:351)
       at org.jboss.ha.framework.server.HAPartitionImpl.startPartition(HAPartitionImpl.java:280)
       at org.jboss.ha.framework.server.ClusterPartition.startService(ClusterPartition.java:341)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy8.deploy(Unknown Source)
       at org.jboss.deployment.scanner.URLDeploymentScanner.deploy(URLDeploymentScanner.java:421)
       at org.jboss.deployment.scanner.URLDeploymentScanner.scan(URLDeploymentScanner.java:634)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.doScan(AbstractDeploymentScanner.java:263)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner.startService(AbstractDeploymentScanner.java:336)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:766)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy5.deploy(Unknown Source)
       at org.jboss.system.server.ServerImpl.doStart(ServerImpl.java:482)
       at org.jboss.system.server.ServerImpl.start(ServerImpl.java:362)
       at org.jboss.Main.boot(Main.java:200)
       at org.jboss.Main$1.run(Main.java:490)
       at java.lang.Thread.run(Thread.java:595)
      2008-04-29 06:34:43,771 INFO [org.jboss.mail.MailService] Mail Service bound to java:/Mail
      2008-04-29 06:34:44,233 INFO [org.jboss.resource.deployment.RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-ha-local-jdbc.rar
      2008-04-29 06:34:44,325 INFO [org.jboss.resource.deployment.RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-ha-xa-jdbc.rar
      2008-04-29 06:34:44,381 INFO [org.jboss.resource.deployment.RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-local-jdbc.rar
      2008-04-29 06:34:44,412 INFO [org.jboss.resource.deployment.RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-xa-jdbc.rar
      2008-04-29 06:34:44,467 INFO [org.jboss.resource.deployment.RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jms/jms-ra.rar
      2008-04-29 06:34:44,501 INFO [org.jboss.resource.deployment.RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/mail-ra.rar
      2008-04-29 06:34:45,088 INFO [org.jboss.resource.adapter.jdbc.remote.WrapperDataSourceService] Bound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=hibernateDatasource' to JNDI name 'java:hibernateDatasource'
      2008-04-29 06:34:45,926 INFO [org.jboss.resource.adapter.jdbc.remote.WrapperDataSourceService] Bound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=DefaultDS' to JNDI name 'java:DefaultDS'
      2008-04-29 06:34:46,241 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=JmsXA' to JNDI name 'java:JmsXA'
      2008-04-29 06:34:47,345 ERROR [org.jboss.deployment.scanner.URLDeploymentScanner] Incomplete Deployment listing:
      
      --- Packages waiting for a deployer ---
      org.jboss.deployment.DeploymentInfo@908367ab { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/httpha-invoker.sar/invoker.war/ }
       deployer: null
       status: Starting
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/httpha-invoker.sar/invoker.war/
       altDD: null
       lastDeployed: 1209450882915
       lastModified: 1173861742000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@5ff705f3 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/jbossweb-tomcat55.sar/ROOT.war/ }
       deployer: null
       status: Starting
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/jbossweb-tomcat55.sar/ROOT.war/
       altDD: null
       lastDeployed: 1209450882915
       lastModified: 1173861742000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@fdeba6f1 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/jbossws14.sar/jbossws-context.war }
       deployer: null
       status: Starting
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/jbossws14.sar/jbossws-context.war
       altDD: null
       lastDeployed: 1209450882915
       lastModified: 1209450823000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@1b04707f { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/juddi-service.sar/juddiws.war/ }
       deployer: null
       status: Starting
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/juddi-service.sar/juddiws.war/
       altDD: null
       lastDeployed: 1209450882916
       lastModified: 1173861742000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@f165a99f { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/management/console-mgr.sar/web-console.war/ }
       deployer: null
       status: Starting
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/management/console-mgr.sar/web-console.war/
       altDD: null
       lastDeployed: 1209450882916
       lastModified: 1173861743000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@167cee87 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/jmx-console.war/ }
       deployer: null
       status: null
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/jmx-console.war/
       altDD: null
       lastDeployed: 1209450886247
       lastModified: 1196774607000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@85fe4a10 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/slide.war }
       deployer: null
       status: null
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/slide.war
       altDD: null
       lastDeployed: 1209450886446
       lastModified: 1209450886000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@9ec67868 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/xss-application.war }
       deployer: null
       status: null
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/xss-application.war
       altDD: null
       lastDeployed: 1209450887299
       lastModified: 1209450887000
       mbeans:
      
      --- Incompletely deployed packages ---
      org.jboss.deployment.DeploymentInfo@167cee87 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/jmx-console.war/ }
       deployer: null
       status: null
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/jmx-console.war/
       altDD: null
       lastDeployed: 1209450886247
       lastModified: 1196774607000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@85fe4a10 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/slide.war }
       deployer: null
       status: null
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/slide.war
       altDD: null
       lastDeployed: 1209450886446
       lastModified: 1209450886000
       mbeans:
      
      org.jboss.deployment.DeploymentInfo@9ec67868 { url=file:/application_data/xss/jboss/server/xss-b1-4/deploy/xss-application.war }
       deployer: null
       status: null
       state: INIT_WAITING_DEPLOYER
       watch: file:/application_data/xss/jboss/server/xss-b1-4/deploy/xss-application.war
       altDD: null
       lastDeployed: 1209450887299
       lastModified: 1209450887000
       mbeans:
      
      --- MBeans waiting for other MBeans ---
      ObjectName: jboss.web:service=WebServer
       State: CONFIGURED
       I Depend On:
       jboss.security:service=JaasSecurityManager
       jboss.cache:service=TomcatClusteringCache
       jboss:service=TransactionManager
       jboss.jca:service=CachedConnectionManager
       Depends On Me:
       jboss.ws:service=WebServiceDeployerJSE
       jboss:service=FarmMember,partition=TestPartition
      
      ObjectName: jboss.ws:service=WebServiceDeployerJSE
       State: CONFIGURED
       I Depend On:
       jboss.web:service=WebServer
       Depends On Me:
       jboss.ws:service=DeployerInterceptorNestedJSE
      
      ObjectName: jboss.ws:service=DeployerInterceptorNestedJSE
       State: CONFIGURED
       I Depend On:
       jboss.system:service=MainDeployer
       jboss.ws:service=WebServiceDeployerJSE
      
      ObjectName: jboss.cache:service=TomcatClusteringCache
       State: FAILED
       Reason: org.jboss.cache.CacheException: Initial state transfer failed: Channel.getState() returned false
       I Depend On:
       jboss:service=Naming
       jboss:service=TransactionManager
       jboss.aop:service=AspectDeployer
       Depends On Me:
       jboss.web:service=WebServer
      
      ObjectName: jboss:service=TestPartition
       State: FAILED
       Reason: java.lang.IllegalStateException: Initial state transfer failed: Channel.getState() returned false
       I Depend On:
       jboss:service=Naming
       Depends On Me:
       at.innovations.xss:service=xsscontroller
       jboss:service=HASessionState
       jboss:service=HAJNDI
       jboss.cache:service=InvalidationBridge,type=JavaGroups
       jboss:service=FarmMember,partition=TestPartition
      
      ObjectName: jboss:service=FarmMember,partition=TestPartition
       State: CONFIGURED
       I Depend On:
       jboss:service=TestPartition
       jboss.web:service=WebServer
       jboss.system:service=MainDeployer
      
      --- MBEANS THAT ARE THE ROOT CAUSE OF THE PROBLEM ---
      ObjectName: jboss:service=TestPartition
       State: FAILED
       Reason: java.lang.IllegalStateException: Initial state transfer failed: Channel.getState() returned false
       I Depend On:
       jboss:service=Naming
       Depends On Me:
       at.innovations.xss:service=xsscontroller
       jboss:service=HASessionState
       jboss:service=HAJNDI
       jboss.cache:service=InvalidationBridge,type=JavaGroups
       jboss:service=FarmMember,partition=TestPartition
      
      ObjectName: jboss.cache:service=TomcatClusteringCache
       State: FAILED
       Reason: org.jboss.cache.CacheException: Initial state transfer failed: Channel.getState() returned false
       I Depend On:
       jboss:service=Naming
       jboss:service=TransactionManager
       jboss.aop:service=AspectDeployer
       Depends On Me:
       jboss.web:service=WebServer
      
      
      2008-04-29 06:34:47,613 INFO [org.jboss.system.server.Server] JBoss (MX MicroKernel) [4.0.5.GA (build: CVSTag=Branch_4_0 date=200610162339)] Started in 1m:16s:816ms
      2008-04-29 06:37:54,906 INFO [org.jboss.system.server.Server] Shutting down the server, blockingShutdown: false
      2008-04-29 06:37:54,908 INFO [org.jboss.system.server.Server] Server exit(0) called
      2008-04-29 06:37:54,909 INFO [org.jboss.system.server.Server] Runtime shutdown hook called, forceHalt: true
      2008-04-29 06:37:54,909 INFO [org.jboss.system.server.Server] JBoss SHUTDOWN: Undeploying all packages
      2008-04-29 06:37:54,919 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] Unbound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=JmsXA' from JNDI name 'java:JmsXA'
      2008-04-29 06:37:54,936 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] Unbound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=DefaultDS' from JNDI name 'java:DefaultDS'
      2008-04-29 06:37:55,686 INFO [org.jboss.jdbc.HypersonicDatabase] Database standalone closed clean
      2008-04-29 06:37:55,694 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] Unbound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=hibernateDatasource' from JNDI name 'java:hibernateDatasource'
      2008-04-29 06:37:55,731 INFO [org.jboss.mail.MailService] Mail service 'java:/Mail' removed from JNDI
      2008-04-29 06:37:55,769 INFO [at.innovations.configuration.jboss.ConfigurationService] istbase ConfigurationService stop()
      2008-04-29 06:37:55,769 INFO [at.innovations.util.corba.OrbServices] Will unregister 'global.section/cXMLConfig.Configuration' from the CORBA naming service.
      2008-04-29 06:37:55,852 INFO [at.innovations.configuration.ConfigurationService] The central configuration service was terminated.
      2008-04-29 06:37:55,867 INFO [org.jboss.ha.framework.interfaces.HAPartition.TestPartition] Partition TestPartition destroyed.
      2008-04-29 06:37:56,085 INFO [org.jboss.jmx.adaptor.snmp.agent.SnmpAgentService] SNMP agent stopped
      2008-04-29 06:37:58,160 INFO [org.jboss.system.server.Server] Shutdown complete
      2008-04-29 06:38:44,208 INFO [org.jboss.ws.server.ServiceEndpointManager] WebServices: jbossws-1.0.3.SP1 (date=200609291417)
      2008-04-29 06:38:45,223 INFO [org.jboss.jmx.adaptor.snmp.agent.SnmpAgentService] SNMP agent going active
      2008-04-29 06:38:45,815 INFO [org.jboss.cache.factories.InterceptorChainFactory] interceptor chain is:
      class org.jboss.cache.interceptors.CallInterceptor
      class org.jboss.cache.interceptors.PessimisticLockInterceptor
      class org.jboss.cache.interceptors.UnlockInterceptor
      class org.jboss.cache.interceptors.ReplicationInterceptor
      class org.jboss.cache.interceptors.TxInterceptor
      class org.jboss.cache.interceptors.CacheMgmtInterceptor
      2008-04-29 06:38:46,058 INFO [STDOUT]
      -------------------------------------------------------
      GMS: address is xss-b1-4:33023
      -------------------------------------------------------
      2008-04-29 06:38:46,324 INFO [org.jboss.cache.TreeCache] viewAccepted(): [141.209.26.30:33145|45] [141.209.26.30:33145, 141.209.26.29:32774, xss-b2-6:32774, 141.209.26.47:32776, 141.209.26.48:32967, xss-b1-4:33023]
      2008-04-29 06:38:46,333 INFO [org.jboss.cache.TreeCache] TreeCache local address is xss-b1-4:33023
      2008-04-29 06:39:01,340 WARN [org.jboss.system.ServiceController] Problem starting service jboss.cache:service=TomcatClusteringCache
      org.jboss.cache.CacheException: Initial state transfer failed: Channel.getState() returned false
       at org.jboss.cache.TreeCache.fetchStateOnStartup(TreeCache.java:3191)
       at org.jboss.cache.TreeCache.startService(TreeCache.java:1429)
       at org.jboss.cache.aop.PojoCache.startService(PojoCache.java:94)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy8.deploy(Unknown Source)
       at org.jboss.deployment.scanner.URLDeploymentScanner.deploy(URLDeploymentScanner.java:421)
       at org.jboss.deployment.scanner.URLDeploymentScanner.scan(URLDeploymentScanner.java:634)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.doScan(AbstractDeploymentScanner.java:263)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner.startService(AbstractDeploymentScanner.java:336)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:766)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy5.deploy(Unknown Source)
       at org.jboss.system.server.ServerImpl.doStart(ServerImpl.java:482)
       at org.jboss.system.server.ServerImpl.start(ServerImpl.java:362)
       at org.jboss.Main.boot(Main.java:200)
       at org.jboss.Main$1.run(Main.java:490)
       at java.lang.Thread.run(Thread.java:595)
      2008-04-29 06:39:07,473 INFO [at.innovations.configuration.jboss.ConfigServiceLauncher] The JBossBindAddress is: 0.0.0.0
      2008-04-29 06:39:08,061 INFO [org.jboss.ha.framework.interfaces.HAPartition.TestPartition] Initializing
      2008-04-29 06:39:08,140 INFO [STDOUT]
      -------------------------------------------------------
      GMS: address is xss-b1-4:33027 (additional data: 18 bytes)
      -------------------------------------------------------
       and so on....
      

      It would be great if anyone had an idea how to solve that. I wasn't able to reproduce this behaviour with my test-environment.
      Thanx in advance,

      Michael

        • 1. Re: Channel.getState() failed
          brian.stansberry

          Have a look at the logs for the server at 141.209.26.30 -- that's the one the state transfer request is going to.

          From a look at the logs, it seems like the failures are due to not getting a state transfer response within the configured timeout. Often that would be due to some issue on the server that's provided the state.