3 Replies Latest reply on Sep 15, 2006 12:21 PM by brian.stansberry

    ClusterFileTransferException

    logankiefer

      Environment JBoss 4.0.4 using Farm clustering deployment.

      I'm getting the error message below when I start up a new jboss server on a different machine. It adds itself to the cluster, but when it tries to pull down the ear files I get the error below. It successfully pulled over the cluster-examples-service.xml, but is unable to pull any of the ear files.

      If I switch the order of which jboss server comes up first then it works fine.


      18:37:37,772 INFO [FarmMemberService] **** pullNewDeployments ****
      18:37:37,772 INFO [ClusterFileTransfer] Start pull of file cluster-examples-service.xml from cluster.
      18:37:37,850 INFO [ClusterFileTransfer] Finished cluster pull of file cluster-examples-service.xml to cluster-examples-service.xml
      18:37:37,850 INFO [ClusterFileTransfer] Start pull of file hello.ear from cluster.
      18:38:48,771 ERROR [STDERR] org.jboss.ha.framework.server.ClusterFileTransfer$ClusterFileTransferException: An error occured on remote machine trying to read file 'farm\hello.ear'. Is remote still running?. Also, we couldn't delete temp file hello.ear
      18:38:48,771 ERROR [STDERR] at org.jboss.ha.framework.server.ClusterFileTransfer.pull(ClusterFileTransfer.java:122)
      18:38:48,771 ERROR [STDERR] at org.jboss.ha.framework.server.FarmMemberService.pullNewDeployments(FarmMemberService.java:229)
      18:38:48,771 ERROR [STDERR] at org.jboss.ha.framework.server.FarmMemberService.startService(FarmMemberService.java:189)
      18:38:48,771 ERROR [STDERR] at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
      18:38:48,771 ERROR [STDERR] at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)

        • 1. Re: ClusterFileTransferException
          smarlow

          Something went wrong on the first machine that you started as that is where we are trying to pull hello.ear from.

          Check the console of the machine that you started first. I'm hoping that we will see an error message there indicating what went wrong when we tried to pull hello.ear.

          • 2. Re: ClusterFileTransferException
            dadnee

            we are facing exactly same problem as well. In clustered configuration when one of the server is restarted it starts pulling files and fails with following exception (at the bottom it says IndexOutOfBoundsException)

            Any leads on this one will be helpful

            2006-09-15 16:50:35,366 242707 INFO [org.jboss.ha.framework.server.ClusterFileTransfer] (main:) Start pull of file XYZ-2.0.0.ear from cluster.
            2006-09-15 16:51:35,369 302710 ERROR [STDERR] (main:) org.jboss.ha.framework.server.ClusterFileTransfer$ClusterFileTransferException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at org.jboss.ha.framework.server.ClusterFileTransfer.pull(ClusterFileTransfer.java:158)
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at org.jboss.ha.framework.server.FarmMemberService.pullNewDeployments(FarmMemberService.java:229)
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at org.jboss.ha.framework.server.FarmMemberService.startService(FarmMemberService.java:189)
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            2006-09-15 16:51:35,370 302711 ERROR [STDERR] (main:) at java.lang.reflect.Method.invoke(Method.java:585)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at $Proxy0.start(Unknown Source)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.system.ServiceController.start(ServiceController.java:417)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at java.lang.reflect.Method.invoke(Method.java:585)
            2006-09-15 16:51:35,371 302712 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at $Proxy4.start(Unknown Source)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1007)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.start(MainDeployer.java:997)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:808)
            2006-09-15 16:51:35,372 302713 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:771)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at java.lang.reflect.Method.invoke(Method.java:585)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
            2006-09-15 16:51:35,373 302714 ERROR [STDERR] (main:) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at $Proxy6.deploy(Unknown Source)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at org.jboss.deployment.scanner.URLDeploymentScanner.deploy(URLDeploymentScanner.java:421)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at org.jboss.deployment.scanner.URLDeploymentScanner.scan(URLDeploymentScanner.java:634)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.doScan(AbstractDeploymentScanner.java:263)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at org.jboss.deployment.scanner.AbstractDeploymentScanner.startService(AbstractDeploymentScanner.java:336)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            2006-09-15 16:51:35,374 302715 ERROR [STDERR] (main:) at java.lang.reflect.Method.invoke(Method.java:585)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at $Proxy0.start(Unknown Source)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at org.jboss.system.ServiceController.start(ServiceController.java:417)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
            2006-09-15 16:51:35,375 302716 ERROR [STDERR] (main:) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at java.lang.reflect.Method.invoke(Method.java:585)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at $Proxy4.start(Unknown Source)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.deployment.SARDeployer.start(SARDeployer.java:302)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1007)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:808)
            2006-09-15 16:51:35,376 302717 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:771)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:755)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at java.lang.reflect.Method.invoke(Method.java:585)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
            2006-09-15 16:51:35,377 302718 ERROR [STDERR] (main:) at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at $Proxy5.deploy(Unknown Source)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at org.jboss.system.server.ServerImpl.doStart(ServerImpl.java:482)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at org.jboss.system.server.ServerImpl.start(ServerImpl.java:362)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at org.jboss.Main.boot(Main.java:200)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at org.jboss.Main$1.run(Main.java:464)
            2006-09-15 16:51:35,378 302719 ERROR [STDERR] (main:) at java.lang.Thread.run(Thread.java:595)
            2006-09-15 16:51:35,379 302720 ERROR [STDERR] (main:) Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
            2006-09-15 16:51:35,379 302720 ERROR [STDERR] (main:) at java.util.ArrayList.RangeCheck(ArrayList.java:546)
            2006-09-15 16:51:35,379 302720 ERROR [STDERR] (main:) at java.util.ArrayList.get(ArrayList.java:321)
            2006-09-15 16:51:35,379 302720 ERROR [STDERR] (main:) at org.jboss.ha.framework.server.ClusterFileTransfer.pull(ClusterFileTransfer.java:101)
            2006-09-15 16:51:35,379 302720 ERROR [STDERR] (main:) ... 96 more
            2006-09-15 16:51:35,379 302720 ERROR [org.jboss.ha.framework.server.FarmMemberService] (main:) org.jboss.ha.framework.server.ClusterFileTransfer$ClusterFileTransferException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0

            • 3. Re: ClusterFileTransferException
              brian.stansberry

              When the new node tried to retrieve the file from the coordinator, it didn't get a response. You need to check the logs for both servers to see if there is any indication why it didn't get a response.

              The ClusterFileTransfer code was disguising the non-response as an ArrayIndexOutOfBoundsException; I've fixed that. Also it no longer dumps the stack trace to syserr, just to log4j.