7 Replies Latest reply on Nov 5, 2008 11:21 AM by karianna

    java.lang.IllegalStateException: Didn't load expected number

    sentcs

       


      Hi,

      we are deployed the JBoss 4.2.3 with JBoss-messaging-1.4.0 in Production environment. It was working fine for last one month.Now we are getting following exception when we starting the JBoss.

      Please tell me the soultion to resove this issue.


      java version "1.6.0_07"
      Java(TM) SE Runtime Environment (build 1.6.0_07-b06)
      Java HotSpot(TM) Server VM (build 10.0-b23, mixed mode)
      /opt/jdk1.6.0_07
      =========================================================================
      
       JBoss Bootstrap Environment
      
       JBOSS_HOME: /opt/jboss-4.2.3.GA
      
       JAVA: /opt/jdk1.6.0_07/bin/java
      
       JAVA_OPTS: -Dprogram.name=run.sh -server -Xms128m -Xmx512m -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.net.preferIPv4Stack=true
      
       CLASSPATH: /opt/jboss-4.2.3.GA/bin/run.jar:/opt/jdk1.6.0_07/lib/tools.jar
      
      =========================================================================
      
      14:59:02,980 INFO [Server] Starting JBoss (MX MicroKernel)...
      14:59:02,981 INFO [Server] Release ID: JBoss [Trinity] 4.2.3.GA (build: SVNTag=JBoss_4_2_3_GA date=200807181439)
      14:59:02,982 INFO [Server] Home Dir: /opt/jboss-4.2.3.GA
      14:59:02,982 INFO [Server] Home URL: file:/opt/jboss-4.2.3.GA/
      14:59:02,983 INFO [Server] Patch URL: null
      14:59:02,983 INFO [Server] Server Name: messaging
      14:59:02,983 INFO [Server] Server Home Dir: /opt/jboss-4.2.3.GA/server/messaging
      14:59:02,983 INFO [Server] Server Home URL: file:/opt/jboss-4.2.3.GA/server/messaging/
      14:59:02,983 INFO [Server] Server Log Dir: /opt/jboss-4.2.3.GA/server/messaging/log
      14:59:02,983 INFO [Server] Server Temp Dir: /opt/jboss-4.2.3.GA/server/messaging/tmp
      14:59:02,983 INFO [Server] Root Deployment Filename: jboss-service.xml
      14:59:03,197 INFO [ServerInfo] Java version: 1.6.0_07,Sun Microsystems Inc.
      14:59:03,197 INFO [ServerInfo] Java VM: Java HotSpot(TM) Server VM 10.0-b23,Sun Microsystems Inc.
      14:59:03,197 INFO [ServerInfo] OS-System: Linux 2.6.5-7.244-bigsmp,i386
      14:59:03,495 INFO [Server] Core system initialized
      14:59:05,282 INFO [WebService] Using RMI server codebase: http://172.19.6.5:8083/
      14:59:05,284 INFO [Log4jService$URLWatchTimerTask] Configuring from URL: resource:jboss-log4j.xml
      14:59:05,636 INFO [TransactionManagerService] JBossTS Transaction Service (JTA version) - JBoss Inc.
      14:59:05,636 INFO [TransactionManagerService] Setting up property manager MBean and JMX layer
      14:59:05,863 INFO [TransactionManagerService] Starting recovery manager
      14:59:05,930 INFO [TransactionManagerService] Recovery manager started
      14:59:05,930 INFO [TransactionManagerService] Binding TransactionManager JNDI Reference
      14:59:08,007 INFO [EJB3Deployer] Starting java:comp multiplexer
      14:59:10,472 INFO [NativeServerConfig] JBoss Web Services - Native
      14:59:10,472 INFO [NativeServerConfig] jbossws-3.0.1-native-2.0.4.GA (build=200803312044)
      14:59:11,150 INFO [Embedded] Catalina naming disabled
      14:59:11,248 INFO [AprLifecycleListener] The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /opt/jdk1.6.0_07/jre/lib/i386/server:/opt/jdk1.6.0_07/jre/lib/i386:/opt/jdk1.6.0_07/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
      14:59:11,375 INFO [Http11Protocol] Initializing Coyote HTTP/1.1 on http-172.19.6.5-8080
      14:59:11,375 INFO [AjpProtocol] Initializing Coyote AJP/1.3 on ajp-172.19.6.5-8009
      14:59:11,376 INFO [Catalina] Initialization processed in 225 ms
      14:59:11,376 INFO [StandardService] Starting service jboss.web
      14:59:11,377 INFO [StandardEngine] Starting Servlet Engine: JBossWeb/2.0.1.GA
      14:59:11,408 INFO [Catalina] Server startup in 32 ms
      14:59:11,478 INFO [TomcatDeployer] deploy, ctxPath=/, warUrl=.../deploy/jboss-web.deployer/ROOT.war/
      14:59:11,959 INFO [TomcatDeployer] deploy, ctxPath=/invoker, warUrl=.../deploy/http-invoker.sar/invoker.war/
      14:59:12,069 INFO [TomcatDeployer] deploy, ctxPath=/jbossws, warUrl=.../deploy/jbossws.sar/jbossws-context.war/
      14:59:12,351 INFO [TomcatDeployer] deploy, ctxPath=/web-console, warUrl=.../deploy/management/console-mgr.sar/web-console.war/
      14:59:12,708 INFO [MailService] Mail Service bound to java:/Mail
      14:59:12,795 INFO [RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-ha-local-jdbc.rar
      14:59:12,823 INFO [RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-ha-xa-jdbc.rar
      14:59:12,899 INFO [RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-local-jdbc.rar
      14:59:12,988 INFO [RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jboss-xa-jdbc.rar
      14:59:13,123 INFO [RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/jms-ra.rar
      14:59:13,142 INFO [RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/mail-ra.rar
      14:59:13,166 INFO [RARDeployment] Required license terms exist, view META-INF/ra.xml in .../deploy/quartz-ra.rar
      14:59:13,171 INFO [QuartzResourceAdapter] start quartz!!!
      14:59:13,303 INFO [SimpleThreadPool] Job execution threads will use class loader of thread: main
      14:59:13,322 INFO [QuartzScheduler] Quartz Scheduler v.1.5.2 created.
      14:59:13,324 INFO [RAMJobStore] RAMJobStore initialized.
      14:59:13,325 INFO [StdSchedulerFactory] Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz package: 'quartz.properties'
      14:59:13,325 INFO [StdSchedulerFactory] Quartz scheduler version: 1.5.2
      14:59:13,325 INFO [QuartzScheduler] Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED started.
      14:59:13,485 INFO [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=JmsXA' to JNDI name 'java:JmsXA'
      14:59:13,568 INFO [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=DefaultDS' to JNDI name 'java:DefaultDS'
      14:59:14,288 INFO [ServerPeer] JBoss Messaging 1.4.0.SP3 server [0] started
      14:59:14,879 INFO [ConnectionFactory] Connector bisocket://172.19.6.5:4457 has leasing enabled, lease period 10000 milliseconds
      14:59:14,879 INFO [ConnectionFactory] org.jboss.jms.server.connectionfactory.ConnectionFactory@1851576 started
      14:59:14,880 WARN [ConnectionFactoryJNDIMapper] supportsFailover attribute is true on connection factory: jboss.messaging.connectionfactory:service=ClusteredConnectionFactory but post office is non clustered. So connection factory will *not* support failover
      14:59:14,881 WARN [ConnectionFactoryJNDIMapper] supportsLoadBalancing attribute is true on connection factory: jboss.messaging.connectionfactory:service=ClusteredConnectionFactory but post office is non clustered. So connection factory will *not* support load balancing
      14:59:14,882 INFO [ConnectionFactory] Connector bisocket://172.19.6.5:4457 has leasing enabled, lease period 10000 milliseconds
      14:59:14,882 INFO [ConnectionFactory] org.jboss.jms.server.connectionfactory.ConnectionFactory@4e0456 started
      14:59:14,883 INFO [ConnectionFactory] Connector bisocket://172.19.6.5:4457 has leasing enabled, lease period 10000 milliseconds
      14:59:14,883 INFO [ConnectionFactory] org.jboss.jms.server.connectionfactory.ConnectionFactory@dd5a9d started
      14:59:18,029 INFO [QueueService] Queue[/queue/DLQ] started, fullSize=200000, pageSize=2000, downCacheSize=2000
      14:59:20,993 INFO [QueueService] Queue[/queue/ExpiryQueue] started, fullSize=200000, pageSize=2000, downCacheSize=2000
      15:16:05,657 INFO [TopicService] Topic[/topic/CRMTOPIC] started, fullSize=100, pageSize=50, downCacheSize=50
      15:22:44,281 WARN [SimpleConnectionManager] ConnectionManager[1b04310] cannot look up remoting session ID a0cc-3uw4ve-fmx6ul81-1-fmx7ojsf-ex
      15:22:44,282 WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client a0cc-3uw4ve-fmx6ul81-1-fmx7ojsf-ex, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All connection resources corresponding to that client process will now be removed.
      15:22:44,282 WARN [SimpleConnectionManager] ConnectionManager[1b04310] cannot look up remoting session ID a0cc-3uw4ve-fmx6ul81-1-fmx7pt3x-ff
      15:22:44,282 WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client a0cc-3uw4ve-fmx6ul81-1-fmx7pt3x-ff, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All connection resources corresponding to that client process will now be removed.
      15:29:17,119 ERROR [ExceptionUtil] Topic[null, name=POSTOPIC] startService
      java.lang.IllegalStateException: Didn't load expected number of references, loaded: 43 expected: 50
       at org.jboss.messaging.core.impl.JDBCPersistenceManager.getPagedReferenceInfos(JDBCPersistenceManager.java:879)
       at org.jboss.messaging.core.impl.PagingChannelSupport.loadPagedReferences(PagingChannelSupport.java:251)
       at org.jboss.messaging.core.impl.PagingChannelSupport.checkLoad(PagingChannelSupport.java:359)
       at org.jboss.messaging.core.impl.PagingChannelSupport.load(PagingChannelSupport.java:216)
       at org.jboss.jms.server.destination.TopicService.startService(TopicService.java:82)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.start(ServiceMBeanSupport.java:196)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:995)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:304)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy42.start(Unknown Source)
       at org.jboss.deployment.XSLSubDeployer.start(XSLSubDeployer.java:197)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy9.deploy(Unknown Source)
       at org.jboss.deployment.scanner.URLDeploymentScanner.deploy(URLDeploymentScanner.java:421)
       at org.jboss.deployment.scanner.URLDeploymentScanner.scan(URLDeploymentScanner.java:634)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.doScan(AbstractDeploymentScanner.java:263)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner.startService(AbstractDeploymentScanner.java:336)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:304)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:766)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy5.deploy(Unknown Source)
       at org.jboss.system.server.ServerImpl.doStart(ServerImpl.java:482)
       at org.jboss.system.server.ServerImpl.start(ServerImpl.java:362)
       at org.jboss.Main.boot(Main.java:200)
       at org.jboss.Main$1.run(Main.java:508)
       at java.lang.Thread.run(Thread.java:619)
      15:29:17,121 WARN [ServiceController] Problem starting service jboss.messaging.destination:service=Topic,name=POSTOPIC
      java.lang.IllegalStateException: Didn't load expected number of references, loaded: 43 expected: 50
       at org.jboss.messaging.core.impl.JDBCPersistenceManager.getPagedReferenceInfos(JDBCPersistenceManager.java:879)
       at org.jboss.messaging.core.impl.PagingChannelSupport.loadPagedReferences(PagingChannelSupport.java:251)
       at org.jboss.messaging.core.impl.PagingChannelSupport.checkLoad(PagingChannelSupport.java:359)
       at org.jboss.messaging.core.impl.PagingChannelSupport.load(PagingChannelSupport.java:216)
       at org.jboss.jms.server.destination.TopicService.startService(TopicService.java:82)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.start(ServiceMBeanSupport.java:196)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:995)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at org.jboss.system.ServiceController.start(ServiceController.java:435)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:304)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy42.start(Unknown Source)
       at org.jboss.deployment.XSLSubDeployer.start(XSLSubDeployer.java:197)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy9.deploy(Unknown Source)
       at org.jboss.deployment.scanner.URLDeploymentScanner.deploy(URLDeploymentScanner.java:421)
       at org.jboss.deployment.scanner.URLDeploymentScanner.scan(URLDeploymentScanner.java:634)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.doScan(AbstractDeploymentScanner.java:263)
       at org.jboss.deployment.scanner.AbstractDeploymentScanner.startService(AbstractDeploymentScanner.java:336)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
       at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:245)
       at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.system.ServiceController$ServiceProxy.invoke(ServiceController.java:978)
       at $Proxy0.start(Unknown Source)
       at org.jboss.system.ServiceController.start(ServiceController.java:417)
       at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy4.start(Unknown Source)
       at org.jboss.deployment.SARDeployer.start(SARDeployer.java:304)
       at org.jboss.deployment.MainDeployer.start(MainDeployer.java:1025)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:819)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:782)
       at org.jboss.deployment.MainDeployer.deploy(MainDeployer.java:766)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:155)
       at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
       at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:133)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:142)
       at org.jboss.mx.server.Invocation.invoke(Invocation.java:88)
       at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
       at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659)
       at org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:210)
       at $Proxy5.deploy(Unknown Source)
       at org.jboss.system.server.ServerImpl.doStart(ServerImpl.java:482)
       at org.jboss.system.server.ServerImpl.start(ServerImpl.java:362)
       at org.jboss.Main.boot(Main.java:200)
       at org.jboss.Main$1.run(Main.java:508)
       at java.lang.Thread.run(Thread.java:619)
      15:29:17,123 INFO [TopicService] Topic[/topic/receiverShutdownTopic] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:17,124 INFO [TopicService] Topic[/topic/shutdownthisreceiverTopic] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:17,125 INFO [TopicService] Topic[/topic/registeredreceiverTopic] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:17,125 INFO [TopicService] Topic[/topic/healthTopic] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:20,010 INFO [QueueService] Queue[/queue/activeListenerQueue] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:22,829 INFO [QueueService] Queue[/queue/sentMessageQueue] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:25,864 INFO [QueueService] Queue[/queue/failureMessageQueue] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:29,162 INFO [QueueService] Queue[/queue/replyMessageQueue] started, fullSize=100, pageSize=50, downCacheSize=50
      15:29:29,229 INFO [TomcatDeployer] deploy, ctxPath=/jmx-console, warUrl=.../deploy/jmx-console.war/
      15:29:29,301 ERROR [URLDeploymentScanner] Incomplete Deployment listing:
      
      --- MBeans waiting for other MBeans ---
      ObjectName: jboss.messaging.destination:service=Topic,name=POSTOPIC
       State: FAILED
       Reason: java.lang.IllegalStateException: Didn't load expected number of references, loaded: 43 expected: 50
       I Depend On:
       jboss.messaging:service=ServerPeer
       jboss.messaging:service=PostOffice
      
      --- MBEANS THAT ARE THE ROOT CAUSE OF THE PROBLEM ---
      ObjectName: jboss.messaging.destination:service=Topic,name=POSTOPIC
       State: FAILED
       Reason: java.lang.IllegalStateException: Didn't load expected number of references, loaded: 43 expected: 50
       I Depend On:
       jboss.messaging:service=ServerPeer
       jboss.messaging:service=PostOffice
      
      
      15:29:29,378 INFO [Http11Protocol] Starting Coyote HTTP/1.1 on http-172.19.6.5-8080
      15:29:29,392 INFO [AjpProtocol] Starting Coyote AJP/1.3 on ajp-172.19.6.5-8009
      15:29:29,399 INFO [Server] JBoss (MX MicroKernel) [4.2.3.GA (build: SVNTag=JBoss_4_2_3_GA date=200807181439)] Started in 30m:26s:414ms
      15:39:23,708 WARN [SimpleConnectionManager] ConnectionManager[1b04310] cannot look up remoting session ID a0fc-porocx-fmx74xc6-1-fmx75xya-i
      15:39:23,708 WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client a0fc-porocx-fmx74xc6-1-fmx75xya-i, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All connection resources corresponding to that client process will now be removed.
      15:39:23,709 WARN [SimpleConnectionManager] ConnectionManager[1b04310] cannot look up remoting session ID a0fc-porocx-fmx74xc6-1-fmx75qdy-d
      15:39:23,709 WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client a0fc-porocx-fmx74xc6-1-fmx75qdy-d, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All connection resources corresponding to that client process will now be removed.
      15:39:23,709 WARN [SimpleConnectionManager] ConnectionManager[1b04310] cannot look up remoting session ID a0fc-porocx-fmx74xc6-1-fmx74ztw-4
      15:39:23,709 WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client a0fc-porocx-fmx74xc6-1-fmx74ztw-4, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All connection resources corresponding to that client process will now be removed.
      15:40:37,165 WARN [SimpleConnectionManager] ConnectionManager[1b04310] cannot look up remoting session ID a0ec-pai3n7-fmx6q618-1-fmx79yie-6b
      15:40:37,166 WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client a0ec-pai3n7-fmx6q618-1-fmx79yie-6b, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All connection resources corresponding to that client process will now be removed.
      15:40:37,166 WARN [SimpleConnectionManager] ConnectionManager[1b04310] cannot look up remoting session ID a0ec-pai3n7-fmx6q618-1-fmx76zjg-5g
      15:40:37,166 WARN [SimpleConnectionManager] A problem has been detected with the connection to remote client a0ec-pai3n7-fmx6q618-1-fmx76zjg-5g, jmsClientID=null. It is possible the client has exited without closing its connection(s) or the network has failed. All connection resources corresponding to that client process will now be removed.