6 Replies Latest reply on Mar 16, 2011 9:18 AM by jaikiran

    EJBTimer Restart Issue : Dropped/Failed Timer Execution

    kyle.bober

      Running JBoss 5.1.0.GA

      Here is the situation: I launch a series of EJBTimers that are scheduled to run in the future. I shut down JBoss and restart the server. Upon Jboss restart I notice a good portion of the EJBTimer(s) which were scheduled to execute fail on JBoss restart. This is what I see in the log:

      
      10:02:35,250 ERROR [TimerImpl] Error invoking ejbTimeout
      org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
       at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:6
      2)
       at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
       at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterce
      ptor.java:67)
       at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
       at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
       at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.jav
      a:44)
       at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
       at java.util.TimerThread.mainLoop(Timer.java:512)
       at java.util.TimerThread.run(Timer.java:462)
      


      It almost looks as if my EJBTimer bean hasn't fully loaded or something else related to the EJB Container at hand. The unfortunate thing about this is that a good portion of the EJBTimer(s) that were schedule to execute are never executed and are removed from the Timers Table. Yet some of the EJBTimer(s) are successfully kicked of and executed properly. Any ideas as to why or what could be causing this issue and how to rectify it???

      Here is the EJBTimer code snippet:

      @Stateless
      @Remote
      @RemoteBinding(jndiBinding=IProcessTimerService.PROCESS_TIMER_EJB_JNDI)
      @TransactionManagement(TransactionManagementType.BEAN)
      public class ProcessTimerService implements IProcessTimerService { ... }
      



      Thanks again for your help!

      FYI: Here are a couple other posts related to what seems to be a similar issue http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4212804#4212804

        • 1. Re: EJBTimer Restart Issue : Dropped/Failed Timer Execution
          jaikiran

          Looking at the stacktrace it appears that the timer is triggered even before the EJB container is probably completely started. Can you post the entire console logs (not server.log) - even the lines after this exception stacktrace.

          • 2. Re: EJBTimer Restart Issue : Dropped/Failed Timer Execution
            kyle.bober

            Thanks for the response! I am just glad that someone is listening on the other end :)

            Here is a the log output from our console:

            10:59:19,843 INFO [ServerImpl] Starting JBoss (Microcontainer)...
            10:59:19,843 INFO [ServerImpl] Release ID: JBoss [The Oracle] 5.1.0.GA (build: SVNTag=JBoss_5_1_0_GA date=200905221053)
            10:59:19,843 INFO [ServerImpl] Bootstrap URL: null
            10:59:19,843 INFO [ServerImpl] Home Dir: C:\ApplicationServers\jboss-5.1.0.GA
            10:59:19,843 INFO [ServerImpl] Home URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/
            10:59:19,843 INFO [ServerImpl] Library URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/lib/
            10:59:19,843 INFO [ServerImpl] Patch URL: null
            10:59:19,843 INFO [ServerImpl] Common Base URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/common/
            10:59:19,843 INFO [ServerImpl] Common Library URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/common/lib/
            10:59:19,843 INFO [ServerImpl] Server Name: default
            10:59:19,843 INFO [ServerImpl] Server Base Dir: C:\ApplicationServers\jboss-5.1.0.GA\server
            10:59:19,843 INFO [ServerImpl] Server Base URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/server/
            10:59:19,843 INFO [ServerImpl] Server Config URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/conf/
            10:59:19,843 INFO [ServerImpl] Server Home Dir: C:\ApplicationServers\jboss-5.1.0.GA\server\default
            10:59:19,843 INFO [ServerImpl] Server Home URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/
            10:59:19,843 INFO [ServerImpl] Server Data Dir: C:\ApplicationServers\jboss-5.1.0.GA\server\default\data
            10:59:19,843 INFO [ServerImpl] Server Library URL: file:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/lib/
            10:59:19,843 INFO [ServerImpl] Server Log Dir: C:\ApplicationServers\jboss-5.1.0.GA\server\default\log
            10:59:19,843 INFO [ServerImpl] Server Native Dir: C:\ApplicationServers\jboss-5.1.0.GA\server\default\tmp\native
            10:59:19,843 INFO [ServerImpl] Server Temp Dir: C:\ApplicationServers\jboss-5.1.0.GA\server\default\tmp
            10:59:19,843 INFO [ServerImpl] Server Temp Deploy Dir: C:\ApplicationServers\jboss-5.1.0.GA\server\default\tmp\deploy
            10:59:20,343 INFO [ServerImpl] Starting Microcontainer, bootstrapURL=file:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/conf/bootstrap.xml
            10:59:20,812 INFO [VFSCacheFactory] Initializing VFSCache [org.jboss.virtual.plugins.cache.CombinedVFSCache]
            10:59:20,828 INFO [VFSCacheFactory] Using VFSCache [CombinedVFSCache[real-cache: null]]
            10:59:21,062 INFO [CopyMechanism] VFS temp dir: C:\ApplicationServers\jboss-5.1.0.GA\server\default\tmp
            10:59:21,093 INFO [ZipEntryContext] VFS force nested jars copy-mode is enabled.
            10:59:22,000 INFO [ServerInfo] Java version: 1.5.0_15,Sun Microsystems Inc.
            10:59:22,000 INFO [ServerInfo] Java Runtime: Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_15-b04)
            10:59:22,000 INFO [ServerInfo] Java VM: Java HotSpot(TM) Client VM 1.5.0_15-b04,Sun Microsystems Inc.
            10:59:22,000 INFO [ServerInfo] OS-System: Windows XP 5.1,x86
            10:59:22,000 INFO [ServerInfo] VM arguments: -Dprogram.name=JBossTools JBoss 5.0 Runtime -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.endorsed.dirs=C:/ApplicationServers/jboss-5.1.0.GA/lib/endorsed -Xms256m -Xmx1024m -XX:MaxPermSize=256m -Dfile.encoding=Cp1252
            10:59:22,015 INFO [JMXKernel] Legacy JMX core initialized
            10:59:23,843 INFO [ProfileServiceBootstrap] Loading profile: ProfileKey@18e252[domain=default, server=default, name=default]
            10:59:25,328 INFO [WebService] Using RMI server codebase: http://localhost:8083/
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule bsh.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb3.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jboss-aop-jboss5.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jboss-jca.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jboss-threads.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jbossweb.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jbossws.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule seam.deployer:0.0.0
            10:59:26,781 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule webbeans.deployer:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule xnio.deployer:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule alias-deployers-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule clustering-deployer-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule dependency-deployers-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule directory-deployer-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ear-deployer-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb-deployer-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule hibernate-deployer-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jsr77-deployers-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule logbridge-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule messaging-definitions-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule metadata-deployer-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule security-deployer-jboss-beans.xml:0.0.0
            10:59:26,796 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jboss-ejb3-endpoint-deployer.jar:0.0.0
            10:59:31,546 INFO [AbstractServerConfig] JBoss Web Services - CXF Server
            10:59:31,546 INFO [AbstractServerConfig] 3.2.0.GA
            10:59:32,453 INFO [AttributeCallbackItem] Owner callback not implemented.
            10:59:35,843 INFO [LogNotificationListener] Adding notification listener for logging mbean "jboss.system:service=Logging,type=Log4jService" to server org.jboss.mx.server.MBeanServerImpl@c4afc4[ defaultDomain='jboss' ]
            10:59:46,234 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb3-interceptors-aop.xml:0.0.0
            10:59:46,234 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule cache-invalidation-service.xml:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule connection-factories-service.xml:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@125871f{jboss.console:sar=console-mgr.sar} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/management/console-mgr.sar/:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@1f52524{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/management/console-mgr.sar/web-console.war/} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/management/console-mgr.sar/web-console.war/:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule destinations-service.xml:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb2-timer-service.xml:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule http-invoker.sar:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@a26301{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/http-invoker.sar/invoker.war/} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/http-invoker.sar/invoker.war/:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jbossweb.sar:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jbossws.sar:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@fd025d{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/jbossws.sar/jbossws-management.war/} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/jbossws.sar/jbossws-management.war/:0.0.0
            10:59:46,250 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jmx-invoker-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jmx-remoting.sar:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jsr88-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule juddi-service.sar:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@1dbc091{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/juddi-service.sar/juddi.war/} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/juddi-service.sar/juddi.war/:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule legacy-invokers-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule legacy-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule mail-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule messaging-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule monitoring-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule mysql-persistence-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule properties-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule remoting-bisocket-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule schedule-manager-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule scheduler-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule sqlexception-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule transaction-service.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule uuid-key-generator.sar:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb2-container-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb3-connectors-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb3-container-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule ejb3-timerservice-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule hdscanner-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jca-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule messaging-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule profileservice-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule remoting-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule security-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule security-policies-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule transaction-jboss-beans.xml:0.0.0
            10:59:46,265 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule vfs-jboss-beans.xml:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jboss-local-jdbc.rar:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jboss-xa-jdbc.rar:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jms-ra.rar:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule mail-ra.rar:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule quartz-ra.rar:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule jms-ds.xml:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule mysql-ds.xml:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule profileservice-secured.jar:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule xnio-provider.jar:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@3f9786{org.jboss.on:loader=embedded} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/admin-console.war/:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@f4e9d3{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/ROOT.war/} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/ROOT.war/:0.0.0
            10:59:46,281 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@12330a6{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/jmx-console.war/} add module VFSDeploymentClassLoaderPolicyModule vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/jmx-console.war/:0.0.0
            10:59:46,296 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@717d91{DefaultDomain} add module VFSDeploymentClassLoaderPolicyModule svc-kat0.0.1--SNAPSHOT.ear:0.0.0
            10:59:46,296 DEBUG [Domain] org.jboss.classloading.spi.dependency.Domain@1c28c8{vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/svc-kat0.0.1--SNAPSHOT.ear/service-kat-war-0.0.1-SNAPSHOT.war/} add module VFSDeploymentClassLoaderPolicyModule vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/svc-kat0.0.1--SNAPSHOT.ear/service-kat-war-0.0.1-SNAPSHOT.war/:0.0.0
            10:59:55,781 INFO [Ejb3DependenciesDeployer] Encountered deployment AbstractVFSDeploymentContext@7836414{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/profileservice-secured.jar/}
            10:59:55,781 INFO [Ejb3DependenciesDeployer] Encountered deployment AbstractVFSDeploymentContext@7836414{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/profileservice-secured.jar/}
            10:59:55,781 INFO [Ejb3DependenciesDeployer] Encountered deployment AbstractVFSDeploymentContext@7836414{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/profileservice-secured.jar/}
            10:59:55,781 INFO [Ejb3DependenciesDeployer] Encountered deployment AbstractVFSDeploymentContext@7836414{vfsfile:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/profileservice-secured.jar/}
            10:59:55,781 INFO [Ejb3DependenciesDeployer] Encountered deployment AbstractVFSDeploymentContext@213201{vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/svc-kat0.0.1--SNAPSHOT.ear/service-kat-ejb-0.0.1-SNAPSHOT.jar/}
            10:59:55,781 INFO [Ejb3DependenciesDeployer] Encountered deployment AbstractVFSDeploymentContext@213201{vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/svc-kat0.0.1--SNAPSHOT.ear/service-kat-ejb-0.0.1-SNAPSHOT.jar/}
            10:59:59,046 INFO [JMXConnectorServerService] JMX Connector server: service:jmx:rmi://localhost/jndi/rmi://localhost:1090/jmxconnector
            10:59:59,265 INFO [MailService] Mail Service bound to java:/Mail
            11:00:01,375 WARN [JBossASSecurityMetadataStore] WARNING! POTENTIAL SECURITY RISK. It has been detected that the MessageSucker component which sucks messages from one node to another has not had its password changed from the installation default. Please see the JBoss Messaging user guide for instructions on how to do this.
            11:00:01,390 WARN [AnnotationCreator] No ClassLoader provided, using TCCL: org.jboss.managed.api.annotation.ManagementComponent
            11:00:01,484 WARN [AnnotationCreator] No ClassLoader provided, using TCCL: org.jboss.managed.api.annotation.ManagementComponent
            11:00:01,562 INFO [TransactionManagerService] JBossTS Transaction Service (JTA version - tag:JBOSSTS_4_6_1_GA) - JBoss Inc.
            11:00:01,562 INFO [TransactionManagerService] Setting up property manager MBean and JMX layer
            11:00:02,062 INFO [TransactionManagerService] Initializing recovery manager
            11:00:02,203 INFO [TransactionManagerService] Recovery manager configured
            11:00:02,203 INFO [TransactionManagerService] Binding TransactionManager JNDI Reference
            11:00:02,234 INFO [TransactionManagerService] Starting transaction recovery manager
            11:00:03,578 INFO [AprLifecycleListener] The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: C:\Program Files\Java\jdk1.5.0_15\bin;.;C:\WINDOWS\system32;C:\WINDOWS;native
            11:00:03,640 INFO [Http11Protocol] Initializing Coyote HTTP/1.1 on http-localhost%2F127.0.0.1-8080
            11:00:03,640 INFO [AjpProtocol] Initializing Coyote AJP/1.3 on ajp-localhost%2F127.0.0.1-8009
            11:00:03,656 INFO [StandardService] Starting service jboss.web
            11:00:03,671 INFO [StandardEngine] Starting Servlet Engine: JBoss Web/2.1.3.GA
            11:00:03,718 INFO [Catalina] Server startup in 70 ms
            11:00:03,734 INFO [TomcatDeployment] deploy, ctxPath=/invoker
            11:00:04,265 INFO [TomcatDeployment] deploy, ctxPath=/juddi
            11:00:04,343 INFO [RegistryServlet] Loading jUDDI configuration.
            11:00:04,343 INFO [RegistryServlet] Resources loaded from: /WEB-INF/juddi.properties
            11:00:04,343 INFO [RegistryServlet] Initializing jUDDI components.
            11:00:04,500 INFO [TomcatDeployment] deploy, ctxPath=/jbossws
            11:00:04,515 INFO [TomcatDeployment] deploy, ctxPath=/web-console
            11:00:04,937 INFO [RARDeployment] Required license terms exist, view vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/jboss-local-jdbc.rar/META-INF/ra.xml
            11:00:04,953 INFO [RARDeployment] Required license terms exist, view vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/jboss-xa-jdbc.rar/META-INF/ra.xml
            11:00:04,984 INFO [RARDeployment] Required license terms exist, view vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/jms-ra.rar/META-INF/ra.xml
            11:00:05,000 INFO [RARDeployment] Required license terms exist, view vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/mail-ra.rar/META-INF/ra.xml
            11:00:05,046 INFO [RARDeployment] Required license terms exist, view vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deploy/quartz-ra.rar/META-INF/ra.xml
            11:00:05,140 INFO [SimpleThreadPool] Job execution threads will use class loader of thread: main
            11:00:05,171 INFO [QuartzScheduler] Quartz Scheduler v.1.5.2 created.
            11:00:05,171 INFO [RAMJobStore] RAMJobStore initialized.
            11:00:05,171 INFO [StdSchedulerFactory] Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz package: 'quartz.properties'
            11:00:05,171 INFO [StdSchedulerFactory] Quartz scheduler version: 1.5.2
            11:00:05,171 INFO [QuartzScheduler] Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED started.
            11:00:06,281 INFO [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=DefaultDS' to JNDI name 'java:DefaultDS'
            11:00:06,609 WARN [JDBCPersistenceManager]
            
            JBoss Messaging Warning: DataSource connection transaction isolation should be READ_COMMITTED, but it is currently REPEATABLE_READ.
             Using an isolation level less strict than READ_COMMITTED may lead to data consistency problems.
             Using an isolation level more strict than READ_COMMITTED may lead to deadlock.
            
            11:00:06,875 INFO [ServerPeer] JBoss Messaging 1.4.3.GA server [0] started
            11:00:07,015 INFO [QueueService] Queue[/queue/DLQ] started, fullSize=200000, pageSize=2000, downCacheSize=2000
            11:00:07,015 INFO [ConnectionFactoryJNDIMapper] supportsFailover attribute is true on connection factory: jboss.messaging.connectionfactory:service=ClusteredConnectionFactory but post office is non clustered. So connection factory will *not* support failover
            11:00:07,031 INFO [ConnectionFactoryJNDIMapper] supportsLoadBalancing attribute is true on connection factory: jboss.messaging.connectionfactory:service=ClusteredConnectionFactory but post office is non clustered. So connection factory will *not* support load balancing
            11:00:07,078 INFO [ConnectionFactory] Connector bisocket://localhost:4457 has leasing enabled, lease period 10000 milliseconds
            11:00:07,078 INFO [ConnectionFactory] org.jboss.jms.server.connectionfactory.ConnectionFactory@1a25b44 started
            11:00:07,078 INFO [ConnectionFactory] Connector bisocket://localhost:4457 has leasing enabled, lease period 10000 milliseconds
            11:00:07,078 INFO [ConnectionFactory] org.jboss.jms.server.connectionfactory.ConnectionFactory@9d7f93 started
            11:00:07,093 INFO [QueueService] Queue[/queue/ExpiryQueue] started, fullSize=200000, pageSize=2000, downCacheSize=2000
            11:00:07,093 INFO [ConnectionFactory] Connector bisocket://localhost:4457 has leasing enabled, lease period 10000 milliseconds
            11:00:07,093 INFO [ConnectionFactory] org.jboss.jms.server.connectionfactory.ConnectionFactory@3dfc08 started
            11:00:07,093 INFO [ConnectionFactoryBindingService] Bound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=JmsXA' to JNDI name 'java:JmsXA'
            11:00:07,546 INFO [JBossASKernel] Created KernelDeployment for: profileservice-secured.jar
            11:00:07,546 INFO [JBossASKernel] installing bean: jboss.j2ee:jar=profileservice-secured.jar,name=SecureManagementView,service=EJB3
            11:00:07,546 INFO [JBossASKernel] with dependencies:
            11:00:07,546 INFO [JBossASKernel] and demands:
            11:00:07,546 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:07,546 INFO [JBossASKernel] and supplies:
            11:00:07,546 INFO [JBossASKernel] jndi:SecureManagementView/remote-org.jboss.deployers.spi.management.ManagementView
            11:00:07,546 INFO [JBossASKernel] jndi:SecureManagementView/remote
            11:00:07,546 INFO [JBossASKernel] Class:org.jboss.deployers.spi.management.ManagementView
            11:00:07,546 INFO [JBossASKernel] Added bean(jboss.j2ee:jar=profileservice-secured.jar,name=SecureManagementView,service=EJB3) to KernelDeployment of: profileservice-secured.jar
            11:00:07,562 INFO [JBossASKernel] installing bean: jboss.j2ee:jar=profileservice-secured.jar,name=SecureProfileService,service=EJB3
            11:00:07,562 INFO [JBossASKernel] with dependencies:
            11:00:07,562 INFO [JBossASKernel] and demands:
            11:00:07,562 INFO [JBossASKernel] jndi:SecureManagementView/remote-org.jboss.deployers.spi.management.ManagementView
            11:00:07,562 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:07,562 INFO [JBossASKernel] and supplies:
            11:00:07,562 INFO [JBossASKernel] jndi:SecureProfileService/remote
            11:00:07,562 INFO [JBossASKernel] jndi:SecureProfileService/remote-org.jboss.profileservice.spi.ProfileService
            11:00:07,562 INFO [JBossASKernel] Class:org.jboss.profileservice.spi.ProfileService
            11:00:07,562 INFO [JBossASKernel] Added bean(jboss.j2ee:jar=profileservice-secured.jar,name=SecureProfileService,service=EJB3) to KernelDeployment of: profileservice-secured.jar
            11:00:07,562 INFO [JBossASKernel] installing bean: jboss.j2ee:jar=profileservice-secured.jar,name=SecureDeploymentManager,service=EJB3
            11:00:07,562 INFO [JBossASKernel] with dependencies:
            11:00:07,562 INFO [JBossASKernel] and demands:
            11:00:07,562 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:07,562 INFO [JBossASKernel] and supplies:
            11:00:07,562 INFO [JBossASKernel] jndi:SecureDeploymentManager/remote-org.jboss.deployers.spi.management.deploy.DeploymentManager
            11:00:07,562 INFO [JBossASKernel] jndi:SecureDeploymentManager/remote
            11:00:07,562 INFO [JBossASKernel] Class:org.jboss.deployers.spi.management.deploy.DeploymentManager
            11:00:07,562 INFO [JBossASKernel] Added bean(jboss.j2ee:jar=profileservice-secured.jar,name=SecureDeploymentManager,service=EJB3) to KernelDeployment of: profileservice-secured.jar
            11:00:07,562 INFO [EJB3EndpointDeployer] Deploy AbstractBeanMetaData@5b469f{name=jboss.j2ee:jar=profileservice-secured.jar,name=SecureManagementView,service=EJB3_endpoint bean=org.jboss.ejb3.endpoint.deployers.impl.EndpointImpl properties=[container] constructor=null autowireCandidate=true}
            11:00:07,578 INFO [EJB3EndpointDeployer] Deploy AbstractBeanMetaData@126dc32{name=jboss.j2ee:jar=profileservice-secured.jar,name=SecureProfileService,service=EJB3_endpoint bean=org.jboss.ejb3.endpoint.deployers.impl.EndpointImpl properties=[container] constructor=null autowireCandidate=true}
            11:00:07,578 INFO [EJB3EndpointDeployer] Deploy AbstractBeanMetaData@1c8bb61{name=jboss.j2ee:jar=profileservice-secured.jar,name=SecureDeploymentManager,service=EJB3_endpoint bean=org.jboss.ejb3.endpoint.deployers.impl.EndpointImpl properties=[container] constructor=null autowireCandidate=true}
            11:00:07,781 INFO [SessionSpecContainer] Starting jboss.j2ee:jar=profileservice-secured.jar,name=SecureManagementView,service=EJB3
            11:00:07,796 INFO [EJBContainer] STARTED EJB: org.jboss.profileservice.ejb.SecureManagementView ejbName: SecureManagementView
            11:00:07,859 INFO [JndiSessionRegistrarBase] Binding the following Entries in Global JNDI:
            
             SecureManagementView/remote - EJB3.x Default Remote Business Interface
             SecureManagementView/remote-org.jboss.deployers.spi.management.ManagementView - EJB3.x Remote Business Interface
            
            11:00:07,953 INFO [SessionSpecContainer] Starting jboss.j2ee:jar=profileservice-secured.jar,name=SecureProfileService,service=EJB3
            11:00:07,953 INFO [EJBContainer] STARTED EJB: org.jboss.profileservice.ejb.SecureProfileServiceBean ejbName: SecureProfileService
            11:00:07,984 INFO [JndiSessionRegistrarBase] Binding the following Entries in Global JNDI:
            
             SecureProfileService/remote - EJB3.x Default Remote Business Interface
             SecureProfileService/remote-org.jboss.profileservice.spi.ProfileService - EJB3.x Remote Business Interface
            
            11:00:08,046 INFO [SessionSpecContainer] Starting jboss.j2ee:jar=profileservice-secured.jar,name=SecureDeploymentManager,service=EJB3
            11:00:08,046 INFO [EJBContainer] STARTED EJB: org.jboss.profileservice.ejb.SecureDeploymentManager ejbName: SecureDeploymentManager
            11:00:08,062 INFO [JndiSessionRegistrarBase] Binding the following Entries in Global JNDI:
            
             SecureDeploymentManager/remote - EJB3.x Default Remote Business Interface
             SecureDeploymentManager/remote-org.jboss.deployers.spi.management.deploy.DeploymentManager - EJB3.x Remote Business Interface
            
            11:00:08,187 INFO [TomcatDeployment] deploy, ctxPath=/admin-console
            11:00:08,250 INFO [config] Initializing Mojarra (1.2_12-b01-FCS) for context '/admin-console'
            11:00:12,390 INFO [TomcatDeployment] deploy, ctxPath=/
            11:00:12,453 INFO [TomcatDeployment] deploy, ctxPath=/jmx-console
            11:00:15,062 INFO [JBossASKernel] Created KernelDeployment for: service-kat-ejb-0.0.1-SNAPSHOT.jar
            11:00:15,062 INFO [JBossASKernel] installing bean: jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportDeleteTimerService,service=EJB3
            11:00:15,062 INFO [JBossASKernel] with dependencies:
            11:00:15,062 INFO [JBossASKernel] and demands:
            11:00:15,062 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:15,062 INFO [JBossASKernel] and supplies:
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportDeleteTimerService/remote-com.thesearchagency.service.kat.IKATReportDeleteTimerService
            11:00:15,062 INFO [JBossASKernel] Class:com.thesearchagency.service.kat.IKATReportDeleteTimerService
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportDeleteTimerService/remote
            11:00:15,062 INFO [JBossASKernel] jndi:ejb/DeleteKATReportsTimerService
            11:00:15,062 INFO [JBossASKernel] Added bean(jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportDeleteTimerService,service=EJB3) to KernelDeployment of: service-kat-ejb-0.0.1-SNAPSHOT.jar
            11:00:15,062 INFO [JBossASKernel] installing bean: jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportProcessTimerService,service=EJB3
            11:00:15,062 INFO [JBossASKernel] with dependencies:
            11:00:15,062 INFO [JBossASKernel] and demands:
            11:00:15,062 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:15,062 INFO [JBossASKernel] and supplies:
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportProcessTimerService/remote-com.thesearchagency.service.kat.IKATReportProcessTimerService
            11:00:15,062 INFO [JBossASKernel] Class:com.thesearchagency.service.kat.IKATReportProcessTimerService
            11:00:15,062 INFO [JBossASKernel] jndi:ejb/ProcessKATReportsTimerService
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportProcessTimerService/remote
            11:00:15,062 INFO [JBossASKernel] Added bean(jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportProcessTimerService,service=EJB3) to KernelDeployment of: service-kat-ejb-0.0.1-SNAPSHOT.jar
            11:00:15,062 INFO [JBossASKernel] installing bean: jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportService,service=EJB3
            11:00:15,062 INFO [JBossASKernel] with dependencies:
            11:00:15,062 INFO [JBossASKernel] and demands:
            11:00:15,062 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:15,062 INFO [JBossASKernel] and supplies:
            11:00:15,062 INFO [JBossASKernel] Class:com.thesearchagency.service.kat.IKATReportLocal
            11:00:15,062 INFO [JBossASKernel] jndi:remote/KATReportService-1.0
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportService/remote
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportService/local-com.thesearchagency.service.kat.IKATReportLocal
            11:00:15,062 INFO [JBossASKernel] Class:com.thesearchagency.service.kat.IKATReportRemote
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportService/local
            11:00:15,062 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportService/remote-com.thesearchagency.service.kat.IKATReportRemote
            11:00:15,062 INFO [JBossASKernel] Added bean(jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportService,service=EJB3) to KernelDeployment of: service-kat-ejb-0.0.1-SNAPSHOT.jar
            11:00:15,078 INFO [JBossASKernel] installing bean: jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportServiceJMX,service=EJB3
            11:00:15,078 INFO [JBossASKernel] with dependencies:
            11:00:15,078 INFO [JBossASKernel] and demands:
            11:00:15,078 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:15,078 INFO [JBossASKernel] and supplies:
            11:00:15,078 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportServiceJMX/remote
            11:00:15,078 INFO [JBossASKernel] Class:com.thesearchagency.service.kat.jmx.IKATReportServiceJMX
            11:00:15,078 INFO [JBossASKernel] Added bean(jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportServiceJMX,service=EJB3) to KernelDeployment of: service-kat-ejb-0.0.1-SNAPSHOT.jar
            11:00:15,078 INFO [JBossASKernel] installing bean: jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATDataServiceTopicListener,service=EJB3
            11:00:15,078 INFO [JBossASKernel] with dependencies:
            11:00:15,078 INFO [JBossASKernel] and demands:
            11:00:15,078 INFO [JBossASKernel] jboss.messaging.destination:service=Topic,name=KATDataServiceTopic
            11:00:15,078 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:15,078 INFO [JBossASKernel] and supplies:
            11:00:15,078 INFO [JBossASKernel] Class:javax.jms.MessageListener
            11:00:15,078 INFO [JBossASKernel] jndi:null
            11:00:15,078 INFO [JBossASKernel] Added bean(jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATDataServiceTopicListener,service=EJB3) to KernelDeployment of: service-kat-ejb-0.0.1-SNAPSHOT.jar
            11:00:15,078 INFO [JBossASKernel] installing bean: jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportTopicListener,service=EJB3
            11:00:15,078 INFO [JBossASKernel] with dependencies:
            11:00:15,078 INFO [JBossASKernel] and demands:
            11:00:15,078 INFO [JBossASKernel] jboss.messaging.destination:service=Topic,name=KATReportTopic
            11:00:15,078 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:15,078 INFO [JBossASKernel] and supplies:
            11:00:15,078 INFO [JBossASKernel] Class:javax.jms.MessageListener
            11:00:15,078 INFO [JBossASKernel] jndi:null
            11:00:15,078 INFO [JBossASKernel] Added bean(jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportTopicListener,service=EJB3) to KernelDeployment of: service-kat-ejb-0.0.1-SNAPSHOT.jar
            11:00:15,078 INFO [EJB3EndpointDeployer] Deploy AbstractBeanMetaData@b57342{name=jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportService,service=EJB3_endpoint bean=org.jboss.ejb3.endpoint.deployers.impl.EndpointImpl properties=[container] constructor=null autowireCandidate=true}
            11:00:15,078 INFO [EJB3EndpointDeployer] Deploy AbstractBeanMetaData@15a7e47{name=jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportProcessTimerService,service=EJB3_endpoint bean=org.jboss.ejb3.endpoint.deployers.impl.EndpointImpl properties=[container] constructor=null autowireCandidate=true}
            11:00:15,078 INFO [EJB3EndpointDeployer] Deploy AbstractBeanMetaData@2b2bfc{name=jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportDeleteTimerService,service=EJB3_endpoint bean=org.jboss.ejb3.endpoint.deployers.impl.EndpointImpl properties=[container] constructor=null autowireCandidate=true}
            11:00:15,171 INFO [SessionSpecContainer] Starting jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportDeleteTimerService,service=EJB3
            11:00:15,171 INFO [EJBContainer] STARTED EJB: com.thesearchagency.service.kat.impl.KATReportDeleteTimerService ejbName: KATReportDeleteTimerService
            11:00:15,234 INFO [JndiSessionRegistrarBase] Binding the following Entries in Global JNDI:
            
             ejb/DeleteKATReportsTimerService - EJB3.x Default Remote Business Interface
             svc-kat0.0.1--SNAPSHOT/KATReportDeleteTimerService/remote-com.thesearchagency.service.kat.IKATReportDeleteTimerService - EJB3.x Remote Business Interface
            
            11:00:15,312 INFO [SessionSpecContainer] Starting jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportProcessTimerService,service=EJB3
            11:00:15,312 INFO [EJBContainer] STARTED EJB: com.thesearchagency.service.kat.impl.KATReportProcessTimerService ejbName: KATReportProcessTimerService
            11:00:15,343 INFO [JndiSessionRegistrarBase] Binding the following Entries in Global JNDI:
            
             ejb/ProcessKATReportsTimerService - EJB3.x Default Remote Business Interface
             svc-kat0.0.1--SNAPSHOT/KATReportProcessTimerService/remote-com.thesearchagency.service.kat.IKATReportProcessTimerService - EJB3.x Remote Business Interface
            
            11:00:15,500 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,500 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,515 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,531 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,531 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,531 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,546 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,546 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,562 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,562 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,578 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,578 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,593 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,593 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,609 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,609 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,609 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,625 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,625 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,640 ERROR [TimerImpl] Error invoking ejbTimeout
            org.jboss.aop.DispatcherConnectException: EJB container is not completely started, or is stopped.
             at org.jboss.ejb3.BlockContainerShutdownInterceptor.invoke(BlockContainerShutdownInterceptor.java:62)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.aspects.currentinvocation.CurrentInvocationInterceptor.invoke(CurrentInvocationInterceptor.java:67)
             at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
             at org.jboss.ejb3.stateless.StatelessContainer.callTimeout(StatelessContainer.java:249)
             at org.jboss.as.ejb3.timerservice.TimedObjectInvokerBridge.callTimeout(TimedObjectInvokerBridge.java:44)
             at org.jboss.ejb.txtimer.TimerImpl$TimerTaskImpl.run(TimerImpl.java:561)
             at java.util.TimerThread.mainLoop(Timer.java:512)
             at java.util.TimerThread.run(Timer.java:462)
            11:00:15,703 DEBUG [KATReportProcessTimerService] Checking status of CAT Process [177929107-1792009-8010779]
            11:00:15,718 DEBUG [KATDataWSAdapter] Initializing the KATDataWSAdapter...
            11:00:15,718 INFO [SessionSpecContainer] Starting jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportService,service=EJB3
            11:00:15,718 INFO [EJBContainer] STARTED EJB: com.thesearchagency.service.kat.impl.KATReportService ejbName: KATReportService
            11:00:15,843 INFO [JndiSessionRegistrarBase] Binding the following Entries in Global JNDI:
            
             remote/KATReportService-1.0 - EJB3.x Default Remote Business Interface
             svc-kat0.0.1--SNAPSHOT/KATReportService/remote-com.thesearchagency.service.kat.IKATReportRemote - EJB3.x Remote Business Interface
             local/KATReportService-1.0 - EJB3.x Default Local Business Interface
             svc-kat0.0.1--SNAPSHOT/KATReportService/local-com.thesearchagency.service.kat.IKATReportLocal - EJB3.x Local Business Interface
            
            11:00:15,953 INFO [JBossASKernel] installing bean: jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportServiceJMX,service=EJB3,type=ManagementInterface
            11:00:15,953 INFO [JBossASKernel] with dependencies:
            11:00:15,953 INFO [JBossASKernel] and demands:
            11:00:15,953 INFO [JBossASKernel] jboss.ejb:service=EJBTimerService
            11:00:15,953 INFO [JBossASKernel] jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportServiceJMX,service=EJB3
            11:00:15,953 INFO [JBossASKernel] and supplies:
            11:00:15,953 INFO [JBossASKernel] jndi:svc-kat0.0.1--SNAPSHOT/KATReportServiceJMX/remote
            11:00:15,953 INFO [JBossASKernel] Class:com.thesearchagency.service.kat.jmx.IKATReportServiceJMX
            11:00:15,953 INFO [JBossASKernel] Installing bean(jboss.j2ee:ear=svc-kat0.0.1--SNAPSHOT.ear,jar=service-kat-ejb-0.0.1-SNAPSHOT.jar,name=KATReportServiceJMX,service=EJB3,type=ManagementInterface) into kernel
            11:00:15,953 DEBUG [KATReportServiceJMX] Creating the KATReportServiceJMX MBean.
            11:00:15,953 INFO [EJBContainer] STARTED EJB: com.thesearchagency.service.kat.jmx.KATReportServiceJMX ejbName: KATReportServiceJMX
            11:00:15,953 INFO [JndiSessionRegistrarBase] Binding the following Entries in Global JNDI:
            
            
            11:00:15,968 DEBUG [KATReportServiceJMX] Starting the KATReportServiceJMX MBean.
            11:00:16,093 INFO [BusApplicationContext] Refreshing org.apache.cxf.bus.spring.BusApplicationContext@a450c2: display name [org.apache.cxf.bus.spring.BusApplicationContext@a450c2]; startup date [Thu Sep 17 11:00:16 EDT 2009]; root of context hierarchy
            11:00:16,218 INFO [DescriptorDeploymentAspect] Add Service
             id=KATReportService
             address=http://localhost:8080/svc-kat0.0.1--SNAPSHOT-service-kat-ejb-0.0.1-SNAPSHOT/KATReportService
             implementor=com.thesearchagency.service.kat.impl.KATReportService
             invoker=org.jboss.wsf.stack.cxf.InvokerEJB3
             mtomEnabled=false
            11:00:16,218 INFO [DescriptorDeploymentAspect] JBossWS-CXF configuration generated: file:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/tmp/jbossws/jbossws-cxf24287.xml
            11:00:16,234 INFO [DescriptorDeploymentAspect] Add Service
             id=KATReportService
             address=http://localhost:8080/KATServices/KATReportService
             implementor=com.thesearchagency.service.kat.impl.KATReportService
             invoker=org.jboss.wsf.stack.cxf.InvokerJSE
             mtomEnabled=false
            11:00:16,234 INFO [DescriptorDeploymentAspect] JBossWS-CXF configuration generated: file:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/tmp/jbossws/jbossws-cxf24288.xml
            11:00:16,265 INFO [DefaultEndpointRegistry] register: jboss.ws:context=svc-kat0.0.1--SNAPSHOT-service-kat-ejb-0.0.1-SNAPSHOT,endpoint=KATReportService
            11:00:16,281 INFO [DefaultEndpointRegistry] register: jboss.ws:context=KATServices,endpoint=KATReportService
            11:00:16,343 INFO [BusApplicationContext] No cxf.xml configuration file detected, relying on defaults.
            11:00:16,546 INFO [DefaultListableBeanFactory] Overriding bean definition for bean 'org.apache.cxf.binding.corba.CorbaBindingFactory': replacing [Generic bean: class [org.apache.cxf.binding.corba.CorbaBindingFactory]; scope=singleton; abstract=false; lazyInit=true; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in URL [vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deployers/jbossws.deployer/cxf-rt-bindings-corba.jar/META-INF/cxf/cxf-extension-corba.fixml]] with [Generic bean: class [org.apache.cxf.binding.corba.CorbaBindingFactory]; scope=singleton; abstract=false; lazyInit=true; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in URL [vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deployers/jbossws.deployer/cxf-rt-bindings-corba.jar/META-INF/cxf/cxf-extension-corba.fixml]]
            11:00:16,546 INFO [DefaultListableBeanFactory] Overriding bean definition for bean 'org.apache.cxf.binding.soap.SoapBindingFactory': replacing [Generic bean: class [org.apache.cxf.binding.soap.SoapBindingFactory]; scope=singleton; abstract=false; lazyInit=true; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in URL [vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deployers/jbossws.deployer/cxf-rt-bindings-soap.jar/META-INF/cxf/cxf-extension-soap.fixml]] with [Generic bean: class [org.apache.cxf.binding.soap.SoapBindingFactory]; scope=singleton; abstract=false; lazyInit=true; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in URL [vfszip:/C:/ApplicationServers/jboss-5.1.0.GA/server/default/deployers/jbossws.deployer/cxf-rt-bindings-soap.jar/META-INF/cxf/cxf-extension-soap.fixml]]
            11:00:16,562 INFO [DefaultListableBeanFactory] Overriding bean definition for bean 'org.apache.cxf.binding.soap.SoapTransportFactory': replacing [Generic bean: class [org.apache.cxf.binding.soap.SoapTransportFactory]; scope=singleton; abstract=false; lazyInit=true; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodNa


            • 3. Re: EJBTimer Restart Issue : Dropped/Failed Timer Execution
              jaikiran

              Could you please create a JIRA for this at https://jira.jboss.org/jira/browse/EJBTHREE. Also if possible, please attach a sample application to reproduce this issue.

              • 4. Re: EJBTimer Restart Issue : Dropped/Failed Timer Execution
                kyle.bober

                Will do!

                • 5. EJBTimer Restart Issue : Dropped/Failed Timer Execution
                  saranganajwala

                  Is this issue resolved?

                  • 6. EJBTimer Restart Issue : Dropped/Failed Timer Execution
                    jaikiran