8 Replies Latest reply on Aug 16, 2013 3:36 PM by jb_adm1n

    Jobss is shutting down

    raghavendrarao

      hi
      I am using Jboss server -jboss-4.0.1.But after 16hrs(ie during run time) JBoss is shutting down saying

      2006-03-18 14:55:12,097 INFO [org.jboss.system.server.Server] Runtime shutdown hook called, forceHalt: true
       2006-03-18 14:55:12,098 INFO [org.jboss.system.server.Server] JBoss SHUTDOWN: Undeploying all packages
       2006-03-18 14:55:12,098 DEBUG [org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread] Notified to shutdown2006-03-18 14:55:12,099 DEBUG [org.jboss.deployment.MainDeployer] Undeploying file:/opt/osa/appserver/jboss-4.0.3SP1/server/default/deploy/jmx-console.war/
      2006-03-18 14:55:12,100 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.web.deployment:war=jmx-console.war,id=1227047831
      2006-03-18 14:55:12,100 DEBUG [org.jboss.system.ServiceController] stopping dependent services for: jboss.web.deployment:war=jmx-console.war,id=1227047831 dependent services are: []
      2006-03-18 14:55:12,101 DEBUG [org.jboss.web.WebModule] Stopping jboss.web.deployment:war=jmx-console.war,id=1227047831
      2006-03-18 14:55:12,101 INFO [org.jboss.web.tomcat.tc5.TomcatDeployer] undeploy, ctxPath=/jmx-console, warUrl=.../deploy/jmx-console.war/
      2006-03-18 14:55:12,126 DEBUG [org.jboss.web.WebModule] Stopped jboss.web.deployment:war=jmx-console.war,id=1227047831
      2006-03-18 14:55:12,127 DEBUG [org.jboss.webservice.ServiceDeployer] handleNotification: org.jboss.deployment.SubDeployer.stop,jmx-console.war
      2006-03-18 14:55:12,128 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.web.deployment:war=jmx-console.war,id=1227047831
      2006-03-18 14:55:12,128 DEBUG [org.jboss.system.ServiceController] destroying dependent services for: jboss.web.deployment:war=jmx-console.war,id=1227047831 dependent services are: []
      2006-03-18 14:55:12,128 DEBUG [org.jboss.web.WebModule] Destroying jboss.web.deployment:war=jmx-console.war,id=1227047831
      2006-03-18 14:55:12,128 DEBUG [org.jboss.web.WebModule] Destroyed jboss.web.deployment:war=jmx-console.war,id=1227047831
      2006-03-18 14:55:12,129 DEBUG [org.jboss.system.ServiceController] removing service: jboss.web.deployment:war=jmx-console.war,id=1227047831
      2006-03-18 14:55:12,129 DEBUG [org.jboss.system.ServiceController] removing already unregistered jboss.web.deployment:war=jmx-console.war,id=1227047831 from server
      2006-03-18 14:55:12,135 DEBUG [org.jboss.webservice.ServiceDeployer] handleNotification: org.jboss.deployment.SubDeployer.destroy,jmx-console.war
      2006-03-18 14:55:12,135 DEBUG [org.jboss.mx.loading.RepositoryClassLoader] Unregistering cl=org.jboss.mx.loading.UnifiedClassLoader3@1e55d39{ url=file:/opt/osa/appserver/jboss-4.0.3SP1/server/default/deploy/jmx-console.war/ ,addedOrder=41}
      2006-03-18 14:55:12,136 DEBUG [org.jboss.mx.loading.UnifiedLoaderRepository3] UnifiedLoaderRepository removed(true) org.jboss.mx.loading.UnifiedClassLoader3@1e55d39{ url=file:/opt/osa/appserver/jboss-4.0.3SP1/server/default/deploy/jmx-console.war/ ,addedOrder=41}
      2006-03-18 14:55:12,142 DEBUG [org.jboss.deployment.DeploymentInfo] Not deleting localUrl, it is null or not a copy: file:/opt/osa/appserver/jboss-4.0.3SP1/server/default/deploy/jmx-console.war/
      2006-03-18 14:55:12,142 DEBUG [org.jboss.deployment.MainDeployer] Undeployed file:/opt/osa/appserver/jboss-4.0.3SP1/server/default/deploy/jmx-console.war/
      2006-03-18 14:55:12,143 DEBUG [org.jboss.deployment.MainDeployer] Undeploying file:/opt/osa/appserver/jboss-4.0.3SP1/server/default/deploy/onesnmpadc.jar
      2006-03-18 14:55:12,143 INFO [org.jboss.ejb.EJBDeployer] Undeploying: file:/opt/osa/appserver/jboss-4.0.3SP1/server/default/deploy/onesnmpadc.jar
      2006-03-18 14:55:12,143 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.j2ee:service=EjbModule,module=onesnmpadc.jar
      2006-03-18 14:55:12,144 DEBUG [org.jboss.system.ServiceController] stopping dependent services for: jboss.j2ee:service=EjbModule,module=onesnmpadc.jar dependent services are: []
      2006-03-18 14:55:12,144 DEBUG [org.jboss.ejb.EjbModule] Stopping jboss.j2ee:service=EjbModule,module=onesnmpadc.jar
      2006-03-18 14:55:12,144 DEBUG [org.jboss.ejb.EjbModule] stopService, stopping container: TrapProcessor
      2006-03-18 14:55:12,144 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.j2ee:jndiName=local/TrapProcessor@1638183,service=EJB
      2006-03-18 14:55:12,144 DEBUG [org.jboss.system.ServiceController] stopping dependent services for: jboss.j2ee:jndiName=local/TrapProcessor@1638183,service=EJB dependent services are: []
      2006-03-18 14:55:12,145 DEBUG [org.jboss.ejb.MessageDrivenContainer] Stopping jboss.j2ee:jndiName=local/TrapProcessor@1638183,service=EJB
      

      etc....
      What could be the reason for this forceful shutdown?
      What are the typical conditions this could happen??
      Thanks in advance
      bye

        • 1. Re: Jobss is shutting down
          bubonic

          I have the same problem, have you gotten any further in finding a cause?

          • 2. Re: Jobss is shutting down
            chagascon

            Same problem here. Sometimes it happens all the time, sometimes not. Is it the OS that sent it (or the JVM) a kill signal to shutdown? Or did the JVM tell jboss to shutdown (due to lack of resources or whatnot)?

            • 3. Re: Jobss is shutting down
              chagascon

              Weird shutdown problem happens even on deployed JBoss 4.0.3 and the recent JBoss 4.0.4.

              • 4. Re: Jobss is shutting down
                deadrow

                I have the same problem... JB should work on it. It is a terrible problem in HA systems.

                • 5. Re: Jobss is shutting down
                  tekniklas

                  Same here with 4.0.3SP1. It shuts down like this:

                  2006-05-23 04:50:53,849 DEBUG [org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread] Notified to shutdown
                  


                  Can you show us why?

                  • 6. Re: Jobss is shutting down
                    hmontoya

                    Well, I am not sure about this problem!
                    It is happening to me for a very particular reason.
                    I have read JIRA notes and It seems that, we, users, are doing something wrong.
                    If i launch jboss 4.0.4-GA from the command prompt it seems to works very well.
                    On the other hand, if "evil users" launch it from a thing their call "console", that is a C++ program that forks jboss as a child process, then it keeps going down.

                    I would like to know what is wrong, but these "evil users" does not seem to be very helpful. I would like to know if we can reproduce this behaviour by forking the jboss from another process, and then try to call other signals like SIGHUP, ...

                    if I am not wrong. The solution could be solved following this way.

                    if I am wrong, I don't know currently what to say
                    at least for now.

                    • 7. Re: Jobss is shutting down

                      People,

                      When using *nix, try adding the parameter -Xrs (to reduce OS signals) to the jboss' run.conf file.
                      It seems the problem is gone.

                      Hugs !

                      • 8. Re: Jobss is shutting down
                        jb_adm1n

                        It doesn't help with -Xrs and it just crashes without giving any clue on what is causing the shutdown. We are using JBoss EAP 5.1 as standalone instance and when the client tries to access non existant resource (host), it's crashing with a UnknownHost exception which should not. Please find the log below and would greatly appreciate your help.

                         

                        2013-08-15 14:41:23,484 INFO  [STDOUT] (ajp-162.123.115.79-8009-4) Up front Reader is done

                        2013-08-15 14:41:23,499 INFO  [STDOUT] (Thread-559) Reader [class com.divinvest.paris3.transactions.remittances.edits.readers.CaseLevelRemitFinancialActivityElectionReader] took 0.015 seconds.

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1) Could not connect to server.

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1) java.net.UnknownHostException: crdcasp3sbat

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:177)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at java.net.Socket.connect(Socket.java:529)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at java.net.Socket.connect(Socket.java:478)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at java.net.Socket.<init>(Socket.java:375)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at java.net.Socket.<init>(Socket.java:189)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.commons.net.DefaultSocketFactory.createSocket(DefaultSocketFactory.java:53)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.commons.net.SocketClient.connect(SocketClient.java:162)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.commons.net.SocketClient.connect(SocketClient.java:250)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at com.aegon.arch.util.FTPUtility.connect(FTPUtility.java:56)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at com.divinvest.paris3.uicontroller.eds.actions.LoadJobLayoutEDSAction.uploadFileForLoad(LoadJobLayoutEDSAction.java:1016)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at com.divinvest.paris3.uicontroller.eds.actions.LoadJobLayoutEDSAction.executeLogic(LoadJobLayoutEDSAction.java:125)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at com.divinvest.paris3.uicontroller.eds.actions.EDSBaseAction.execute(EDSBaseAction.java:177)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at com.divinvest.paris3.uicontroller.eds.actions.EDSBaseAction.perform(EDSBaseAction.java:351)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.struts.action.ActionServlet.processActionPerform(ActionServlet.java:1787)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1586)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:510)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at com.divinvest.paris3.uicontroller.eds.EdsUIC.service(EdsUIC.java:75)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:183)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:95)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.coyote.ajp.AjpAprProcessor.process(AjpAprProcessor.java:419)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.coyote.ajp.AjpAprProtocol$AjpConnectionHandler.process(AjpAprProtocol.java:402)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:2036)

                        2013-08-15 14:41:25,092 ERROR [STDERR] (ajp-162.123.115.79-8009-1)     at java.lang.Thread.run(Thread.java:662)

                        2013-08-15 14:41:25,092 INFO  [org.jboss.bootstrap.microcontainer.ServerImpl] (JBoss Shutdown Hook) Runtime shutdown hook called, forceHalt: true

                        2013-08-15 14:41:25,092 INFO  [org.apache.coyote.http11.Http11AprProtocol] (JBoss Shutdown Hook) Pausing Coyote HTTP/1.1 on http-162.123.115.79-8080

                        2013-08-15 14:41:25,108 INFO  [org.apache.coyote.http11.Http11AprProtocol] (JBoss Shutdown Hook) Stopping Coyote HTTP/1.1 on http-162.123.115.79-8080

                        2013-08-15 14:41:26,154 INFO  [org.apache.coyote.ajp.AjpAprProtocol] (JBoss Shutdown Hook) Pausing Coyote AJP/1.3 on ajp-162.123.115.79-8009

                        2013-08-15 14:41:26,154 INFO  [org.apache.coyote.ajp.AjpAprProtocol] (JBoss Shutdown Hook) Stopping Coyote AJP/1.3 on ajp-162.123.115.79-8009

                        2013-08-15 14:41:26,201 INFO  [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/parisIII

                        2013-08-15 14:41:26,248 INFO  [org.apache.catalina.core.ContainerBase.[jboss.web].[localhost].[/parisIII]] (JBoss Shutdown Hook) action: Finalizing this controller servlet

                        2013-08-15 14:41:26,342 INFO  [org.jboss.proxy.ejb.ProxyFactory] (JBoss Shutdown Hook) Unbind EJB Home 'ReportBO' from jndi 'ReportBO'

                        2013-08-15 14:41:26,357 INFO  [org.jboss.ejb.EjbModule] (JBoss Shutdown Hook) Undeployed ReportBO

                        ................

                        ......................

                        2013-08-15 14:41:28,778 INFO  [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/invoker

                        2013-08-15 14:41:28,778 INFO  [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/jbossws

                        2013-08-15 14:41:28,778 INFO  [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/web-console

                        2013-08-15 14:41:28,794 INFO  [org.apache.catalina.core.StandardService] (JBoss Shutdown Hook) Stopping service jboss.web

                        2013-08-15 14:41:28,810 INFO  [com.arjuna.ats.jbossatx.jta.TransactionManagerService] (JBoss Shutdown Hook) Stopping transaction recovery manager

                        2013-08-15 14:41:28,810 INFO  [com.arjuna.ats.jbossatx.jta.TransactionManagerService] (JBoss Shutdown Hook) Destroying TransactionManagerService

                        2013-08-15 14:41:29,606 INFO  [org.jboss.mail.MailService] (JBoss Shutdown Hook) Mail service 'java:/Mail' removed from JNDI

                        2013-08-15 14:41:34,947 INFO  [org.jboss.bootstrap.microcontainer.ServerImpl] (JBoss Shutdown Hook) Shutdown complete

                         

                         

                        I searched on the forums but no useful clue found. It is a very common issue it seems as many people reported but seems like a better documentation would greatly help people.  Let me know if any other info needed.

                         

                        Thanks in advance.

                        Regards,

                        TN