8 Replies Latest reply on May 24, 2012 1:45 PM by Wolf-Dieter Fink

    OS process remains after stopping server

    Jeff Bride Novice

      Hi,

         I have built CLI batch scripts which include commands to stop servers in a Managed Domain as explained here:    https://docs.jboss.org/author/display/AS71/Admin+Guide#AdminGuide-Starting%26stoppingServersinaManagedDomain

       

        what I am observing on AS 7.1.2.Final is that after having successfully stopped and removed a server, the operating system process remains for that server.

       

        I'm wondering if this is to be expected and if so, why ?

       

      thank you,

      jeff

        • 1. Re: OS process remains after stopping server
          Wolf-Dieter Fink Master

          If you start a domain there are different (Java) processes. A HOST, PROCESS-Controller and one for each server.

          If you remove all servers you will still have two Java processes.

           

          Or did I understand it wrong? If yes post a bit more details (i.e. domain/server config, ps before and after)

          • 2. Re: OS process remains after stopping server
            Darran Lofthouse Master

            The output from 'jps -v' is useful for identifying the differnet processes.

            • 3. Re: OS process remains after stopping server
              Jeff Bride Novice

              Hi,

                The following snippet is output from after having executed my batch CLI on a stock AS 7.1.2.FINAL that stops and removes "server-two" :

               

                   [exec] #1 /host=master/server-config=server-two:stop(server=server-two,blocking=false)

                   [exec] The batch executed successfully.

                   [exec] #1 /host=master/server-config=server-two:remove

                    [exec] The batch executed successfully.

               

                doing so does successully remove all references to server-two when viewed from either the AS7 admin console    and/or   jboss-cli.sh --gui

               

              however, the following is a list of operating system processes (generated from :    ps -aef  | grep java     and modified for clarity ) :

               

              jbride   11575 11501  0 11:54 pts/1    00:00:01 /usr/lib/jvm/java/bin/java -D[Process Controller]

              jbride   11596 11575  0 11:54 pts/1    00:00:10 /usr/lib/jvm/java/bin/java -D[Host Controller]

              jbride   11698 11575  1 11:54 pts/1    00:00:36 /usr/lib/jvm/java/bin/java -D[Server:server-one]

              jbride   11721 11575  0 11:54 pts/1    00:00:18 /usr/lib/jvm/java/bin/java -D[Server:server-two]

              jbride   12359 11575  2 11:55 pts/1    00:00:56 /usr/lib/jvm/java/bin/java -D[Server:lab]

               

              all is to be expected with the exception of processId:  11721 .... which corresponds to "server-two".   Seems that 11721 shoud have been killed with the "stop" command ??

               

              thanks again,  jeff

              • 4. Re: OS process remains after stopping server
                Wolf-Dieter Fink Master

                I checked it with my 7.2.0.Alpa1 (git upstream)

                Wrote a stop.cli with the commands and execute it via jboss-cli and it work (after I set blocking=true, otherwise the server is still active during execution)

                The process is correctly stopped.

                 

                So how your script looks like? What OS it is? I use Fedora15.

                • 5. Re: OS process remains after stopping server
                  Jeff Bride Novice

                  excellent.  thanks for looking into this.  I run on Fedora 16 using the stock openJDK 1.6.    Here is my script :

                   

                  batch

                  /host=master/server-config=server-two/:stop(server=server-two,blocking=false)

                  run-batch

                  batch

                  /host=master/server-config=server-two/:remove

                  run-batch

                   

                  I think you've pointed out probably a deeper problem in that when I set "blocking=true" .... my batch script hangs on that command. 

                  Which is why I set blocking=false naively thinking i had avoided the problem.

                  in both $JBOSS_HOME/domain/servers/server-two/log/boot.log & server.log ..... i do see log statements indicating that the server is at least attempting to shutdown.

                   

                  Thanks for at least confirming thus far that it's either an environment issue or I need to upgrade.  I'll let you know how it goes.

                   

                  jeff

                  • 6. Re: OS process remains after stopping server
                    Wolf-Dieter Fink Master

                    Hi Jeff,

                    I've used different version from 7.1.1 (not always the tagged one) but I have no problems.

                    What if you use the clean installation with your script, does that works?

                    Also you can run both operations in one batch

                     

                    What can happen is that you have one service or EJB that waits for finishing (and blocks for any reason), maybe TRACE level might help to see what happen.

                    In this case the process will not be stopped.

                     

                    Wolf

                    • 7. Re: OS process remains after stopping server
                      Jeff Bride Novice

                      thanks wolf,

                      i should have mentioned earlier that i made one customization to domain.xml.

                      that customization was to modify the default locations for both the hornetq journal and page directories

                      i must not be configuring that exactly correctly because as soon as i remove those modifications from domain.xml ..... server-two now shuts down cleanly (with blocking=true) and the OS process is killed.

                       

                      thanks for the hints !  greatly helped me isolate the problem.

                       

                      jeff

                      • 8. Re: OS process remains after stopping server
                        Wolf-Dieter Fink Master

                        No problem, your welcome.

                         

                        if you know whats wrong you should post the details adn mark the correct answer and the thread accordingly.