12 Replies Latest reply on Jun 4, 2012 8:59 AM by handyman

    JBoss AS 7.1.1.Final fails to start

    handyman

      Running the JBOSS_HOME/bin/domain.bat it freezes on "[org.jboss.as] (MSC service thread 1-3) JBAS015899: JBoss AS 7.1.1.Final "Brontes" starting".

       

      I'm using Java - 1.6.0_32, 64-Bit and an OS - Microsoft Windows XP, Proffesional x64 Edition Version 2003 Service Pack 2

        • 1. Re: JBoss AS 7.1.1.Final fails to start
          wdfink

          What you mean by 'freezes'?

          The last output is that line, if you do nothing with the server there might no further logging.

          Is the server accessible with a browser using localhost:8080?

          • 2. Re: JBoss AS 7.1.1.Final fails to start
            handyman

            The server wasn't accessible on localhost:8080.

             

            I said freezes because, I tried the domain script on a different machine again with a fresh new jboss installation and it continued after that step and it was accessible on localhost.

             

            Also running the standalone script didn't have the same problem (the server was accessible on localhost:8080) on the machine that had it with the domain script.

            • 3. Re: JBoss AS 7.1.1.Final fails to start
              wdfink

              Sounds strange.

              Could you attach logfiles, domain and host xml?

              • 4. Re: JBoss AS 7.1.1.Final fails to start
                handyman

                I don't currently have access to that machine, but as soon as I do I will attach them

                 

                P.S. Actually I didn't change anything before the problem occurred.

                • 5. Re: JBoss AS 7.1.1.Final fails to start
                  handyman

                  I downloaded a fresh new installation of 7.1.1.Final Brontes and tried running the domain.bat. I'm attaching the log files, domain and host xml.

                  • 6. Re: JBoss AS 7.1.1.Final fails to start
                    wdfink

                    The logs look like that the JVM is crashed.

                    I suppose you did not change host/domain.xml right.

                     

                    Do you see any JVM crash files in the diretory where you start?

                    What if you start standalone.bat?

                    Could you try another JVM?

                    How your start command, console output lookslike?

                    Do you see the java processes still running?

                    • 7. Re: JBoss AS 7.1.1.Final fails to start
                      ctomc

                      Can you try with 32bit jvm?

                      • 8. Re: JBoss AS 7.1.1.Final fails to start
                        handyman

                        I didn't change the host/domain.xml.

                         

                        I don't see any JVM crash files whether I run the domain or the standalone bat.

                         

                        I tried running the domain bat with Java - 1.6.0_32 and 1.7.0_04 - both 32 and 64 bit.

                         

                        Once the domain script's console reaches "JBoss AS 7.1.1.Final "Brontes" starting" there is a java process still running.

                        • 9. Re: JBoss AS 7.1.1.Final fails to start
                          wdfink

                          If the java process is still running

                          1)

                          add "-Djboss.boot.server.log.level=TRACE" to your start parameter

                          change the root-logger level of you stanalone/domain configuration to "TRACE"

                          maybe the logs can give you a hint.

                           

                          2)

                          Is there a posibility to monitor the process low-level, like truss on a UNIX system? This might give you a hint where the process is hanging

                          • 10. Re: JBoss AS 7.1.1.Final fails to start
                            wdfink

                            On Windows you can try the process monitor of sysinternals.

                            Search for "microsoft sysinternals process monitor"

                            • 11. Re: JBoss AS 7.1.1.Final fails to start
                              handyman

                              There doesn't seem to be a deadlock, but maybe a thread is waiting on a monitor that is never notified or some other issue.

                               

                              Here's a threaddump:

                               

                               

                               

                              "DestroyJavaVM" prio=6 tid=0x00398800 nid=0x1554 waiting on condition [0x00000000]
                                 java.lang.Thread.State: RUNNABLE
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "reaper for Host Controller" prio=6 tid=0x35b15400 nid=0xec runnable [0x3683f000]
                                 java.lang.Thread.State: RUNNABLE
                                      at java.lang.ProcessImpl.waitFor(Native Method)
                                      at org.jboss.as.process.ManagedProcess$JoinTask.run(ManagedProcess.java:292)
                                      at java.lang.Thread.run(Thread.java:662)
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "stdout for Host Controller" prio=6 tid=0x358c2400 nid=0x1514 runnable [0x367af000]
                                 java.lang.Thread.State: RUNNABLE
                                      at java.io.FileInputStream.readBytes(Native Method)
                                      at java.io.FileInputStream.read(FileInputStream.java:220)
                                      at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
                                      at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
                                      - locked <0x2aa023f8> (a java.io.BufferedInputStream)
                                      at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
                                      at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
                                      - locked <0x2aaae6b8> (a java.io.BufferedInputStream)
                                      at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:264)
                                      at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:306)
                                      at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158)
                                      - locked <0x2aaae6a0> (a java.io.InputStreamReader)
                                      at java.io.InputStreamReader.read(InputStreamReader.java:167)
                                      at java.io.BufferedReader.fill(BufferedReader.java:136)
                                      at java.io.BufferedReader.readLine(BufferedReader.java:299)
                                      - locked <0x2aaae6a0> (a java.io.InputStreamReader)
                                      at java.io.BufferedReader.readLine(BufferedReader.java:362)
                                      at org.jboss.as.process.ManagedProcess$ReadTask.run(ManagedProcess.java:357)
                                      at java.lang.Thread.run(Thread.java:662)
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "stderr for Host Controller" prio=6 tid=0x3597f400 nid=0x8c4 runnable [0x3671f000]
                                 java.lang.Thread.State: RUNNABLE
                                      at java.io.FileInputStream.readBytes(Native Method)
                                      at java.io.FileInputStream.read(FileInputStream.java:220)
                                      at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
                                      at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
                                      - locked <0x2aa5c3b8> (a java.io.BufferedInputStream)
                                      at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:264)
                                      at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:306)
                                      at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158)
                                      - locked <0x2aa5c3a0> (a java.io.InputStreamReader)
                                      at java.io.InputStreamReader.read(InputStreamReader.java:167)
                                      at java.io.BufferedReader.fill(BufferedReader.java:136)
                                      at java.io.BufferedReader.readLine(BufferedReader.java:299)
                                      - locked <0x2aa5c3a0> (a java.io.InputStreamReader)
                                      at java.io.BufferedReader.readLine(BufferedReader.java:362)
                                      at org.jboss.as.process.ManagedProcess$ReadTask.run(ManagedProcess.java:357)
                                      at java.lang.Thread.run(Thread.java:662)
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "Accept thread" prio=6 tid=0x35b7c400 nid=0x1614 runnable [0x3666f000]
                                 java.lang.Thread.State: RUNNABLE
                                      at java.net.PlainSocketImpl.socketAccept(Native Method)
                                      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
                                      - locked <0x2a90f538> (a java.net.SocksSocketImpl)
                                      at java.net.ServerSocket.implAccept(ServerSocket.java:462)
                                      at java.net.ServerSocket.accept(ServerSocket.java:430)
                                      at org.jboss.as.process.protocol.ProtocolServer$1.run(ProtocolServer.java:85)
                                      at java.lang.Thread.run(Thread.java:662)
                                      at org.jboss.threads.JBossThread.run(JBossThread.java:122)
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "Reference Reaper" daemon prio=6 tid=0x357dd000 nid=0x1594 in Object.wait() [0x359cf000]
                                 java.lang.Thread.State: WAITING (on object monitor)
                                      at java.lang.Object.wait(Native Method)
                                      - waiting on <0x2a3e91c8> (a java.lang.ref.ReferenceQueue$Lock)
                                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
                                      - locked <0x2a3e91c8> (a java.lang.ref.ReferenceQueue$Lock)
                                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
                                      at org.jboss.modules.ref.References$ReaperThread.run(References.java:68)
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "Low Memory Detector" daemon prio=6 tid=0x35122400 nid=0x1678 runnable [0x00000000]
                                 java.lang.Thread.State: RUNNABLE
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "C2 CompilerThread1" daemon prio=10 tid=0x35117000 nid=0xc60 waiting on condition [0x00000000]
                                 java.lang.Thread.State: RUNNABLE
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "C2 CompilerThread0" daemon prio=10 tid=0x35111c00 nid=0xed4 waiting on condition [0x00000000]
                                 java.lang.Thread.State: RUNNABLE
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "Attach Listener" daemon prio=10 tid=0x35110400 nid=0x244 waiting on condition [0x00000000]
                                 java.lang.Thread.State: RUNNABLE
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "Signal Dispatcher" daemon prio=10 tid=0x3510ec00 nid=0xba0 runnable [0x00000000]
                                 java.lang.Thread.State: RUNNABLE
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "Finalizer" daemon prio=8 tid=0x350fb400 nid=0x144c in Object.wait() [0x353df000]
                                 java.lang.Thread.State: WAITING (on object monitor)
                                      at java.lang.Object.wait(Native Method)
                                      - waiting on <0x2a2f1158> (a java.lang.ref.ReferenceQueue$Lock)
                                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
                                      - locked <0x2a2f1158> (a java.lang.ref.ReferenceQueue$Lock)
                                      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
                                      at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "Reference Handler" daemon prio=10 tid=0x350fa000 nid=0x13f4 in Object.wait() [0x3534f000]
                                 java.lang.Thread.State: WAITING (on object monitor)
                                      at java.lang.Object.wait(Native Method)
                                      - waiting on <0x2a2f1058> (a java.lang.ref.Reference$Lock)
                                      at java.lang.Object.wait(Object.java:485)
                                      at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
                                      - locked <0x2a2f1058> (a java.lang.ref.Reference$Lock)
                              
                                 Locked ownable synchronizers:
                                      - None
                              
                              "VM Thread" prio=10 tid=0x350f6400 nid=0x153c runnable
                              
                              "GC task thread#0 (ParallelGC)" prio=6 tid=0x35050400 nid=0x17b0 runnable
                              
                              "GC task thread#1 (ParallelGC)" prio=6 tid=0x35051400 nid=0xda0 runnable
                              
                              "VM Periodic Task Thread" prio=10 tid=0x35124000 nid=0xae4 waiting on condition
                              
                              JNI global references: 914
                              

                               

                              P.S. Changing the logging level to TRACE didn't give me much more information. Attaching the log files.

                              • 12. Re: JBoss AS 7.1.1.Final fails to start
                                handyman

                                Reviewing the process through JConsole showed three RMI TCP Connection threads that blocked and waited many times and the process controller log changing accordingly. Attaching the log.