1 Reply Latest reply on Apr 6, 2015 5:48 PM by Human Being

    Why am I getting 500 Internal Server Error?

    Human Being Newbie

      Upgrading web app from jboss 6 to wildfly 8. I have a domain setup of 2 servers (master and slave) for clustering (load balancing). When I visit the home page, I get '500 Internal Server Error'.

      OS: Centos 6 Web: Apache 2.2.15 App: Wildfly 8.2.0.Final Mod_Cluster: 1.2.0.Final mod_ssl: 2.2.15 OpenSSL: 1.0.1e-fips mod_wsgi: 3.2 Python: 2.6.6 mod_perl: 2.0.4 Perl: v5.10.1

       

      Some logs below (and attached). If I forgot to include anything please let me know and I'll add it. Thanks in advanced.

       

      Apache httpd


      access log:

      mymachineIP- - [03/Apr/2015:15:41:29 -0400] "GET /mod_cluster-manager?nonce=a1f1608b-84d5-4d77-857e-d5e2bad71519&refresh=10 HTTP/1.1" 200 2567 "-" "Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Firefox/31.0"

      AnotherServerIP- - [03/Apr/2015:15:41:29 -0400] "STATUS / HTTP/1.1" 200 86 "-" "ClusterListener/1.0"

      SlaveIP- - [03/Apr/2015:15:41:31 -0400] "STATUS / HTTP/1.1" 200 74 "-" "ClusterListener/1.0"

      DomainIP- - [03/Apr/2015:15:41:36 -0400] "STATUS / HTTP/1.1" 200 69 "-" "ClusterListener/1.0"

       

      error log (this error didn't prevent jboss from running the app but perhaps it is now):

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

      [Fri Apr 03 15:02:47 2015] [notice] caught SIGTERM, shutting down

      [Fri Apr 03 15:02:48 2015] [notice] SELinux policy enabled; httpd running as context unconfined_u:system_r:httpd_t:s0

      [Fri Apr 03 15:02:48 2015] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)

      [Fri Apr 03 15:02:48 2015] [warn] Init: (oasistest.staffaccess.net:443) You configured HTTP(80) on the standard HTTPS(443) port!

      [Fri Apr 03 15:02:48 2015] [notice] Digest: generating secret for digest authentication ...

      [Fri Apr 03 15:02:48 2015] [notice] Digest: done

      [Fri Apr 03 15:02:48 2015] [warn] Init: (oasistest.staffaccess.net:443) You configured HTTP(80) on the standard HTTPS(443) port!

      [Fri Apr 03 15:02:48 2015] [warn] mod_wsgi: Compiled for Python/2.6.2.

      [Fri Apr 03 15:02:48 2015] [warn] mod_wsgi: Runtime using Python/2.6.6.

      [Fri Apr 03 15:02:48 2015] [notice] Advertise initialized for process 8227

      [Fri Apr 03 15:02:48 2015] [notice] Apache/2.2.15 (Unix) DAV/2 mod_cluster/1.2.0.Final mod_ssl/2.2.15 OpenSSL/1.0.1e-fips mod_wsgi/3.2 Python/2.6.6 mod_perl/2.0.4 Perl/v5.10.1 configured -- resuming normal operations

       

      chatter log

      [Fri Apr 03 16:20:22 2015] [info] Initial (No.1) HTTPS request received for child 3 (server oasistest.staffaccess.net:443)

      [Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(1667): manager_trans STATUS

      [Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(2323): manager_handler STATUS processing: "JVMRoute=master%3Aserver-three&Load=100"

      [Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(1404): Processing STATUS

      [Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2026): proxy: ajp: has acquired connection for (oasistest.staffaccess.net)

      [Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2082): proxy: connecting ajp://oasistest.staffaccess.net:8259/ to oasistest.staffaccess.net:8259

      [Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2209): proxy: connected ajp://oasistest.staffaccess.net:8259/ to oasistest.staffaccess.net:8259

      [Fri Apr 03 16:20:22 2015] [debug] mod_proxy_cluster.c(773): ajp_cping_cpong: Done

      [Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2044): proxy: ajp: has released connection for (oasistest.staffaccess.net)

      [Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(2366): manager_handler STATUS  OK

      [Fri Apr 03 16:20:22 2015] [debug] ssl_engine_kernel.c(1886): OpenSSL: Write: SSL negotiation finished successfully

      [Fri Apr 03 16:20:22 2015] [info] [client 10.250.1.65] Connection closed to child 3 with standard shutdown (server oasistest.staffaccess.net:443)

        • 1. Re: Why am I getting 500 Internal Server Error?
          Human Being Newbie

          Needed to load the following module: mod_proxy_ajp.so  which at least this got me past that issue.  Now, I have others:

           

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88) org.picketlink.idm.IdentityManagementException: PLIDM000002: Null argument: [IdentityType].

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at org.picketlink.idm.model.basic.BasicModel.hasRole(BasicModel.java:431)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at org.monarchnc.security.security.InlineSecuritiesBean.executeLocalQueue(InlineSecuritiesBean.java:201)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at org.monarchnc.security.security.InlineSecuritiesBean.isLocalQueue(InlineSecuritiesBean.java:190)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at sun.reflect.GeneratedMethodAccessor125.invoke(Unknown Source)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at java.lang.reflect.Method.invoke(Method.java:606)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at javax.el.BeanELResolver.getValue(BeanELResolver.java:363)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.faces.el.DemuxCompositeELResolver._getValue(DemuxCompositeELResolver.java:176)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.faces.el.DemuxCompositeELResolver.getValue(DemuxCompositeELResolver.java:203)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.el.parser.AstValue.getValue(AstValue.java:140)

          2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.el.parser.AstValue.getValue(AstValue.java:204)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.el.ValueExpressionImpl.getValue(ValueExpressionImpl.java:226)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at org.jboss.weld.el.WeldValueExpression.getValue(WeldValueExpression.java:50)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at org.jboss.weld.el.WeldValueExpression.getValue(WeldValueExpression.java:50)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.faces.facelets.el.TagValueExpression.getValue(TagValueExpression.java:109)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.ComponentStateHelper.eval(ComponentStateHelper.java:194)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponentBase.isRendered(UIComponentBase.java:457)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1850)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.render.Renderer.encodeChildren(Renderer.java:176)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponentBase.encodeChildren(UIComponentBase.java:889)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1856)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1859)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1859)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.faces.application.view.FaceletViewHandlingStrategy.renderView(FaceletViewHandlingStrategy.java:456)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.faces.application.view.MultiViewHandler.renderView(MultiViewHandler.java:133)

          2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at com.sun.faces.lifecycle.RenderResponsePhase.execute(RenderResponsePhase.java:120)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:219)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at org.apache.deltaspike.jsf.impl.listener.request.DeltaSpikeLifecycleWrapper.render(DeltaSpikeLifecycleWrapper.java:97)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.webapp.FacesServlet.service(FacesServlet.java:647)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:61)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)

          2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78)

           

           

          Also, going to the nodes via ipaddress doesn't work for the 2nd node.  Could be httpd config issue so I'll revisit that first.