1 Reply Latest reply on Apr 6, 2015 5:48 PM by humanbeing

Why am I getting 500 Internal Server Error?

humanbeing Apr 3, 2015 4:35 PM

Upgrading web app from jboss 6 to wildfly 8. I have a domain setup of 2 servers (master and slave) for clustering (load balancing). When I visit the home page, I get '500 Internal Server Error'.

OS: Centos 6 Web: Apache 2.2.15 App: Wildfly 8.2.0.Final Mod_Cluster: 1.2.0.Final mod_ssl: 2.2.15 OpenSSL: 1.0.1e-fips mod_wsgi: 3.2 Python: 2.6.6 mod_perl: 2.0.4 Perl: v5.10.1

Some logs below (and attached). If I forgot to include anything please let me know and I'll add it. Thanks in advanced.

Apache httpd

access log:

mymachineIP- - [03/Apr/2015:15:41:29 -0400] "GET /mod_cluster-manager?nonce=a1f1608b-84d5-4d77-857e-d5e2bad71519&refresh=10 HTTP/1.1" 200 2567 "-" "Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Firefox/31.0"

AnotherServerIP- - [03/Apr/2015:15:41:29 -0400] "STATUS / HTTP/1.1" 200 86 "-" "ClusterListener/1.0"

SlaveIP- - [03/Apr/2015:15:41:31 -0400] "STATUS / HTTP/1.1" 200 74 "-" "ClusterListener/1.0"

DomainIP- - [03/Apr/2015:15:41:36 -0400] "STATUS / HTTP/1.1" 200 69 "-" "ClusterListener/1.0"

error log (this error didn't prevent jboss from running the app but perhaps it is now):

[Fri Apr 03 15:02:46 2015] [error] Exception KeyError: KeyError(140387375130592,) in <module 'threading' from '/usr/lib64/python2.6/threading.pyc'> ignored

[Fri Apr 03 15:02:47 2015] [notice] caught SIGTERM, shutting down

[Fri Apr 03 15:02:48 2015] [notice] SELinux policy enabled; httpd running as context unconfined_u:system_r:httpd_t:s0

[Fri Apr 03 15:02:48 2015] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)

[Fri Apr 03 15:02:48 2015] [warn] Init: (oasistest.staffaccess.net:443) You configured HTTP(80) on the standard HTTPS(443) port!

[Fri Apr 03 15:02:48 2015] [notice] Digest: generating secret for digest authentication ...

[Fri Apr 03 15:02:48 2015] [notice] Digest: done

[Fri Apr 03 15:02:48 2015] [warn] Init: (oasistest.staffaccess.net:443) You configured HTTP(80) on the standard HTTPS(443) port!

[Fri Apr 03 15:02:48 2015] [warn] mod_wsgi: Compiled for Python/2.6.2.

[Fri Apr 03 15:02:48 2015] [warn] mod_wsgi: Runtime using Python/2.6.6.

[Fri Apr 03 15:02:48 2015] [notice] Advertise initialized for process 8227

[Fri Apr 03 15:02:48 2015] [notice] Apache/2.2.15 (Unix) DAV/2 mod_cluster/1.2.0.Final mod_ssl/2.2.15 OpenSSL/1.0.1e-fips mod_wsgi/3.2 Python/2.6.6 mod_perl/2.0.4 Perl/v5.10.1 configured -- resuming normal operations

chatter log

[Fri Apr 03 16:20:22 2015] [info] Initial (No.1) HTTPS request received for child 3 (server oasistest.staffaccess.net:443)

[Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(1667): manager_trans STATUS

[Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(2323): manager_handler STATUS processing: "JVMRoute=master%3Aserver-three&Load=100"

[Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(1404): Processing STATUS

[Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2026): proxy: ajp: has acquired connection for (oasistest.staffaccess.net)

[Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2082): proxy: connecting ajp://oasistest.staffaccess.net:8259/ to oasistest.staffaccess.net:8259

[Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2209): proxy: connected ajp://oasistest.staffaccess.net:8259/ to oasistest.staffaccess.net:8259

[Fri Apr 03 16:20:22 2015] [debug] mod_proxy_cluster.c(773): ajp_cping_cpong: Done

[Fri Apr 03 16:20:22 2015] [debug] proxy_util.c(2044): proxy: ajp: has released connection for (oasistest.staffaccess.net)

[Fri Apr 03 16:20:22 2015] [debug] mod_manager.c(2366): manager_handler STATUS OK

[Fri Apr 03 16:20:22 2015] [debug] ssl_engine_kernel.c(1886): OpenSSL: Write: SSL negotiation finished successfully

[Fri Apr 03 16:20:22 2015] [info] [client 10.250.1.65] Connection closed to child 3 with standard shutdown (server oasistest.staffaccess.net:443)

1. Re: Why am I getting 500 Internal Server Error?

humanbeing Apr 6, 2015 5:48 PM (in response to humanbeing)

Needed to load the following module: mod_proxy_ajp.so which at least this got me past that issue. Now, I have others:

2015-04-06 15:43:40,932 ERROR [stderr] (default task-88) org.picketlink.idm.IdentityManagementException: PLIDM000002: Null argument: [IdentityType].
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at org.picketlink.idm.model.basic.BasicModel.hasRole(BasicModel.java:431)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at org.monarchnc.security.security.InlineSecuritiesBean.executeLocalQueue(InlineSecuritiesBean.java:201)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at org.monarchnc.security.security.InlineSecuritiesBean.isLocalQueue(InlineSecuritiesBean.java:190)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at sun.reflect.GeneratedMethodAccessor125.invoke(Unknown Source)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at java.lang.reflect.Method.invoke(Method.java:606)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at javax.el.BeanELResolver.getValue(BeanELResolver.java:363)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.faces.el.DemuxCompositeELResolver._getValue(DemuxCompositeELResolver.java:176)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.faces.el.DemuxCompositeELResolver.getValue(DemuxCompositeELResolver.java:203)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.el.parser.AstValue.getValue(AstValue.java:140)
2015-04-06 15:43:40,932 ERROR [stderr] (default task-88)        at com.sun.el.parser.AstValue.getValue(AstValue.java:204)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.el.ValueExpressionImpl.getValue(ValueExpressionImpl.java:226)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at org.jboss.weld.el.WeldValueExpression.getValue(WeldValueExpression.java:50)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at org.jboss.weld.el.WeldValueExpression.getValue(WeldValueExpression.java:50)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.faces.facelets.el.TagValueExpression.getValue(TagValueExpression.java:109)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.ComponentStateHelper.eval(ComponentStateHelper.java:194)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponentBase.isRendered(UIComponentBase.java:457)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1850)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.render.Renderer.encodeChildren(Renderer.java:176)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponentBase.encodeChildren(UIComponentBase.java:889)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1856)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1859)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.component.UIComponent.encodeAll(UIComponent.java:1859)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.faces.application.view.FaceletViewHandlingStrategy.renderView(FaceletViewHandlingStrategy.java:456)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at com.sun.faces.application.view.MultiViewHandler.renderView(MultiViewHandler.java:133)
2015-04-06 15:43:40,933 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:337)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at com.sun.faces.lifecycle.RenderResponsePhase.execute(RenderResponsePhase.java:120)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:219)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at org.apache.deltaspike.jsf.impl.listener.request.DeltaSpikeLifecycleWrapper.render(DeltaSpikeLifecycleWrapper.java:97)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at javax.faces.webapp.FacesServlet.service(FacesServlet.java:647)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:61)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
2015-04-06 15:43:40,934 ERROR [stderr] (default task-88)        at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78)

Also, going to the nodes via ipaddress doesn't work for the 2nd node. Could be httpd config issue so I'll revisit that first.
Actions