NullPointer Exceptions with JBOSS 4.0.2

[sk1]

Hi,

We have a JBOSS 4.0.2 instance running on Linux and earlier today, we began to see many exceptions which are suspected to have led to an outage on one of our critical applications. An Abstract of the error logs are given below. Would appreciate any help in debugging/determining root cause

2006-04-10 04:37:36,375 DEBUG [com.xxxx.xxxx.sm.rtinfo.xxxxxxxx] Time taken for reading properties from nyxxxxqa2/Producer_cairo is 329 msecs

2006-04-10 04:54:35,182 INFO [STDOUT] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)

2006-04-10 04:54:35,184 ERROR [org.jboss.web.tomcat.tc5.session.JBossCacheManager] processSessionRepl: failed with exception: java.lang.NullPointerException

2006-04-10 04:54:35,186 INFO [STDOUT] at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)

2006-04-10 04:54:35,186 INFO [STDOUT] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)

2006-04-10 04:54:35,186 INFO [STDOUT] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)

2006-04-10 04:37:36,355 DEBUG [com.xxxx.xxxx.sm.rtinfo.xxxxxxxx] Time taken for reading properties from nyxxxxqa2/Producer_xxxxxxxx is 234 msecs

2006-04-10 04:54:35,186 INFO [STDOUT] at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)

2006-04-10 04:54:35,185 INFO [STDOUT] <I> Apr 10 04:50:03 [jradiusclient.BBRadiusAuthorization] End authorize(2970908, PSM, 1) = true

2006-04-10 04:54:35,188 INFO [STDOUT] at org.apache.tomcat.util.net.MasterSlaveWorkerThread.run(MasterSlaveWorkerThread.java:112)

2006-04-10 04:54:35,189 ERROR [org.jboss.web.tomcat.tc5.session.JBossCacheManager] processSessionRepl: failed with exception: java.lang.NullPointerException

2006-04-10 04:54:35,190 INFO [STDOUT] at java.lang.Thread.run(Thread.java:595)

2006-04-10 04:54:35,191 ERROR [org.jboss.web.tomcat.tc5.session.JBossCacheManager] processSessionRepl: failed with exception: java.lang.NullPointerException

2006-04-10 04:54:35,192 INFO [STDOUT] java.lang.NullPointerException

2006-04-10 04:54:35,191 INFO [STDOUT] <I> Apr 10 04:49:36 [jradiusclient.BBRadiusAuthorization] End authorize(910769, PSM, 1) = true

2006-04-10 04:54:35,192 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:484)

2006-04-10 04:54:35,193 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:256)

2006-04-10 04:54:35,192 WARN [org.jboss.web.tomcat.tc5.session.InstantSnapshotManager] Failed to replicate sessionID:tGzZnLhTCbnti+rj02DAjw**

org.jboss.util.NestedRuntimeException: JBossCacheManager.processSessionRepl(): failed to replicate session.; - nested throwable: (java.lang.NullPointerException)

at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:491)

at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:256)

at org.jboss.web.tomcat.tc5.session.InstantSnapshotManager.snapshot(InstantSnapshotManager.java:38)

at org.jboss.web.tomcat.tc5.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:91)

at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:407)

at com.xxxx.sso.tomcat.BbSsoAuthenticator.invoke(BbSsoAuthenticator.java:172)

at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:482)

at com.xxxx.sso.tomcat.BbSsoAuthenticator.invoke(BbSsoAuthenticator.java:172)

at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:59)

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)

at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)

at org.apache.catalina.valves.FastCommonAccessLogValve.invoke(FastCommonAccessLogValve.java:481)

at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)

at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)

at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)

at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)

at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)

at org.apache.tomcat.util.net.MasterSlaveWorkerThread.run(MasterSlaveWorkerThread.java:112)

at java.lang.Thread.run(Thread.java:595)

Caused by: java.lang.NullPointerException

at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:469)

... 18 more

2006-04-10 04:54:35,195 INFO [STDOUT] <I> Apr 10 04:49:26 [jradiusclient.BBRadiusAuthorization] End authorize(67395, PSM, 1) = true

2006-04-10 04:54:35,194 ERROR [org.jboss.web.tomcat.tc5.session.JBossCacheManager] processSessionRepl: failed with exception: java.lang.NullPointerException

2006-04-10 04:54:35,197 ERROR [org.jboss.web.tomcat.tc5.session.JBossCacheManager] processSessionRepl: failed with exception: java.lang.NullPointerException

2006-04-10 04:54:35,193 DEBUG [com.xxxx.xxxx.sm.rtinfo.SweepTask] Sweep terminated for nyxxxxqa3/Producer_chile in 809850msec

2006-04-10 04:54:35,189 DEBUG [com.xxxx.xxxx.sm.rtinfo.SweepTask] Sweep terminated for sunqa1/Producer_lme in 810000msec

[ben.wang]

I assume it has been working before? Unfortunately, the NPE doesn't tell a lot. I have also looked at the code and nothing obvious jump into mind.

If it continues, can you try 4.0.3SP1? We have numerous fixes toward that release.

-Ben

[brian.stansberry]

From the stack trace it looks to be from JBossCacheManager line 469, where the only way you can get an NPE is if the field referencing the TransactionManager is null. That field only gets set to null if the manager is stopped (i.e. in an undeploy of the webapp). Did anything like an undeploy happen before the NPE?