Every three - four days we are getting a JBOSS server failure. The sun.misc.Cleaner code terminates shortly after 3am with the following error:
2010-11-13 03:15:26,119 ERROR [STDERR] java.lang.Error: Cleaner terminated abnormally
2010-11-13 03:15:26,120 ERROR [STDERR] at sun.misc.Cleaner$1.run(Cleaner.java:130)
2010-11-13 03:15:26,120 ERROR [STDERR] at java.security.AccessController.doPrivileged(Native Method)
2010-11-13 03:15:26,120 ERROR [STDERR] at sun.misc.Cleaner.clean(Cleaner.java:127)
2010-11-13 03:15:26,120 ERROR [STDERR] at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:124)
2010-11-13 03:15:26,120 ERROR [STDERR] Caused by: java.io.IOException: Access is denied
2010-11-13 03:15:26,120 ERROR [STDERR] at sun.nio.ch.FileChannelImpl.unmap0(Native Method)
2010-11-13 03:15:26,120 ERROR [STDERR] at sun.nio.ch.FileChannelImpl.access$100(FileChannelImpl.java:32)
2010-11-13 03:15:26,120 ERROR [STDERR] at sun.nio.ch.FileChannelImpl$Unmapper.run(FileChannelImpl.java:677)
2010-11-13 03:15:26,120 ERROR [STDERR] at sun.misc.Cleaner.clean(Cleaner.java:125)
2010-11-13 03:15:26,120 ERROR [STDERR] ... 1 more
2010-11-13 03:15:26,141 INFO [org.jboss.system.server.Server] Runtime shutdown hook called, forceHalt: true
2010-11-13 03:15:26,142 INFO [org.jboss.system.server.Server] JBoss SHUTDOWN: Undeploying all packages
JBoss shuts down completely !! Having researched this it appears that this was a feature added to Cleaner in later releases in the advent of failure
This happens on two out of three cluster members. The third remains up and running.
Is there any way we can tell what is actually making the call to cleaner around this time without recompiling the cleaner code or can anybody shed any light on what is going on ?
windows Server 2008 R2 Standard
8 Gb 64 bit OS
java version "1.6.0_20"
java(tm) se runtime environment (build 1.6.0_20-b02)
java hotspot(tm) 64-bit server VM (build 16.3-b01, mixed mode)
I would recommend to install 1.6.22 (latest Java release).
We drop 64Bit JVM because we found out that we have no benefit when using more than 2GB for the AppServer and we have some problems with the 64BitJava @ Sun and HP.