Out of memory errors
creynolds May 6, 2009 11:06 AMIn production we are running 4.2.2ga clustered with 4 nodes. We are seeing this error ever few hours. The servers are w2k3 64bit 18gigs of ram with java 1.5.05_05 32bit.
INFO | jvm 1 | 2009/05/06 08:53:20 | 08:53:20,130 INFO [STDOUT] 2009-05-06 08:53:20,130 ERROR [System] Disabling Refresh for:/xxxxxxxxx request from x.x.x.x INFO | jvm 1 | 2009/05/06 08:53:56 | 08:53:56,833 ERROR [[action]] Servlet.service() for servlet action threw exception INFO | jvm 1 | 2009/05/06 08:53:56 | java.lang.OutOfMemoryError: unable to create new native thread INFO | jvm 1 | 2009/05/06 08:53:56 | at java.lang.Thread.start0(Native Method) INFO | jvm 1 | 2009/05/06 08:53:56 | at java.lang.Thread.start(Thread.java:574) INFO | jvm 1 | 2009/05/06 08:53:56 | at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:833) INFO | jvm 1 | 2009/05/06 08:53:56 | at com.sun.net.ssl.internal.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1025) INFO | jvm 1 | 2009/05/06 08:53:56 | at com.sun.net.ssl.internal.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1038) INFO | jvm 1 | 2009/05/06 08:53:56 | at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:405) INFO | jvm 1 | 2009/05/06 08:53:56 | at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:170) INFO | jvm 1 | 2009/05/06 08:53:56 | at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:836) INFO | jvm 1 | 2009/05/06 08:53:56 | at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:230) INFO | jvm 1 | 2009/05/06 08:53:56 | at com.sun.xml.rpc.client.http.HttpClientTransport.writeMessageToConnection(HttpClientTransport.java:382) INFO | jvm 1 | 2009/05/06 08:53:56 | at com.sun.xml.rpc.client.http.HttpClientTransport.invoke(HttpClientTransport.java:86) INFO | jvm 1 | 2009/05/06 08:53:56 | at com.sun.xml.rpc.client.StreamingSender._send(StreamingSender.java:92) INFO | jvm 1 | 2009/05/06 08:54:02 | 08:54:02,364 ERROR [[action]] Servlet.service() for servlet action threw exception INFO | jvm 1 | 2009/05/06 08:54:02 | java.lang.OutOfMemoryError: unable to create new native thread INFO | jvm 1 | 2009/05/06 08:54:02 | at java.lang.Thread.start0(Native Method) INFO | jvm 1 | 2009/05/06 08:54:02 | at java.lang.Thread.start(Thread.java:574) INFO | jvm 1 | 2009/05/06 08:54:02 | at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:833) INFO | jvm 1 | 2009/05/06 08:54:02 | at com.sun.net.ssl.internal.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1025) INFO | jvm 1 | 2009/05/06 08:54:02 | at com.sun.net.ssl.internal.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1038) INFO | jvm 1 | 2009/05/06 08:54:02 | at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:405) INFO | jvm 1 | 2009/05/06 08:54:02 | at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:170) INFO | jvm 1 | 2009/05/06 08:54:02 | at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:836) INFO | jvm 1 | 2009/05/06 08:54:02 | at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:230) INFO | jvm 1 | 2009/05/06 08:54:02 | at com.sun.xml.rpc.client.http.HttpClientTransport.writeMessageToConnection(HttpClientTransport.java:382) INFO | jvm 1 | 2009/05/06 08:54:02 | at com.sun.xml.rpc.client.http.HttpClientTransport.invoke(HttpClientTransport.java:86) INFO | jvm 1 | 2009/05/06 08:54:02 | at com.sun.xml.rpc.client.StreamingSender._send(StreamingSender.java:92) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] Exception in thread "RMI RenewClean-[XXX.XXX.XXX.XXX:1101]" INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] java.lang.OutOfMemoryError: unable to create new native thread INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at java.lang.Thread.start0(Native Method) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at java.lang.Thread.start(Thread.java:574) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at sun.rmi.transport.tcp.TCPChannel.free(TCPChannel.java:322) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at sun.rmi.server.UnicastRef.free(UnicastRef.java:395) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at sun.rmi.server.UnicastRef.done(UnicastRef.java:412) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at sun.rmi.transport.DGCImpl_Stub.dirty(Unknown Source) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at sun.rmi.transport.DGCClient$EndpointEntry.makeDirtyCall(DGCClient.java:328) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at sun.rmi.transport.DGCClient$EndpointEntry.access$1600(DGCClient.java:144) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:539) INFO | jvm 1 | 2009/05/06 08:31:31 | 08:31:31,381 ERROR [STDERR] at java.lang.Thread.run(Thread.java:595) wrapper.java.additional.2=-Xss1m wrapper.java.additional.3=-Xms1g wrapper.java.additional.4=-Xmx1280m wrapper.java.additional.9=-XX:+UseConcMarkSweepGC wrapper.java.additional.10=-XX:+CMSPermGenSweepingEnabled wrapper.java.additional.11=-XX:+CMSClassUnloadingEnabled wrapper.java.additional.12=-XX:MaxPermSize=256m
any ideas? thanks in advanced!