JBoss As 5.1 OutOfMemoryError: PermGen space on start up when
Jboss dies on start up when i added these lines in run.conf
JAVA_OPTS="$JAVA_OPTS -Djboss.platform.mbeanserver"
JAVA_OPTS="$JAVA_OPTS -Djavax.management.builder.initial=org.jboss.system.server.jmx.MBeanServerBuilderImpl"
I am running it with
JAVA_OPTS="-server -javaagent:jboss-profiler.jar -Djboss-profiler.properties=jboss-profiler.properties -Xms1024m -Xmx1024m -XX:PermSize=128m -XX:MaxPermSize=512m -XX:ReservedCodeCacheSize=64m
-XX:+UseParallelGC -XX:ParallelGCThreads=20 -XX:+UseParallelOldGC
-Djava.awt.headless=true -Dsun.net.inetaddr.ttl=60 -Dsun.net.client.defaultConnectTimeout=30000 -Dorg.jboss.resolver.warning=true
-Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000"
I tried with UseConcMarkSweepGC too.
Here is the console error
16:37:11,621 INFO [DefaultPartition] Number of cluster members: 1 16:37:11,627 INFO [DefaultPartition] Other members: 0 16:37:11,675 INFO [RPCManagerImpl] Received new cluster view: [127.0.0.1:46117|0] [127.0.0.1:46117] 16:37:11,738 INFO [RPCManagerImpl] Cache local address is 127.0.0.1:46117 16:37:11,740 INFO [RPCManagerImpl] state was retrieved successfully (in 2.1 seconds) 16:37:11,756 INFO [ComponentRegistry] JBoss Cache version: JBossCache 'Cascabel' 3.1.0.GA 16:37:11,756 INFO [DefaultPartition] Fetching serviceState (will wait for 30000 milliseconds): 16:37:11,759 INFO [DefaultPartition] State could not be retrieved (we are the first member in group) 16:37:11,864 INFO [HANamingService] Started HAJNDI bootstrap; jnpPort=1100, backlog=50, bindAddress=/127.0.0.1 16:37:11,876 INFO [DetachedHANamingService$AutomaticDiscovery] Listening on /127.0.0.1:1102, group=230.0.0.32, HA-JNDI address=127.0.0.1:1100 16:37:12,561 INFO [UnifiedInvokerHA] Service name is jboss:service=invoker,type=unifiedha 16:37:13,267 WARN [JBossASSecurityMetadataStore] WARNING! POTENTIAL SECURITY RISK. It has been detected that the MessageSucker component which sucks messages from one node to another has not had its password changed from the installation default. Please see the JBoss Messaging user guide for instructions on how to do this. 16:37:13,281 WARN [AnnotationCreator] No ClassLoader provided, using TCCL: org.jboss.managed.api.annotation.ManagementComponent 16:37:13,392 WARN [AnnotationCreator] No ClassLoader provided, using TCCL: org.jboss.managed.api.annotation.ManagementComponent 16:37:13,456 INFO [TransactionManagerService] JBossTS Transaction Service (JTA version - tag:JBOSSTS_4_6_1_GA) - JBoss Inc. 16:37:13,456 INFO [TransactionManagerService] Setting up property manager MBean and JMX layer 16:37:13,677 INFO [TransactionManagerService] Initializing recovery manager 16:37:13,878 INFO [TransactionManagerService] Recovery manager configured 16:37:13,883 INFO [TransactionManagerService] Binding TransactionManager JNDI Reference 16:37:13,924 INFO [TransactionManagerService] Starting transaction recovery manager 16:37:14,578 INFO [AprLifecycleListener] The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib/jvm/java-6-sun-1.6.0.16/jre/lib/amd64/server:/usr/lib/jvm/java-6-sun-1.6.0.16/jre/lib/amd64:/usr/lib/jvm/java-6-sun-1.6.0.16/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib 16:37:14,650 INFO [Http11Protocol] Initializing Coyote HTTP/1.1 on http-127.0.0.1-8080 16:37:14,651 INFO [AjpProtocol] Initializing Coyote AJP/1.3 on ajp-127.0.0.1-8009 16:37:14,690 INFO [StandardService] Starting service jboss.web 16:37:14,694 INFO [StandardEngine] Starting Servlet Engine: JBoss Web/2.1.3.GA 16:37:14,771 INFO [Catalina] Server startup in 119 ms 16:37:14,791 INFO [TomcatDeployment] deploy, ctxPath=/jbossws 16:37:15,346 INFO [TomcatDeployment] deploy, ctxPath=/invoker 16:37:15,404 INFO [TomcatDeployment] deploy, ctxPath=/web-console 16:37:15,728 INFO [TomcatDeployment] deploy, ctxPath=/juddi 16:37:15,763 INFO [RegistryServlet] Loading jUDDI configuration. 16:37:15,764 INFO [RegistryServlet] Resources loaded from: /WEB-INF/juddi.properties 16:37:15,764 INFO [RegistryServlet] Initializing jUDDI components. 16:37:20,719 INFO [RARDeployment] Required license terms exist, view vfszip:/home/dimitar/Desktop/dimitar/jboss-5.1.0.GA-clean/server/all/deploy/jboss-local-jdbc.rar/META-INF/ra.xml 16:37:20,743 INFO [RARDeployment] Required license terms exist, view vfszip:/home/dimitar/Desktop/dimitar/jboss-5.1.0.GA-clean/server/all/deploy/jboss-xa-jdbc.rar/META-INF/ra.xml 16:37:20,780 INFO [RARDeployment] Required license terms exist, view vfszip:/home/dimitar/Desktop/dimitar/jboss-5.1.0.GA-clean/server/all/deploy/jms-ra.rar/META-INF/ra.xml 16:37:20,807 INFO [RARDeployment] Required license terms exist, view vfszip:/home/dimitar/Desktop/dimitar/jboss-5.1.0.GA-clean/server/all/deploy/mail-ra.rar/META-INF/ra.xml 16:37:33,033 WARN [ClassLoaderManager] Unexpected error during load of:org.hsqldb.Grantee java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:621) at org.jboss.classloader.spi.base.BaseClassLoader.access$200(BaseClassLoader.java:63) at org.jboss.classloader.spi.base.BaseClassLoader$2.run(BaseClassLoader.java:572) at org.jboss.classloader.spi.base.BaseClassLoader$2.run(BaseClassLoader.java:532) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.classloader.spi.base.BaseClassLoader.loadClassLocally(BaseClassLoader.java:530) at org.jboss.classloader.spi.base.BaseClassLoader.loadClassLocally(BaseClassLoader.java:507) at org.jboss.classloader.spi.base.BaseDelegateLoader.loadClass(BaseDelegateLoader.java:134) at org.jboss.classloader.spi.filter.FilteredDelegateLoader.loadClass(FilteredDelegateLoader.java:131) at org.jboss.classloader.spi.base.ClassLoadingTask$ThreadTask.run(ClassLoadingTask.java:452) at org.jboss.classloader.spi.base.ClassLoaderManager.nextTask(ClassLoaderManager.java:251) at org.jboss.classloader.spi.base.ClassLoaderManager.process(ClassLoaderManager.java:150) at org.jboss.classloader.spi.base.BaseClassLoaderDomain.loadClass(BaseClassLoaderDomain.java:265) at org.jboss.classloader.spi.base.BaseClassLoaderDomain.loadClass(BaseClassLoaderDomain.java:1119) at org.jboss.classloader.spi.base.BaseClassLoader.loadClassFromDomain(BaseClassLoader.java:798) at org.jboss.classloader.spi.base.BaseClassLoader.loadClass(BaseClassLoader.java:441) at java.lang.ClassLoader.loadClass(ClassLoader.java:252) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) at org.hsqldb.GranteeManager.addGrantee(Unknown Source) at org.hsqldb.GranteeManager.addRole(Unknown Source) at org.hsqldb.GranteeManager.<init>(Unknown Source) at org.hsqldb.Database.reopen(Unknown Source) at org.hsqldb.Database.open(Unknown Source) at org.hsqldb.DatabaseManager.getDatabase(Unknown Source) at org.hsqldb.DatabaseManager.newSession(Unknown Source) at org.hsqldb.jdbc.jdbcConnection.<init>(Unknown Source) at org.hsqldb.jdbcDriver.getConnection(Unknown Source) at org.hsqldb.jdbcDriver.connect(Unknown Source) at java.sql.DriverManager.getConnection(DriverManager.java:582) at java.sql.DriverManager.getConnection(DriverManager.java:185) at org.jboss.jdbc.HypersonicDatabase.getConnection(HypersonicDatabase.java:777) 16:37:34,963 WARN [ClassLoaderManager] Unexpected error during load of:org.hsqldb.lib.HashMap$KeySet java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:621) at org.jboss.classloader.spi.base.BaseClassLoader.access$200(BaseClassLoader.java:63) at org.jboss.classloader.spi.base.BaseClassLoader$2.run(BaseClassLoader.java:572) at org.jboss.classloader.spi.base.BaseClassLoader$2.run(BaseClassLoader.java:532) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.classloader.spi.base.BaseClassLoader.loadClassLocally(BaseClassLoader.java:530) at org.jboss.classloader.spi.base.BaseClassLoader.loadClassLocally(BaseClassLoader.java:507) at org.jboss.classloader.spi.base.BaseDelegateLoader.loadClass(BaseDelegateLoader.java:134) at org.jboss.classloader.spi.filter.FilteredDelegateLoader.loadClass(FilteredDelegateLoader.java:131) at org.jboss.classloader.spi.base.ClassLoadingTask$ThreadTask.run(ClassLoadingTask.java:452) at org.jboss.classloader.spi.base.ClassLoaderManager.nextTask(ClassLoaderManager.java:251) at org.jboss.classloader.spi.base.ClassLoaderManager.process(ClassLoaderManager.java:150) at org.jboss.classloader.spi.base.BaseClassLoaderDomain.loadClass(BaseClassLoaderDomain.java:265) at org.jboss.classloader.spi.base.BaseClassLoaderDomain.loadClass(BaseClassLoaderDomain.java:1119) at org.jboss.classloader.spi.base.BaseClassLoader.loadClassFromDomain(BaseClassLoader.java:798) at org.jboss.classloader.spi.base.BaseClassLoader.loadClass(BaseClassLoader.java:441) at java.lang.ClassLoader.loadClass(ClassLoader.java:252) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) at org.hsqldb.lib.HashMap.keySet(Unknown Source) at org.hsqldb.DatabaseManager.notifyServers(Unknown Source) at org.hsqldb.DatabaseManager.removeDatabase(Unknown Source) at org.hsqldb.Database.reopen(Unknown Source) at org.hsqldb.Database.open(Unknown Source) at org.hsqldb.DatabaseManager.getDatabase(Unknown Source) at org.hsqldb.DatabaseManager.newSession(Unknown Source) at org.hsqldb.jdbc.jdbcConnection.<init>(Unknown Source) at org.hsqldb.jdbcDriver.getConnection(Unknown Source) at org.hsqldb.jdbcDriver.connect(Unknown Source) at java.sql.DriverManager.getConnection(DriverManager.java:582) at java.sql.DriverManager.getConnection(DriverManager.java:185) at org.jboss.jdbc.HypersonicDatabase.getConnection(HypersonicDatabase.java:777) 16:37:36,834 ERROR [AbstractKernelController] Error installing to Start: name=jboss:database=localDB,service=Hypersonic state=Create mode=Manual requiredState=Installed 16:38:13,665 ERROR [ServiceModuleJSR77Deployer] Error during undeploy: vfsfile:/home/dimitar/Desktop/dimitar/jboss-5.1.0.GA-clean/server/all/deploy/hsqldb-ds.xml java.lang.OutOfMemoryError: PermGen space 16:38:13,666 ERROR [AbstractKernelController] Error installing to Real: name=vfsfile:/home/dimitar/Desktop/dimitar/jboss-5.1.0.GA-clean/server/all/deploy/hsqldb-ds.xml state=PreReal mode=Manual requiredState=Real java.lang.OutOfMemoryError: PermGen space 16:38:21,450 ERROR [AOPClassLoaderDeployer] Error during undeploy: vfsfile:/home/dimitar/Desktop/dimitar/jboss-5.1.0.GA-clean/server/all/deploy/hsqldb-ds.xml java.lang.OutOfMemoryError: PermGen space
Here is the jstat log
/opt/jdk1.6.0_16/bin$ ./jstat -gcutil -h 10 -t 18677 1s Timestamp S0 S1 E O P YGC YGCT FGC FGCT GCT 24.0 0.00 32.11 80.96 83.10 66.34 19 0.673 2 0.836 1.509 25.0 74.48 0.00 31.98 83.10 66.96 20 0.728 2 0.836 1.564 26.0 74.48 0.00 49.86 83.10 68.62 20 0.728 2 0.836 1.564 27.0 74.48 0.00 79.79 83.10 69.67 20 0.728 2 0.836 1.564 28.0 0.00 99.97 0.00 99.00 69.81 21 0.881 3 0.836 1.716 29.0 0.00 0.00 51.55 61.52 70.10 21 0.881 3 1.876 2.757 30.0 58.70 0.00 7.66 61.56 71.08 22 1.000 3 1.876 2.876 31.0 58.70 0.00 45.97 61.56 71.82 22 1.000 3 1.876 2.876 32.0 58.70 0.00 84.27 61.56 72.35 22 1.000 3 1.876 2.876 33.0 0.00 99.17 17.60 61.56 72.89 23 1.093 3 1.876 2.970 Timestamp S0 S1 E O P YGC YGCT FGC FGCT GCT 34.0 0.00 99.17 57.04 61.56 74.44 23 1.093 3 1.876 2.970 35.0 0.00 99.17 91.12 61.56 78.47 23 1.093 3 1.876 2.970 36.0 99.99 0.00 51.51 65.19 79.26 24 1.229 3 1.876 3.105 37.0 0.00 54.23 15.76 76.99 80.11 25 1.365 3 1.876 3.241 38.0 0.00 54.23 52.68 76.99 82.29 25 1.365 3 1.876 3.241 39.0 0.00 54.23 89.70 76.99 84.00 25 1.365 3 1.876 3.241 40.0 87.04 0.00 17.74 76.99 85.20 26 1.468 3 1.876 3.345 41.0 87.04 0.00 46.05 76.99 88.92 26 1.468 3 1.876 3.345 42.0 87.04 0.00 51.50 76.99 89.10 26 1.468 3 1.876 3.345 43.0 87.04 0.00 51.50 76.99 89.10 26 1.468 3 1.876 3.345 Timestamp S0 S1 E O P YGC YGCT FGC FGCT GCT 44.0 87.04 0.00 91.16 76.99 90.53 26 1.468 3 1.876 3.345 45.0 0.00 99.96 30.74 76.99 92.46 27 1.593 3 1.876 3.469 46.0 0.00 99.96 57.95 76.99 95.40 27 1.593 3 1.876 3.469 47.0 0.00 99.96 85.60 76.99 98.88 27 1.593 3 1.876 3.469 48.0 99.99 0.00 0.00 85.26 100.00 28 1.762 4 1.876 3.638 49.0 99.99 0.00 0.00 85.26 99.63 28 1.762 4 1.876 3.638 50.0 0.00 28.44 0.00 66.36 100.00 29 1.901 5 3.544 5.445 51.0 0.00 0.00 0.00 64.23 100.00 30 1.907 6 4.896 6.804 52.0 0.00 0.00 0.00 47.02 98.94 30 1.907 6 6.143 8.051 53.0 0.00 5.98 0.00 47.02 100.00 31 1.935 7 6.143 8.078 Timestamp S0 S1 E O P YGC YGCT FGC FGCT GCT 54.0 0.00 0.00 0.00 42.69 100.00 32 1.944 8 7.164 9.109 55.0 0.00 100.00 0.00 36.88 100.00 33 1.953 9 8.234 10.187 56.0 0.00 0.00 0.00 32.42 100.00 34 1.959 10 9.175 11.134 57.0 0.00 100.00 0.00 28.13 100.00 35 1.966 11 10.135 12.101 58.0 0.00 0.00 0.00 24.58 100.00 36 1.972 12 11.088 13.060 59.0 0.00 95.00 0.00 21.22 100.00 37 1.980 13 12.197 14.177 60.0 0.00 0.00 0.00 21.03 100.00 38 1.987 14 13.136 15.123 61.0 0.00 100.00 0.00 20.99 100.00 39 1.994 15 14.207 16.201 62.0 0.00 0.00 0.00 21.00 100.00 40 2.000 16 15.114 17.114 63.0 0.00 100.00 0.00 20.98 100.00 41 2.012 17 16.121 18.133