java.lang.OutOfMemoryError: GC overhead limit exceeded
tawalisa Mar 16, 2011 1:40 AMHi all,
We meet a urgency question. When we do endurance test, Teiid server throw this exeception: java.lang.OutOfMemoryError: GC overhead limit exceeded. In this case, we do many deploy and undeloy VDB. And we do many "select " SQL command to Teiid. After a few time, Teiid server will throw this exeception. I analysed dump file of teiid server. We can see. XAManagedConnection used 49.59% memory. Our VDB has 2 datasource . Those datasource are XA. One of both connect oracle. Another datasource connect another VDB. This VDB has 2 datasoure ,too. They are XA. So from my architecture, if clieet use one connection to connect VDB, our VDB will use 4 XA Datasouce as lease. In memory of Teiid, we can find 169 org.jboss.resource.adapter.jdbc.xa.XAManagedConnection. They used 817m memory. Our teiid server java arguments is below.
-Xms1303m -Xmx2048m -XX:PermSize=256m -XX:MaxPermSize=512m -XX:+UseParallelGC -XX:+UseParallelOldGC -XX:+HeapDumpOnOutOfMemoryError
I want to know whether this result is ok or memory of teiid has been leak?
Biggest Top-Level Dominator Classes
Label | Number Of Objects | Used Heap Size | Retained Heap Size | Retained Heap, % |
---|---|---|---|---|
org.jboss.resource.adapter.jdbc.xa.XAManagedConnection | 169 | 21,632 | 817,211,128 | 49.59% |
org.jboss.mx.server.MBeanServerImpl | 2 | 96 | 175,107,832 | 10.63% |
org.teiid.metadata.Schema | 100 | 8,800 | 113,696,264 | 6.90% |
oracle.jdbc.driver.T4CConnection | 5 | 6,880 | 99,099,120 | 6.01% |
org.jboss.virtual.plugins.context.zip.ZipEntryContext | 437 | 52,440 | 88,327,728 | 5.36% |
char[] | 32,348 | 63,251,656 | 63,251,656 | 3.84% |
org.jboss.classloader.spi.base.BaseClassLoader | 201 | 33,768 | 34,585,200 | 2.10% |
java.util.jar.JarFile | 761 | 60,880 | 25,504,104 | 1.55% |
org.jboss.classloading.spi.vfs.policy.VFSClassLoaderPolicy | 201 | 28,944 | 19,894,752 | 1.21% |
org.jboss.profileservice.management.ManagementViewImpl | 1 | 224 | 17,445,328 | 1.06% |
Problem Suspect 1
One instance of "org.jboss.mx.server.MBeanServerImpl" loaded by "org.jboss.classloader.spi.base.BaseClassLoader @ 0x2aaace604b50" occupies 174,974,024 (10.62%) bytes. The memory is accumulated in one instance of "EDU.oswego.cs.dl.util.concurrent.ConcurrentReaderHashMap$Entry[]" loaded by "org.jboss.bootstrap.NoAnnotationURLClassLoader @ 0x2aaace603d38".
Keywords
org.jboss.classloader.spi.base.BaseClassLoader @ 0x2aaace604b50
org.jboss.mx.server.MBeanServerImpl
org.jboss.bootstrap.NoAnnotationURLClassLoader @ 0x2aaace603d38
EDU.oswego.cs.dl.util.concurrent.ConcurrentReaderHashMap$Entry[]
Problem Suspect 2
169 instances of "org.jboss.resource.adapter.jdbc.xa.XAManagedConnection", loaded by "org.jboss.classloader.spi.base.BaseClassLoader @ 0x2aaae105f960" occupy 817,211,128 (49.59%) bytes.
Biggest instances:
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf910cd78 - 60,778,320 (3.69%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf9137bf0 - 60,778,312 (3.69%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf910f230 - 60,778,296 (3.69%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf913cd68 - 60,778,008 (3.69%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf6900968 - 60,647,544 (3.68%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf6a49de0 - 60,647,544 (3.68%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf69a2018 - 60,646,592 (3.68%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf79ad400 - 60,642,520 (3.68%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf913c300 - 44,263,208 (2.69%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf75d10e8 - 44,132,304 (2.68%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf66adc10 - 27,617,784 (1.68%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf6629d88 - 27,617,496 (1.68%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf8caadf0 - 26,699,288 (1.62%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf72d48f8 - 26,565,472 (1.61%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aaaf5f9ddf8 - 26,565,464 (1.61%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aab2bf181b8 - 17,487,664 (1.06%) bytes.
- org.jboss.resource.adapter.jdbc.xa.XAManagedConnection @ 0x2aab31b55418 - 17,487,392 (1.06%) bytes.
Keywords
org.jboss.resource.adapter.jdbc.xa.XAManagedConnection
org.jboss.classloader.spi.base.BaseClassLoader @ 0x2aaae105f960