Problems Jboss 4.0.2/JKD1.4.2/Profiler1.0.RC3/Solaris 9

[thof]

I use Jboss Profiler 1.0 RC3 with
-JBoss 4.0.2,
-JD1.4.2
-Solaris 9

JVM for Jboss is running with -server. On 8 of 10 tries to capture data (e.g. kill -3) JVM crashes with a core dump. Here is the console output

Full thread dump Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode):

"UIL2(SocketManager.MsgPool@1bfdaa4 client=172.16.10.151:2900)#2" daemon prio=5
tid=0x02416d10 nid=0x5a in Object.wait() [717ff000..717ffc28]
at java.lang.Object.wait(Native Method)
- waiting on <0x7b40c470> (a

....

"VM Thread" prio=5 tid=0x000fc588 nid=0x2 runnable

"VM Periodic Task Thread" prio=10 tid=0x00109bc0 nid=0xa waiting on condition
"Suspend Checker Thread" prio=10 tid=0x00104cb0 nid=0x5 runnable
JBossProfiler: Initializing DataGathering

An unexpected exception has been detected in native code outside the VM.
Unexpected Signal : 11 occurred at PC=0xFF3E6554
Function=memcpy+0x78
Library=/usr/platform/sun4u/lib/libc_psr.so.1
Current Java thread:
at java.lang.Object.wait(Native Method)
- waiting on <0x9aa860f8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <0x9aa860f8> (a java.lang.ref.ReferenceQueue$Lock)
at org.jboss.mq.server.MessageCache.run(MessageCache.java:232)
at java.lang.Thread.run(Thread.java:534)

Dynamic libraries:
0x10000 /usr/j2sdk1.4.2_05/bin/java
0xff370000 /usr/lib/libthread.so.1
0xff3fa000 /usr/lib/libdl.so.1
0xff280000 /usr/lib/libc.so.1
0xff3e6000 /usr/platform/SUNW,Ultra-Enterprise/lib/libc_psr.so.1
0xfec00000 /usr/j2sdk1.4.2_05/jre/lib/sparc/server/libjvm.so
0xff230000 /usr/lib/libCrun.so.1
0xff210000 /usr/lib/libsocket.so.1
0xfeb00000 /usr/lib/libnsl.so.1
0xfebd0000 /usr/lib/libm.so.1
0xff1f0000 /usr/lib/libsched.so.1
0xfeae0000 /usr/lib/libmp.so.2
0xfeac0000 /usr/lib/librt.so.1
0xfeaa0000 /usr/lib/libaio.so.1
0xfea80000 /usr/lib/libmd5.so.1
0xfea60000 /usr/platform/SUNW,Ultra-Enterprise/lib/libmd5_psr.so.1
0xfea10000 /usr/j2sdk1.4.2_05/jre/lib/sparc/native_threads/libhpi.so
0xfe9d0000 /usr/j2sdk1.4.2_05/jre/lib/sparc/libverify.so
0xfe990000 /usr/j2sdk1.4.2_05/jre/lib/sparc/libjava.so
0xfe970000 /usr/j2sdk1.4.2_05/jre/lib/sparc/libzip.so
0xfe8a0000 /usr/lib/locale/iso_8859_1/iso_8859_1.so.2
0xfe840000 /usr/local/jboss-profiler-1.0/jvmpi/solaris/libjbossInspector.so
0xf9700000 /usr/local/lib/libstdc++.so.6
0xfe820000 /usr/local/lib/libgcc_s.so.1
0xfbbd0000 /usr/j2sdk1.4.2_05/jre/lib/sparc/libnet.so
0x77060000 /usr/j2sdk1.4.2_05/jre/lib/sparc/libnio.so
0x77040000 /usr/lib/libsendfile.so.1
0x75d10000 /usr/j2sdk1.4.2_05/jre/lib/sparc/libioser12.so
0x754a0000 /usr/j2sdk1.4.2_05/jre/lib/sparc/librmi.so

Heap at VM Abort:
Heap
def new generation total 169856K, used 169856K [0x79400000, 0x83ee0000, 0x994
00000)
eden space 164736K, 100% used [0x79400000, 0x834e0000, 0x834e0000)
from space 5120K, 100% used [0x834e0000, 0x839e0000, 0x839e0000)
to space 5120K, 0% used [0x839e0000, 0x839e0000, 0x83ee0000)
tenured generation total 349568K, used 65649K [0x99400000, 0xae960000, 0xd940
0000)
the space 349568K, 18% used [0x99400000, 0x9d41c458, 0x9d41c600, 0xae960000)
compacting perm gen total 28928K, used 28784K [0xd9400000, 0xdb040000, 0xf9400
000)
the space 28928K, 99% used [0xd9400000, 0xdb01c3d8, 0xdb01c400, 0xdb040000)

Local Time = Mon Jul 31 16:25:14 2006
Elapsed Time = 630
#
# The exception above was detected in native code outside the VM
#
# Java VM: Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode)
#


****************
Another exception has been detected while we were handling last error.
Dumping information about last error:
ERROR REPORT FILE = hs_err_pid3352.log
ContendedEnter ThreadId -1723858328 268
# An error report file has been saved as hs_err_pid3352.log.
# Please refer to the file for further information.
#
PC = 0xff3e6554
SIGNAL = 11
FUNCTION NAME = memcpy
OFFSET = 0x78
LIBRARY NAME = /usr/platform/sun4u/lib/libc_psr.so.1
Please check ERROR REPORT FILE for further information, if there is any.
Good bye.
Segmentation Fault - core dumped


Any ideas?

[clebert.suconic]

I just updated CR4 to downloads.

There was a fix on synchronizations on Linked Lists.

Also, I compiled the libraries using Solaris' compiler this time.

In case you want to recompile it you can use CC-compile.sh

[thof]

I installed your latest version, but can not compile the sources with gcc:

compile.sh
../../src/jbossInspector.cc: In function `void notifyEvent(JVMPI_Event*)':
../../src/jbossInspector.cc:1565: error: `JVMPI_REQUESTED_EVENT' undeclared (first use this function)
../../src/jbossInspector.cc:1565: error: (Each undeclared identifier is reported only once for each function it appears in.)
../../src/jbossInspector.cc:1575: error: 'union JVMPI_Event::' has no member named 'method_entry2'
../../src/jbossInspector.cc:1575: error: 'union JVMPI_Event::' has no member named 'method_entry2'
../../src/jbossInspector.cc:1579: error: 'union JVMPI_Event::' has no member named 'method'
../../src/jbossInspector.cc:1583: error: `JVMPI_NORMAL_OBJECT' undeclared (first use this function)
../../src/jbossInspector.cc:1592: error: 'union JVMPI_Event::' has no member named 'obj_free'
../../src/jbossInspector.cc:1611: error: 'union JVMPI_Event::' has no member named 'monitor_wait'
../../src/jbossInspector.cc:1611: error: 'union JVMPI_Event::' has no member named 'monitor_wait'
../../src/jbossInspector.cc:1614: error: 'union JVMPI_Event::' has no member named 'monitor_wait'
../../src/jbossInspector.cc:1614: error: 'union JVMPI_Event::' has no member named 'monitor_wait'
../../src/jbossInspector.cc:1618: error: 'union JVMPI_Event::' has no member named 'monitor'
../../src/jbossInspector.cc:1621: error: 'union JVMPI_Event::' has no member named 'monitor'
../../src/jbossInspector.cc:1624: error: 'union JVMPI_Event::' has no member named 'monitor'
../../src/jbossInspector.cc:1628: error: 'union JVMPI_Event::' has no member named 'raw_monitor'
../../src/jbossInspector.cc:1628: error: 'union JVMPI_Event::' has no member named 'raw_monitor'
../../src/jbossInspector.cc:1631: error: 'union JVMPI_Event::' has no member named 'raw_monitor'
../../src/jbossInspector.cc:1631: error: 'union JVMPI_Event::' has no member named 'raw_monitor'
../../src/jbossInspector.cc:1634: error: 'union JVMPI_Event::' has no member named 'raw_monitor'
../../src/jbossInspector.cc:1634: error: 'union JVMPI_Event::' has no member named 'raw_monitor'

The shipped solaris jbossInspector lib has dependent libs which are not on our system:

ldd: /usr/local/jboss-profiler-1.0.CR4/jvmpi/solaris/libjbossInspector.so: is not executable
libstdc++.so.2.10.0 => (file not found)
libm.so.2 => (file not found)
libc.so.1 => /usr/lib/libc.so.1
libdl.so.1 => /usr/lib/libdl.so.1
/usr/platform/SUNW,Ultra-Enterprise/lib/libc_psr.so.1

The RC3-lib uses other versions of dependent libs:
ldd: /usr/local/jboss-profiler-1.0.RC3/jvmpi/solaris/libjbossInspector.so: is not executable
libstdc++.so.6 => /usr/local/lib/libstdc++.so.6
libm.so.1 => /usr/lib/libm.so.1
libgcc_s.so.1 => /usr/local/lib/libgcc_s.so.1
libc.so.1 => /usr/lib/libc.so.1
libdl.so.1 => /usr/lib/libdl.so.1
/usr/platform/SUNW,Ultra-Enterprise/lib/libc_psr.so.1

Thanks in advance!

[clebert.suconic]

It looks like you don't have JAVA_HOME variable defined.

If this is not the case, it's weird. I just compiled on Linux using GCC.

(I don't have access to GCC/G++ on the solaris box I have access now. I'm just using solaris CC and cc).

Verify you JAVA_HOME variable. It looks like GCC it's not finding $JAVA_HOME/include and $JAVA_HOME/include/solaris as include directories.

This comes from compile.sh:

_INCLUDES="-I$JAVA_HOME/include -I$JAVA_HOME/include/solaris -I../../src/zlib"