0 Replies Latest reply on Dec 3, 2002 10:55 AM by crazynala

    JBoss constantly opening 500 files / minute

    crazynala

      When we run our JBoss application we have discovered that the files open on the system rises at a more or less constant rate of about 500/minute until it hits 650,000 and the system refuses to do anything.



      If anyone has experienced this behavior and has some recommended solutions, I could really benefit from some advice.



      The server is running Redhat 8,0, with JDK 1.4.1 and JBoss 3.0.4 / Tomcat 4.1.12.



      The behavior occurs even with virtually no load. Under the lightest possible condition, the application is just checking email via Javamail. It uses Quartz for scheduling. A job is triggered every 5 minutes, and then invokes a mail checking component via JMS.



      I have examined the output of ‘lsof’ and noticed that new processes are constantly re-opening all of the deployed JBoss files. For examples, in my last test JBoss was running on PID 4483. This resulted in a block of files being opened exactly like that in the lsof output I appended below. Then it did the same with PID 4484, 4485, etc. until it reached the appended 4977 after about 30 minutes. Each block appears to be identical except for the PID.



      Any ideas? I gratefully appreciate any assistance with this very confounding problem.



      Dan Norcross

      KES

      Beijing



      ====== excerpt from ‘lsof’ output =====-



      java 4977 root cwd DIR 8,2 4096 426153 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/bin

      java 4977 root rtd DIR 8,2 4096 2 /

      java 4977 root txt REG 8,2 23380 1671707 /usr/local/j2sdk1.4.1_01/bin/java

      java 4977 root mem REG 8,2 87341 409605 /lib/ld-2.2.93.so

      java 4977 root mem REG 8,2 8386 1409355 /usr/local/j2sdk1.4.1_01/jre/lib/ext/dnsns.jar

      java 4977 root mem REG 8,2 12504 1098179 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/struts-validator.jar/3.struts-validator.jar

      java 4977 root mem REG 8,2 3293 1442140 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jpl-pattern.jar/40.jpl-pattern.jar

      java 4977 root mem REG 8,2 85498 524299 /lib/i686/libpthread-0.10.so

      java 4977 root mem REG 8,2 11314 409618 /lib/libdl-2.2.93.so

      java 4977 root mem REG 8,2 8190325 983490 /usr/local/j2sdk1.4.1_01/jre/lib/i386/server/libjvm.so

      java 4977 root mem REG 8,2 90444 409622 /lib/libnsl-2.2.93.so

      java 4977 root mem REG 8,2 170910 524297 /lib/i686/libm-2.2.93.so

      java 4977 root mem REG 8,2 38948 1671686 /usr/local/j2sdk1.4.1_01/jre/lib/i386/native_threads/libhpi.so

      java 4977 root mem REG 8,2 69092 1425921 /usr/local/j2sdk1.4.1_01/jre/lib/i386/libverify.so

      java 4977 root mem REG 8,2 147188 1425922 /usr/local/j2sdk1.4.1_01/jre/lib/i386/libjava.so

      java 4977 root mem REG 8,2 91960 1425924 /usr/local/j2sdk1.4.1_01/jre/lib/i386/libzip.so

      java 4977 root mem REG 8,2 23910233 983513 /usr/local/j2sdk1.4.1_01/jre/lib/rt.jar

      java 4977 root mem REG 8,2 90973 983493 /usr/local/j2sdk1.4.1_01/jre/lib/sunrsasign.jar

      java 4977 root mem REG 8,2 462386 983495 /usr/local/j2sdk1.4.1_01/jre/lib/jsse.jar

      java 4977 root mem REG 8,2 76355 983494 /usr/local/j2sdk1.4.1_01/jre/lib/jce.jar

      java 4977 root mem REG 8,2 42657 409638 /lib/libnss_files-2.2.93.so

      java 4977 root mem REG 8,2 53520 1409357 /usr/local/j2sdk1.4.1_01/jre/lib/ext/ldapsec.jar

      java 4977 root mem REG 8,2 5409 295089 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/mail-plugin.jar/18.mail-plugin.jar

      java 4977 root mem REG 8,2 4064 1605899 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/servlets-common.jar/74.servlets-common.jar

      java 4977 root mem REG 8,2 1395734 524295 /lib/i686/libc-2.2.93.so

      java 4977 root mem REG 8,2 2863339 983511 /usr/local/j2sdk1.4.1_01/jre/lib/charsets.jar

      java 4977 root mem REG 8,2 13174 164387 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jboss-jsr77.jar/6.jboss-jsr77.jar

      java 4977 root mem REG 8,2 1830272 475142 /usr/lib/locale/locale-archive

      java 4977 root mem REG 8,2 117054 1409354 /usr/local/j2sdk1.4.1_01/jre/lib/ext/sunjce_provider.jar

      java 4977 root mem REG 8,2 650624 1409356 /usr/local/j2sdk1.4.1_01/jre/lib/ext/localedata.jar

      java 4977 root mem REG 8,2 27667 426156 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/bin/run.jar

      java 4977 root mem REG 8,2 4926903 1475043 /usr/local/j2sdk1.4.1_01/lib/tools.jar

      java 4977 root mem REG 8,2 196399 1786282 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/crimson.jar

      java 4977 root mem REG 8,2 33323 1786285 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/jaxp.jar

      java 4977 root mem REG 8,2 380654 1786288 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/jboss-jmx.jar

      java 4977 root mem REG 8,2 30163 1786284 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/gnu-regexp.jar

      java 4977 root mem REG 8,2 149233 1786281 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/concurrent.jar

      java 4977 root mem REG 8,2 118410 1786290 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/log4j-boot.jar

      java 4977 root mem REG 8,2 227835 1786287 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/jboss-common.jar

      java 4977 root mem REG 8,2 134533 1786289 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/lib/jboss-system.jar

      java 4977 root mem REG 8,2 68532 1425927 /usr/local/j2sdk1.4.1_01/jre/lib/i386/libnet.so

      java 4977 root mem REG 8,2 1170230 115037 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jboss.jar/2.jboss.jar

      java 4977 root mem REG 8,2 81790 1098180 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-dbcp.jar/4.commons-dbcp.jar

      java 4977 root mem REG 8,2 28970 1901045 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-pool.jar/5.commons-pool.jar

      java 4977 root mem REG 8,2 493322 1458719 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/mandarax-1.9.1.jar/7.mandarax-1.9.1.jar

      java 4977 root mem REG 8,2 69907 1098181 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jboss-j2ee.jar/8.jboss-j2ee.jar

      java 4977 root mem REG 8,2 45386 803233 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/activation.jar/9.activation.jar

      java 4977 root mem REG 8,2 30087 1818900 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jnpserver.jar/10.jnpserver.jar

      java 4977 root mem REG 8,2 146297 1901046 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jts.jar/11.jts.jar

      java 4977 root mem REG 8,2 435308 1458720 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jbossmq.jar/12.jbossmq.jar

      java 4977 root mem REG 8,2 16756 377413 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jpl-util.jar/13.jpl-util.jar

      java 4977 root mem REG 8,2 477780 541320 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/struts.jar/14.struts.jar

      java 4977 root mem REG 8,2 65368 1442311 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jakarta-oro.jar/15.jakarta-oro.jar

      java 4977 root mem REG 8,2 65368 1442138 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jakarta-oro.jar/16.jakarta-oro.jar

      java 4977 root mem REG 8,2 150459 164390 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/quartz.jar/17.quartz.jar

      java 4977 root mem REG 8,2 25463 1442139 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jbossmx.jar/19.jbossmx.jar

      java 4977 root mem REG 8,2 114798 1884760 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/mm.mysql-2.0.7-bin.jar/20.mm.mysql-2.0.7-bin.jar

      java 4977 root mem REG 8,2 14185 1049192 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-fileupload.jar/21.commons-fileupload.jar

      java 4977 root mem REG 8,2 100076 1344052 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-digester.jar/22.commons-digester.jar

      java 4977 root mem REG 8,2 882739 1884761 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/xalan.jar/23.xalan.jar

      java 4977 root mem REG 8,2 511935 1392968 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jsse.jar/24.jsse.jar

      java 4977 root mem REG 8,2 176478 295090 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jbosssx.jar/25.jbosssx.jar

      java 4977 root mem REG 8,2 90339 377414 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jboss-management.jar/26.jboss-management.jar

      java 4977 root mem REG 8,2 136498 1049194 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/lucene-1.2.jar/27.lucene-1.2.jar

      java 4977 root mem REG 8,2 5828 1818901 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jnet.jar/28.jnet.jar

      java 4977 root mem REG 8,2 74473 1704550 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/javax.servlet.jar/29.javax.servlet.jar

      java 4977 root mem REG 8,2 28517 573847 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-resources.jar/30.commons-resources.jar

      java 4977 root mem REG 8,2 162019 1458747 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/lucene-20021201.jar/31.lucene-20021201.jar

      java 4977 root mem REG 8,2 87673 1818902 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jboss-jca.jar/32.jboss-jca.jar

      java 4977 root mem REG 8,2 222685 803234 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/log4j.jar/33.log4j.jar

      java 4977 root mem REG 8,2 305434 573848 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/mail.jar/34.mail.jar

      java 4977 root mem REG 8,2 130686 1688056 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jbossha.jar/35.jbossha.jar

      java 4977 root mem REG 8,2 81378 1540333 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-lang.jar/36.commons-lang.jar

      java 4977 root mem REG 8,2 8456 1098182 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/properties-plugin.jar/37.properties-plugin.jar

      java 4977 root mem REG 8,2 187812 377416 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-collections.jar/38.commons-collections.jar

      java 4977 root mem REG 8,2 44514 1311170 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-validator.jar/39.commons-validator.jar

      java 4977 root mem REG 8,2 11318 1540334 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jcert.jar/41.jcert.jar

      java 4977 root mem REG 8,2 342565 1098183 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/bcel.jar/42.bcel.jar

      java 4977 root mem REG 8,2 110392 1605897 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-beanutils.jar/43.commons-beanutils.jar

      java 4977 root mem REG 8,2 111132 1344053 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/jaas.jar/44.jaas.jar

      java 4977 root mem REG 8,2 22133 1704554 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-services.jar/45.commons-services.jar

      java 4977 root mem REG 8,2 26462 1901072 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/lib/commons-logging.jar/46.commons-logging.jar

      java 4977 root mem REG 8,2 3832 1425938 /usr/local/j2sdk1.4.1_01/jre/lib/i386/librmi.so

      java 4977 root mem REG 8,2 69308 1311178 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/jasper-runtime.jar/57.jasper-runtime.jar

      java 4977 root mem REG 8,2 90503 1442143 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/commons-collections.jar/58.commons-collections.jar

      java 4977 root mem REG 8,2 15758 1818903 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/servlets-manager.jar/59.servlets-manager.jar

      java 4977 root mem REG 8,2 150365 1901074 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/tomcat-util.jar/60.tomcat-util.jar

      java 4977 root mem REG 8,2 24855 16971 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/commons-logging.jar/61.commons-logging.jar

      java 4977 root mem REG 8,2 24855 16973 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/commons-logging.jar/62.commons-logging.jar

      java 4977 root mem REG 8,2 55944 377447 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/tomcat-coyote.jar/63.tomcat-coyote.jar

      java 4977 root mem REG 8,2 24589 1605898 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/bin/bootstrap.jar/64.bootstrap.jar

      java 4977 root mem REG 8,2 9034 1704563 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/bin/commons-daemon.jar/65.commons-daemon.jar

      java 4977 root mem REG 8,2 9034 1704564 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/bin/commons-daemon.jar/66.commons-daemon.jar

      java 4977 root mem REG 8,2 5972 590439 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/servlets-invoker.jar/68.servlets-invoker.jar

      java 4977 root mem REG 8,2 10762 1688057 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/bin/tomcat-jni.jar/77.tomcat-jni.jar

      java 4977 root mem REG 8,2 16812 1311174 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jmx-ejb-connector-server.sar/47.jmx-ejb-connector-server.sar

      java 4977 root mem REG 8,2 44301 1016094 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/ruleengine-mbean.sar/48.ruleengine-mbean.sar

      java 4977 root mem REG 8,2 23849 1442141 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/scheduler-mbean.sar/49.scheduler-mbean.sar

      java 4977 root mem REG 8,2 24657 1442142 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/searchengine-mbean.sar/50.searchengine-mbean.sar

      java 4977 root mem REG 8,2 53122 1540338 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/mailhandler-ejb-client.jar/103.mailhandler-ejb-client.jar

      java 4977 root mem REG 8,2 66606 1557017 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/mailhandler-ejb.jar/104.mailhandler-ejb.jar

      java 4977 root mem REG 8,2 8376 1409487 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/rule-ejb-client.jar/105.rule-ejb-client.jar

      java 4977 root mem REG 8,2 10807 1753584 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/rule-ejb.jar/106.rule-ejb.jar

      java 4977 root mem REG 8,2 7116 426207 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/scheduler-cmp-ejb-client.jar/107.scheduler-cmp-ejb-client.jar

      java 4977 root mem REG 8,2 11865 1540340 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/scheduler-cmp-ejb.jar/108.scheduler-cmp-ejb.jar

      java 4977 root mem REG 8,2 15960 1425937 /usr/local/j2sdk1.4.1_01/jre/lib/i386/libioser12.so

      java 4977 root mem REG 8,2 6773 131599 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/uidgenerator-ejb-client.jar/109.uidgenerator-ejb-client.jar

      java 4977 root mem REG 8,2 13584 426208 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/uidgenerator-ejb.jar/110.uidgenerator-ejb.jar

      java 4977 root mem REG 8,2 52681 1491427 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/tomcat-4.1.x/work/MainEngine/localhost/ces/WEB-INF/lib/display.jar

      java 4977 root mem REG 8,2 11930 1491428 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/tomcat-4.1.x/work/MainEngine/localhost/ces/WEB-INF/lib/pager-taglib.jar

      java 4977 root mem REG 8,2 53940 1507909 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/tomcat-4.1.x/work/MainEngine/localhost/dashboard/WEB-INF/lib/display.jar

      java 4977 root mem REG 8,2 11930 1507949 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/tomcat-4.1.x/work/MainEngine/localhost/support/WEB-INF/lib/pager-taglib.jar

      java 4977 root mem REG 8,2 11391 1409484 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jmx-ejb-adaptor.jar/102.jmx-ejb-adaptor.jar

      java 4977 root mem REG 8,2 52681 1507948 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/tomcat-4.1.x/work/MainEngine/localhost/support/WEB-INF/lib/display.jar

      java 4977 root mem REG 8,2 28664 131593 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/naming-common.jar/67.naming-common.jar

      java 4977 root mem REG 8,2 81184 426187 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/commons-beanutils.jar/69.commons-beanutils.jar

      java 4977 root mem REG 8,2 34184 590444 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/tomcat-http11.jar/70.tomcat-http11.jar

      java 4977 root mem REG 8,2 19358 1818904 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/servlets-default.jar/71.servlets-default.jar

      java 4977 root mem REG 8,2 22164 901391 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/servlets-webdav.jar/72.servlets-webdav.jar

      java 4977 root mem REG 8,2 65619 1704565 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/tomcat-jk.jar/73.tomcat-jk.jar

      java 4977 root mem REG 8,2 80063 131595 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/tomcat-jk2.jar/75.tomcat-jk2.jar

      java 4977 root mem REG 8,2 32290 1605900 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/commons-modeler.jar/76.commons-modeler.jar

      java 4977 root mem REG 8,2 23367 1818905 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/tomcat-warp.jar/78.tomcat-warp.jar

      java 4977 root mem REG 8,2 93881 901392 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/commons-digester.jar/79.commons-digester.jar

      java 4977 root mem REG 8,2 29871 1753570 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/jakarta-regexp-1.2.jar/81.jakarta-regexp-1.2.jar

      java 4977 root mem REG 8,2 18222 1818906 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/naming-factory.jar/86.naming-factory.jar

      java 4977 root mem REG 8,2 16910 1016095 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/commons-logging-api.jar/88.commons-logging-api.jar

      java 4977 root mem REG 8,2 716139 295091 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/ant.jar/80.ant.jar

      java 4977 root mem REG 8,2 49498 590451 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/tomcat41-service.jar/82.tomcat41-service.jar

      java 4977 root mem REG 8,2 182290 1688058 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/jasper-compiler.jar/83.jasper-compiler.jar

      java 4977 root mem REG 8,2 282549 16974 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/mx4j-jmx.jar/84.mx4j-jmx.jar

      java 4977 root mem REG 8,2 80054 377449 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/servlet.jar/85.servlet.jar

      java 4977 root mem REG 8,2 37601 1311180 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/common/lib/naming-resources.jar/87.naming-resources.jar

      java 4977 root mem REG 8,2 715682 1605901 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/catalina.jar/89.catalina.jar

      java 4977 root mem REG 8,2 14979 1557013 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/tomcat-4.1.x/server/lib/catalina-ant.jar/90.catalina-ant.jar

      java 4977 root mem REG 8,2 21785 1753578 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jboss-local-jdbc.rar/92.jboss-local-jdbc.rar

      java 4977 root mem REG 8,2 22524 115039 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jboss-local-jdbc.rar/92.jboss-local-jdbc.rar-contents/local-ra-jdbc-libs.jar

      java 4977 root mem REG 8,2 13755 1016129 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jboss-xa.rar/93.jboss-xa.rar

      java 4977 root mem REG 8,2 12914 115041 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jboss-xa.rar/93.jboss-xa.rar-contents/ra-xa-libs.jar

      java 4977 root mem REG 8,2 24216 459402 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jms-ra.rar/94.jms-ra.rar

      java 4977 root mem REG 8,2 25617 541322 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/jms-ra.rar/94.jms-ra.rar-contents/jms-ra.jar

      java 4977 root mem REG 8,2 161161 590453 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/casehandler-ejb-client.jar/95.casehandler-ejb-client.jar

      java 4977 root mem REG 8,2 182175 1311181 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/casehandler-ejb.jar/96.casehandler-ejb.jar

      java 4977 root mem REG 8,2 73044 246251 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/cmp-ejb-client.jar/97.cmp-ejb-client.jar

      java 4977 root mem REG 8,2 117463 1262137 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/cmp-ejb.jar/98.cmp-ejb.jar

      java 4977 root mem REG 8,2 27646 1704566 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/ejb-management.jar/99.ejb-management.jar

      java 4977 root mem REG 8,2 215764 1917584 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/support.war/113.support.war

      java 4977 root mem REG 8,2 269680 164391 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/facade-ejb-client.jar/100.facade-ejb-client.jar

      java 4977 root mem REG 8,2 271190 1049198 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/facade-ejb.jar/101.facade-ejb.jar

      java 4977 root mem REG 8,2 220683 1540342 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/ces.war/111.ces.war

      java 4977 root mem REG 8,2 719386 1409490 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/tmp/deploy/server/default/deploy/dashboard.war/112.dashboard.war

      java 4977 root 0r CHR 1,3 67152 /dev/null

      java 4977 root 1w FIFO 0,5 9539901 pipe

      java 4977 root 2w FIFO 0,5 9539902 pipe

      java 4977 root 3r FIFO 0,5 9539937 pipe

      java 4977 root 4w FIFO 0,5 9539937 pipe

      java 4977 root 5w REG 8,2 128742 1442325 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/log/server.log

      java 4977 root 6u IPv4 9540214 TCP *:8083 (LISTEN)

      java 4977 root 7u sock 0,0 9540212 can't identify protocol

      java 4977 root 9u IPv4 9540221 TCP *:34496 (LISTEN)

      java 4977 root 10u IPv4 9540223 TCP *:1099 (LISTEN)

      java 4977 root 11u IPv4 9540229 TCP *:34497 (LISTEN)

      java 4977 root 12u IPv4 9540235 TCP *:krb524 (LISTEN)

      java 4977 root 13u IPv4 9540243 TCP *:34498 (LISTEN)

      java 4977 root 14u IPv4 9540473 TCP *:8090 (LISTEN)

      java 4977 root 17u IPv4 9540479 TCP *:8091 (LISTEN)

      java 4977 root 18w REG 8,2 4693 1442137 /usr/local/jboss/jboss-3.0.4_tomcat-4.1.12/server/default/log/localhost_access2002-12-03.log

      java 4977 root 19u IPv4 9540975 TCP *:webcache (LISTEN)

      java 4977 root 21u IPv4 9541118 TCP localhost.localdomain:34505->localhost.localdomain:mysql (ESTABLISHED)

      java 4977 root 22u IPv4 9552828 TCP dedicated50.eapps.com:34528->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 23u IPv4 9552829 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34528 (ESTABLISHED)

      java 4977 root 24u IPv4 9541463 TCP dedicated50.eapps.com:34510->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 25u IPv4 9541464 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34510 (ESTABLISHED)

      java 4977 root 26u IPv4 9552732 TCP dedicated50.eapps.com:34522->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 27u IPv4 9541471 TCP dedicated50.eapps.com:34512->dedicated50.eapps.com:34511 (ESTABLISHED)

      java 4977 root 28u IPv4 9541472 TCP dedicated50.eapps.com:34511->dedicated50.eapps.com:34512 (ESTABLISHED)

      java 4977 root 29u IPv4 9552733 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34522 (ESTABLISHED)

      java 4977 root 30u IPv4 9552923 TCP dedicated50.eapps.com:34534->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 31u IPv4 9552738 TCP dedicated50.eapps.com:34524->dedicated50.eapps.com:34523 (ESTABLISHED)

      java 4977 root 32u IPv4 9552739 TCP dedicated50.eapps.com:34523->dedicated50.eapps.com:34524 (ESTABLISHED)

      java 4977 root 33u IPv4 9552839 TCP dedicated50.eapps.com:34530->dedicated50.eapps.com:34529 (ESTABLISHED)

      java 4977 root 34u IPv4 9552840 TCP dedicated50.eapps.com:34529->dedicated50.eapps.com:34530 (ESTABLISHED)

      java 4977 root 35u IPv4 9552924 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34534 (ESTABLISHED)

      java 4977 root 36u IPv4 9553040 TCP dedicated50.eapps.com:34540->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 37u IPv4 9552936 TCP dedicated50.eapps.com:34536->dedicated50.eapps.com:34535 (ESTABLISHED)

      java 4977 root 38u IPv4 9552937 TCP dedicated50.eapps.com:34535->dedicated50.eapps.com:34536 (ESTABLISHED)

      java 4977 root 39u IPv4 9553043 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34540 (ESTABLISHED)

      java 4977 root 40u IPv4 9567508 TCP dedicated50.eapps.com:34553->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 41u IPv4 9553094 TCP dedicated50.eapps.com:34542->dedicated50.eapps.com:34541 (ESTABLISHED)

      java 4977 root 42u IPv4 9553095 TCP dedicated50.eapps.com:34541->dedicated50.eapps.com:34542 (ESTABLISHED)

      java 4977 root 43u IPv4 9567511 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34553 (ESTABLISHED)

      java 4977 root 44u IPv4 9553142 TCP dedicated50.eapps.com:34547->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 45u IPv4 9553145 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34547 (ESTABLISHED)

      java 4977 root 46u IPv4 9567607 TCP dedicated50.eapps.com:34559->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 47u IPv4 9553158 TCP dedicated50.eapps.com:34549->dedicated50.eapps.com:34548 (ESTABLISHED)

      java 4977 root 48u IPv4 9553159 TCP dedicated50.eapps.com:34548->dedicated50.eapps.com:34549 (ESTABLISHED)

      java 4977 root 49u IPv4 9567525 TCP dedicated50.eapps.com:34555->dedicated50.eapps.com:34554 (ESTABLISHED)

      java 4977 root 50u IPv4 9567526 TCP dedicated50.eapps.com:34554->dedicated50.eapps.com:34555 (ESTABLISHED)

      java 4977 root 51u IPv4 9567608 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34559 (ESTABLISHED)

      java 4977 root 52u IPv4 9567699 TCP dedicated50.eapps.com:34565->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 53u IPv4 9567613 TCP dedicated50.eapps.com:34561->dedicated50.eapps.com:34560 (ESTABLISHED)

      java 4977 root 54u IPv4 9567614 TCP dedicated50.eapps.com:34560->dedicated50.eapps.com:34561 (ESTABLISHED)

      java 4977 root 55u IPv4 9567702 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34565 (ESTABLISHED)

      java 4977 root 56u IPv4 9567801 TCP dedicated50.eapps.com:34571->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 57u IPv4 9567712 TCP dedicated50.eapps.com:34567->dedicated50.eapps.com:34566 (ESTABLISHED)

      java 4977 root 58u IPv4 9567736 TCP dedicated50.eapps.com:34566->dedicated50.eapps.com:34567 (ESTABLISHED)

      java 4977 root 59u IPv4 9567802 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34571 (ESTABLISHED)

      java 4977 root 60u IPv4 9567900 TCP dedicated50.eapps.com:34577->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 61u IPv4 9567807 TCP dedicated50.eapps.com:34573->dedicated50.eapps.com:34572 (ESTABLISHED)

      java 4977 root 62u IPv4 9567808 TCP dedicated50.eapps.com:34572->dedicated50.eapps.com:34573 (ESTABLISHED)

      java 4977 root 63u IPv4 9567901 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34577 (ESTABLISHED)

      java 4977 root 64u IPv4 9589926 TCP dedicated50.eapps.com:34583->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 65u IPv4 9567906 TCP dedicated50.eapps.com:34579->dedicated50.eapps.com:34578 (ESTABLISHED)

      java 4977 root 66u IPv4 9567907 TCP dedicated50.eapps.com:34578->dedicated50.eapps.com:34579 (ESTABLISHED)

      java 4977 root 67u IPv4 9589927 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34583 (ESTABLISHED)

      java 4977 root 68u IPv4 9590020 TCP dedicated50.eapps.com:34589->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 69u IPv4 9589932 TCP dedicated50.eapps.com:34585->dedicated50.eapps.com:34584 (ESTABLISHED)

      java 4977 root 70u IPv4 9589933 TCP dedicated50.eapps.com:34584->dedicated50.eapps.com:34585 (ESTABLISHED)

      java 4977 root 71u IPv4 9590021 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34589 (ESTABLISHED)

      java 4977 root 72u IPv4 9590211 TCP dedicated50.eapps.com:34602->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 73u IPv4 9590026 TCP dedicated50.eapps.com:34591->dedicated50.eapps.com:34590 (ESTABLISHED)

      java 4977 root 74u IPv4 9590027 TCP dedicated50.eapps.com:34590->dedicated50.eapps.com:34591 (ESTABLISHED)

      java 4977 root 75u IPv4 9590212 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34602 (ESTABLISHED)

      java 4977 root 76u IPv4 9590121 TCP dedicated50.eapps.com:34596->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 77u IPv4 9590122 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34596 (ESTABLISHED)

      java 4977 root 78u IPv4 9598286 TCP dedicated50.eapps.com:34608->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 79u IPv4 9590134 TCP dedicated50.eapps.com:34598->dedicated50.eapps.com:34597 (ESTABLISHED)

      java 4977 root 80u IPv4 9590135 TCP dedicated50.eapps.com:34597->dedicated50.eapps.com:34598 (ESTABLISHED)

      java 4977 root 81u IPv4 9590222 TCP dedicated50.eapps.com:34604->dedicated50.eapps.com:34603 (ESTABLISHED)

      java 4977 root 82u IPv4 9598289 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34608 (ESTABLISHED)

      java 4977 root 83u IPv4 9590246 TCP dedicated50.eapps.com:34603->dedicated50.eapps.com:34604 (ESTABLISHED)

      java 4977 root 84u IPv4 9626006 TCP dedicated50.eapps.com:34614->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 85u IPv4 9598299 TCP dedicated50.eapps.com:34610->dedicated50.eapps.com:34609 (ESTABLISHED)

      java 4977 root 86u IPv4 9598323 TCP dedicated50.eapps.com:34609->dedicated50.eapps.com:34610 (ESTABLISHED)

      java 4977 root 87u IPv4 9626007 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34614 (ESTABLISHED)

      java 4977 root 88u IPv4 9626099 TCP dedicated50.eapps.com:34620->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 89u IPv4 9626012 TCP dedicated50.eapps.com:34616->dedicated50.eapps.com:34615 (ESTABLISHED)

      java 4977 root 90u IPv4 9626013 TCP dedicated50.eapps.com:34615->dedicated50.eapps.com:34616 (ESTABLISHED)

      java 4977 root 91u IPv4 9626102 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34620 (ESTABLISHED)

      java 4977 root 92u IPv4 9626195 TCP dedicated50.eapps.com:34626->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 93u IPv4 9626112 TCP dedicated50.eapps.com:34622->dedicated50.eapps.com:34621 (ESTABLISHED)

      java 4977 root 94u IPv4 9626138 TCP dedicated50.eapps.com:34621->dedicated50.eapps.com:34622 (ESTABLISHED)

      java 4977 root 95u IPv4 9626196 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34626 (ESTABLISHED)

      java 4977 root 96u IPv4 9626289 TCP dedicated50.eapps.com:34632->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 97u IPv4 9626201 TCP dedicated50.eapps.com:34628->dedicated50.eapps.com:34627 (ESTABLISHED)

      java 4977 root 98u IPv4 9626202 TCP dedicated50.eapps.com:34627->dedicated50.eapps.com:34628 (ESTABLISHED)

      java 4977 root 99u IPv4 9626290 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34632 (ESTABLISHED)

      java 4977 root 100u IPv4 9626384 TCP dedicated50.eapps.com:34638->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 101u IPv4 9626295 TCP dedicated50.eapps.com:34634->dedicated50.eapps.com:34633 (ESTABLISHED)

      java 4977 root 102u IPv4 9626296 TCP dedicated50.eapps.com:34633->dedicated50.eapps.com:34634 (ESTABLISHED)

      java 4977 root 103u IPv4 9626385 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34638 (ESTABLISHED)

      java 4977 root 104u IPv4 9662539 TCP dedicated50.eapps.com:34644->dedicated50.eapps.com:8090 (ESTABLISHED)

      java 4977 root 105u IPv4 9626390 TCP dedicated50.eapps.com:34640->dedicated50.eapps.com:34639 (ESTABLISHED)

      java 4977 root 106u IPv4 9626391 TCP dedicated50.eapps.com:34639->dedicated50.eapps.com:34640 (ESTABLISHED)

      java 4977 root 107u IPv4 9662540 TCP dedicated50.eapps.com:8090->dedicated50.eapps.com:34644 (ESTABLISHED)

      java 4977 root 109u IPv4 9662545 TCP dedicated50.eapps.com:34646->dedicated50.eapps.com:34645 (ESTABLISHED)

      java 4977 root 110u IPv4 9662546 TCP dedicated50.eapps.com:34645->dedicated50.eapps.com:34646 (ESTABLISHED)