We are having a problem at times when our JBoss server does not deploy all the beans listed in the jboss-serivce.xml file. For example, following is the log from a server instance that hasn't deployed all the beans:
Jul 11 07:28:55 INFO Deploying wmtp.FXTradeEntry Jul 11 07:28:55 INFO Deployed: file:/home/wmtbuser/wmtp_wmtp-uat/ejbeans/fxtradeentry.jar Jul 11 07:28:55 INFO Deploying wmtp.ContractEntry Jul 11 07:28:55 INFO Deployed: file:/home/wmtbuser/wmtp_wmtp-uat/ejbeans/contractentry.jar 600.3251201.594: [Full GC 74613K->36893K(504128K), 0.7865592 secs] 1802.4242403.499: [Full GC 73622K->35401K(504128K), 0.7818711 secs] 3004.333: [Full GC[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor44] 73151K->35431K(504128K), 0.7786688 secs] 4206.295: [Full GC 98473K->37705K(504128K), 1.1072378 secs] Jul 11 08:26:30 INFO LoginContext created
If you see, from the above log, only 2 beans (out of 4) were deployed and there is no activity for an hour on the server, other than a couple of GCs.
And following is the server log for the same server, once it's restarted:
Jul 11 15:04:08 INFO Deploying wmtp.FXTradeEntry Jul 11 15:04:09 INFO Deployed: file:/home/smrtuser4/wmtp_wmtp-it4/ejbeans/fxtradeentry.jar Jul 11 15:04:09 INFO Deploying wmtp.ContractEntry Jul 11 15:04:09 INFO Deployed: file:/home/smrtuser4/wmtp_wmtp-it4/ejbeans/contractentry.jar Jul 11 15:04:10 INFO Deploying wmtp.IPOTradeEntry Jul 11 15:04:10 INFO Deployed: file:/home/smrtuser4/wmtp_wmtp-it4/ejbeans/ipotradeentry.jar Jul 11 15:04:11 INFO Deploying wmtp.ProductInquiry Jul 11 15:04:11 INFO Deployed: file:/home/smrtuser4/wmtp_wmtp-it4/ejbeans/productinquiry.jar
The above log shows that all the beans were deployed.
This problem hasn't been happening frequently, but this was the second instance in the last 3 weeks. Unfortunately, I didn't have any more details apart from the above logs. The issue is not limited to the deployment of beans, but all the process that needs to happen after the bean deployment comes to a halt (like connection pool creation). For example, I don't see the "Jk running" log statement, that's typical in the server logs once the server is started, in the first logs where as I see the same in the second log.
We are using JBoss 3.2.5 on JDK 1.4.2 on Solaris 2.8
Please let me know incase anyone has ever faced such a problem or have an idea as to what could be the problem, or where can I look at to start with, to figure out what's the problem.