5 Replies Latest reply on Dec 14, 2007 1:05 AM by starksm64

Major regression in EJBSpecUnitTestCase run time

starksm64 Dec 6, 2007 6:44 PM

I'm seeing a 10x increase in the runtime of the org.jboss.test.security.test.EJBSpecUnitTestCase under jbossas5 trunk vs jbossas4.2 trunk.

jbossas5:
[starksm@succubus testsuite]$ run_tests.sh
ant -Dtest=org.jboss.test.security.test.EJBSpecUnitTestCase -Dnojars=t -Djunit.timeout=1800000 -Djbosstest.cluster.node0=192.168.3.130 -Djbosstest.cluster.node1=192.168.3.120 -Djbosstest.threadcount=1 -Djbosstest.iterationcount=50 one-test
...
one-test:
[mkdir] Created dir: /home/svn/JBossHead/jboss-head/testsuite/output/log
[junit] Running org.jboss.test.security.test.EJBSpecUnitTestCase
[junit] Found log4j.xml: file:/home/svn/JBossHead/jboss-head/testsuite/output/resources/log4j.xml
[junit] Tests run: 25, Failures: 0, Errors: 4, Time elapsed: 55.844 sec
[junit] Test org.jboss.test.security.test.EJBSpecUnitTestCase FAILED

jbossas4.2:
[starksm@succubus testsuite]$ run_tests.sh
ant -Dtest=org.jboss.test.security.test.EJBSpecUnitTestCase -Dnojars=t -Djunit.timeout=1800000 -Djbosstest.cluster.node0=192.168.3.130 -Djbosstest.cluster.node1=192.168.3.120 -Djbosstest.threadcount=1 -Djbosstest.iterationcount=50 one-test
Buildfile: build.xml

one-test:
[mkdir] Created dir: /home/svn/JBossAS/JBoss4.2/Branch_4_2/testsuite/output/log
[junit] Running org.jboss.test.security.test.EJBSpecUnitTestCase
[junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 5.13 sec

BUILD SUCCESSFUL
Total time: 7 seconds

The majority of the time is spent in the 2 stress methods testStress, testStressNoJaasCache, which just make jbosstest.iterationcount (min 100) calls to a secure ejb using jbosstest.threadcount threads. Each iteration is just an ejb jaas-login/create/invoke/remove/jaas-logout cycle for a simple stateless ejb, so the delay is either in the security layer, or the remoting transport layer.

1. Re: Major regression in EJBSpecUnitTestCase run time

anil.saldhana Dec 7, 2007 2:04 AM (in response to starksm64)

With my effort to move the configuration/setup of the security managers out of JaasSecurityManagerService, the security managers created may not be set up with a cachepolicy.

I need to check this.
Actions
2. Re: Major regression in EJBSpecUnitTestCase run time

anil.saldhana Dec 8, 2007 11:58 PM (in response to starksm64)

Deployment/Undeployment of the test archive "security-spec.jar" is taking around 20sec.
Actions
3. Re: Major regression in EJBSpecUnitTestCase run time

anil.saldhana Dec 11, 2007 12:00 AM (in response to starksm64)

I profiled JBAS and made some changes to reduce JNDI lookups of the security managers... This probably cut the overall time by some percentage (maybe 40%). I still see that remoting (and Arjuna) taking up cpu cycles during the profile......

Scott, what is the latest execution time for the test case on your box?
Actions
4. Re: Major regression in EJBSpecUnitTestCase run time

starksm64 Dec 11, 2007 12:50 AM (in response to starksm64)

This is on a different box.

with the current 2 threads, 10 iterations:
one-test:
[junit] Tests run: 25, Failures: 0, Errors: 4, Time elapsed: 29.894 sec

Using 1 thread, 50 iters as shown in the other run its:
[junit] Tests run: 25, Failures: 0, Errors: 4, Time elapsed: 41.767 sec

which I would guess would be around 25s on the server box I showed earlier.
I won't be able to check that until Thu as I'm traveling.
Actions
5. Re: Major regression in EJBSpecUnitTestCase run time

starksm64 Dec 14, 2007 1:05 AM (in response to starksm64)

The current server box time is down to 31 secs.

one-test:
[junit] Running org.jboss.test.security.test.EJBSpecUnitTestCase
[junit] Tests run: 25, Failures: 0, Errors: 4, Time elapsed: 31.608 sec
Actions

Go to original post