0 Replies Latest reply on Jan 12, 2005 11:59 PM by c.cremers

    Internal testsuite run variability

    c.cremers
    c.cremers Jan 12, 2005 11:59 PM

      I have JBoss 3.2.6 installed, and run it against stock java 1.4.2_03 on a Solaris 9 system. It bothers me that I get inconsistent failures on the runs : Run 1 fails 22 tests, Run 2 fails 55 tests, and Run 3 fails 54 tests. It's not something as easy as time outs, and I bounce the server prior to each run. Any idea what causes the variability ? More importantly, how do I make it go away ?

      Thanks !

      Run 1 :

      [junit] Test org.jboss.test.cache.test.local.ConcurrentUnitTestCase FAILED
      [junit] Test org.jboss.test.classloader.test.ScopingUnitTestCase FAILED
      [junit] Test org.jboss.test.classloader.test.UnifiedLoaderUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.basic.AxisUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.ExternalUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.security.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.StateUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.PooledInvokerUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.SimpleUnitTestCase FAILED
      [junit] Test org.jboss.test.testbeancluster.test.BeanUnitTestCase FAILED
      [junit] Test org.jboss.test.testbeancluster.test.CacheInvalidationUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.ClusteredSingleSignOnUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.FormAuthUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.ssl.SSLUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.security.test.EJBSpecUnitTestCase FAILED (timeout)
      [junit] Test org.jboss.test.jca.test.BaseConnectionManagerStressTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.ExternalUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.security.SecurityUnitTestCase FAILED

      Run 2 :

      [junit] Test org.jboss.test.cache.test.local.ConcurrentUnitTestCase FAILED
      [junit] Test org.jboss.test.cache.test.local.MBeanUnitTestCase FAILED
      [junit] Test org.jboss.test.classloader.test.ScopingUnitTestCase FAILED
      [junit] Test org.jboss.test.classloader.test.UnifiedLoaderUnitTestCase FAILED
      [junit] Test org.jboss.test.cmp2.optimisticlock.test.OptimisticLockUnitTestCase FAILED
      [junit] Test org.jboss.test.cts.test.LongWaitStatefulSessionUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.LargeMessageUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.OILConnectionUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.OILJBossMQUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.RMIConnectionUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.RMIJBossMQUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.basic.AxisUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.HelloUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.ExternalUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.JmxUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.security.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.StateUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.WSRUnitTestCase FAILED
      [junit] Test org.jboss.test.jmx.test.HAInvokerUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.PooledInvokerUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.SimpleUnitTestCase FAILED
      [junit] Test org.jboss.test.testbeancluster.test.BeanUnitTestCase FAILED
      [junit] Test org.jboss.test.testbeancluster.test.CacheInvalidationUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.ClusteredSingleSignOnUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.FormAuthUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.ssl.SSLUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.security.test.EJBSpecUnitTestCase FAILED (timeout)
      [junit] Test org.jboss.test.security.test.SRPLoginModuleUnitTestCase FAILED
      [junit] Test org.jboss.test.security.test.SRPUnitTestCase FAILED
      [junit] Test org.jboss.test.hello.test.HelloClusteredHttpStressTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.perf.RMIInvocationLayerStressTestCase FAILED
      [junit] Test org.jboss.test.jca.test.BaseConnectionManagerStressTestCase FAILED


      [junit] Test org.jboss.test.jbossnet.basic.AxisUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.HelloUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.ExternalUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.JmxUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.security.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.StateUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.WSRUnitTestCase FAILED
      [junit] Test org.jboss.test.bankiiop.test.BankStressTestCase FAILED
      [junit] Test org.jboss.test.excepiiop.test.ExceptionTimingStressTestCase FAILED
      [junit] Test org.jboss.test.helloiiop.test.HelloTimingStressTestCase FAILED
      [junit] Test org.jboss.test.hellojrmpiiop.test.HelloTimingStressTestCase FAILED
      [junit] Test org.jboss.test.iiop.test.ParameterPassingStressTestCase FAILED

      Run 3 :

      [junit] Test org.jboss.test.cache.test.local.ConcurrentUnitTestCase FAILED
      [junit] Test org.jboss.test.cache.test.local.MBeanUnitTestCase FAILED
      [junit] Test org.jboss.test.classloader.test.ScopingUnitTestCase FAILED
      [junit] Test org.jboss.test.classloader.test.UnifiedLoaderUnitTestCase FAILED
      [junit] Test org.jboss.test.cmp2.optimisticlock.test.OptimisticLockUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.LargeMessageUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.OILConnectionUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.OILJBossMQUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.RMIConnectionUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.test.RMIJBossMQUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.basic.AxisUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.HelloUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.ExternalUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.JmxUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.security.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.StateUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.WSRUnitTestCase FAILED
      [junit] Test org.jboss.test.jmx.test.HAInvokerUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.PooledInvokerUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.SimpleUnitTestCase FAILED
      [junit] Test org.jboss.test.testbeancluster.test.BeanUnitTestCase FAILED
      [junit] Test org.jboss.test.testbeancluster.test.CacheInvalidationUnitTestCase FAILED

      [junit] Test org.jboss.test.web.test.ClusteredSingleSignOnUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.FormAuthUnitTestCase FAILED
      [junit] Test org.jboss.test.web.test.ssl.SSLUnitTestCase FAILED
      [junit] Test org.jboss.test.naming.test.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.security.test.EJBSpecUnitTestCase FAILED (timeout)
      [junit] Test org.jboss.test.security.test.SRPLoginModuleUnitTestCase FAILED
      [junit] Test org.jboss.test.security.test.SRPUnitTestCase FAILED
      [junit] Test org.jboss.test.hello.test.HelloClusteredHttpStressTestCase FAILED
      [junit] Test org.jboss.test.jbossmq.perf.RMIInvocationLayerStressTestCase FAILED
      [junit] Test org.jboss.test.jca.test.BaseConnectionManagerStressTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.basic.AxisUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.HelloUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.ejbsimple.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.ExternalUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.external.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.JmxUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.jmx.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.security.SecurityUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.state.StateUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.RedeployUnitTestCase FAILED
      [junit] Test org.jboss.test.jbossnet.wsr.WSRUnitTestCase FAILED
      [junit] Test org.jboss.test.bankiiop.test.BankStressTestCase FAILED
      [junit] Test org.jboss.test.excepiiop.test.ExceptionTimingStressTestCase FAILED
      [junit] Test org.jboss.test.helloiiop.test.HelloTimingStressTestCase FAILED
      [junit] Test org.jboss.test.hellojrmpiiop.test.HelloTimingStressTestCase FAILED
      [junit] Test org.jboss.test.iiop.test.ParameterPassingStressTestCase FAILED

      • 1610 Views
      • Tags: