-
1. Re: Matrix Tests List - Input requested from Project leads
tom.elrod May 6, 2005 2:10 AM (in response to clebert.suconic)I'm sorry, but I am a little lost. So this is to test all the different client version with all the other server versions?
How do I tell if a 4.0.1 client passed all tests calling against a 4.0.2 server? Any way to make it so there are two axis to the matrix? For example:
client | 4.0.1 server | 4.0.2 server
4.0.1 | 0 failures | 12 failures
4.0.2 | 0 failures | 0 failures -
2. Re: Matrix Tests List - Input requested from Project leads
starksm64 May 6, 2005 2:28 AM (in response to clebert.suconic)This is a test of client oriented tests using different client jars against one version of the server. In this case 4.0.2.
-
3. Re: Matrix Tests List - Input requested from Project leads
tom.elrod May 6, 2005 11:36 AM (in response to clebert.suconic)Guess the issue I am having is how would I be able to determine this from looking at http://cruisecontrol.jboss.com/cc/artifacts/jboss-4.0-testsuite/20050504194421/results/org/jboss/test/compatibility/test/matrix/package-summary.html
? -
4. Re: Matrix Tests List - Input requested from Project leads
starksm64 May 6, 2005 11:44 AM (in response to clebert.suconic)You can't. This should be a frame based report with the index specifying the server version under test. If this stays as a single report there needs to be a header added for each server version under test.
-
5. Re: Matrix Tests List - Input requested from Project leads
clebert.suconic May 9, 2005 10:55 AM (in response to clebert.suconic)In the URL I sent you have for example:
For the BMP tests:
MatrixTestContainer(BMP_v_4_0_2) - This is BMP tests executed using the client library version 4.0.2
MatrixTestContainer(BMP_v_4_0_sp1) - The same tests executes againt 4.0.1_sp1. (I think I need to rename the file.. I missed a 1)
And so on...
Each container will have several other tests:
Like:
org.jboss.test.bmp.test.BmpUnitTestCase::testBMP was contained by the container.
Let me know if you still have an issue.
Clebert Suconic -
6. Re: Matrix Tests List - Input requested from Project leads
clebert.suconic May 9, 2005 10:57 AM (in response to clebert.suconic)How do I tell if a 4.0.1 client passed all tests calling against a 4.0.2 server? Any way to make it so there are two axis to the matrix? For example:
The test is always done against the current version.
If it's needed to test against older versions we will have to test against other branches.
We are using the plain JUnitReport, so we can't change the output format for this, that's I'm using the concept of container and tests.
Clebert