Version 8

    Unit tests

     

    • All inputs and outputs to the component should be tested.

     

    • During the test, the component should not use any third party components - e.g. database, jgroups or MINA directly. It should work only with mock or fake implementations of other components. Working with mocks or fakes allows the tests to run extremely quickly, which is crucial for quick refactoring, and a test-driven development approach. No component is allowed to be committed without full unit tests involving mocks or fakes where appropriate. Any dependencies with third party components, should be abstracted out to a very thin integration layer. Our core components should only deal with the abstracted out interfaces, never with the real component interfaces, this allows to us to create mock/fake implementations easily.

     

    • Any Thread.sleep(...) calls are banned in unit tests. Again this is crucial to ensure speedy execution of tests. If you need to wait for an action to occur asynchronously you should use a latch or Object.wait/notify or better still refactor the component to be able to test the same code without having to wait for an asynchronous action.

     

    • Timing sensitive tests. Some times it is not possible to avoid unit tests that need to sleep for a condition. E.g. a scheduled delivery test where i send a message for delivery in 5 seconds time - in this case the test would need to sleep for 5 seconds. There should only be a very small number of tests that do this. These tests should exist in a separate directory for timing sensitive tests.

     

    Concurrency tests

     

    These are similar to unit tests, in that they test a particular component with no third party dependencies. But they test the component with many threads concurrently. These kinds of tests may take longer to run than normal unit tests, so should exist in a separate directory for concurrent tests.

     

    Integration tests

     

    We will provide a smaller number of tests which test the system with the real third party components, e.g. real BDB, real MINA. We do not need so many tests in the integration test suite. What is more important is wide coverage but not to so much depth as unit tests.

     

    Most of the current JMS tests are in fact unit tests.

     

    Compliance tests

     

    TCK - this is run by QA

     

    JORAM

     

    Stress tests

     

    Soak tests

     

     

    Tests package layout

     

    We will adopt the following package layout scheme in JBM 2.0:

     

    Unit tests, concurrent tests and timing tests will exist in the same package hierarchy as the code.

     

    E.g.

     

    • org.jboss.messaging.core.impl.test.unit - contains unit tests for classes in org.jboss.messaging.core.impl

    • org.jboss.messaging.core.impl.bdbje.test.unit - contains unit tests for classes in org.jboss.messaging.core.impl.bdbje

    • org.jboss.messaging.core.impl.test.unit.fakes - contains fakes for any classes in org.jboss.messaging.core.impl

    • org.jboss.messaging.core.impl.test.timing - contains any timing sensitive tests for any classes in org.jboss.messaging.core.impl

    • org.jboss.messaging.core.impl.test.concurrent - contains any concurrent tests for any classes in org.jboss.messaging.core.impl