Version 2

    This page provides some examples of requirements from existing distributed testing frameworks.


    Distributed Testing Framework (DTF)


    DTF design goals:

    • provide a system to specify, execute and report on test cases, which addresses the configuration coverage problem (via parallelism, use of a pool of remote test nodes and remote task invovation and product installation)

    • support correctness testing and performance testing of products under test

    • allow specification of (DTF-native) test cases with the following features:

      • test cases may involve ordered execution of multiple tasks (processes)

      • tasks may be started synchronously or asynchronously (then waited-for or terminated)

      • test cases are non-distributed in nature (i.e. test case data is gathered and analysed from a single source in order to determine pass-fail)

    • support the execution of JUnit test cases

    • provide a web-based user interface to the system which permits:

      • creation of test cases and other required test-related artifacts

      • scheduling of test case runs

      • viewing correctness test results

      • viewing performance results

      • deployment of products on test nodes and general management of test nodes

      • archiving of test results

    • provide a distributed architecture, which permits flexibility in system configuration

    • provide an entirely automtated approach to ensuring the coverage of defined configuration matricies for a product, and parameters which can be used to adjust the coverage algorithm