This page provides some examples of requirements from existing distributed testing frameworks.

Distributed Testing Framework (DTF)

DTF design goals:

• provide a system to specify, execute and report on test cases, which addresses the configuration coverage problem (via parallelism, use of a pool of remote test nodes and remote task invovation and product installation)

• support correctness testing and performance testing of products under test

• allow specification of (DTF-native) test cases with the following features:

• test cases may involve ordered execution of multiple tasks (processes)

• tasks may be started synchronously or asynchronously (then waited-for or terminated)

• test cases are non-distributed in nature (i.e. test case data is gathered and analysed from a single source in order to determine pass-fail)

• support the execution of JUnit test cases

• provide a web-based user interface to the system which permits:

• creation of test cases and other required test-related artifacts

• scheduling of test case runs

• viewing correctness test results

• viewing performance results

• deployment of products on test nodes and general management of test nodes

• archiving of test results

• provide a distributed architecture, which permits flexibility in system configuration

• provide an entirely automtated approach to ensuring the coverage of defined configuration matricies for a product, and parameters which can be used to adjust the coverage algorithm