Formal Test Automation: A Simple Experiment

In this paper1 we study the automation of test derivation and execution in the area of conformance testing. The test scenarios are derived from multiple specication languages: LOTOS, Promela and SDL. A central theme of this study is the usability of batch-oriented and on-the-fly testing approaches. To facilitate the derivation from multiple formal description techniques and the dierent test execution approaches, an open, generic environment called TorX is introduced. TorX enables plugging in existing or dedicated tools. We have carried out several experiments in testing a conference protocol, resulting in requirements on automated testing and benchmarking criteria