Academic
Publications
Using Transient/Persistent Errors to Develop Automated Test Oracles for Event-Driven Software

Using Transient/Persistent Errors to Develop Automated Test Oracles for Event-Driven Software,10.1109/ASE.2004.1342736,Atif M. Memon,Qing Xie

Using Transient/Persistent Errors to Develop Automated Test Oracles for Event-Driven Software   (Citations: 8)
BibTex | RIS | RefWorks Download
Today's software-intensive systems contain an important class of software, namely event-driven software (EDS). All EDS take events as input, change their state, and (perhaps) output an event sequence. EDS is typically implemented as a collection of event-handlers designed to respond to individual events. The nature of EDS creates new challenges for test automation. In this paper, we focus on those relevant to automated test oracles. A test oracle is a mechanism that determines whether a software executed correctly for a test case. A test case for an EDS consists of a sequence of events. The test case is executed on the EDS, one event at a time. Errors in the EDS may "appear" and later ''disappear" at several points (e.g., after an event is executed) during test case execution. Because of the behavior of these transient (those that disappear) and persistent (those that don't disappear) errors, EDS require complex and expensive test oracles that compare the expected and actual output multiple times during test case execution. We leverage our previous work to study several applications and observe the occurrence of persistent/transient errors. Our studies show that in practice, a large number of errors in EDS are transient and that there are specific classes of events that lead to transient errors. We use the results of this study to develop a new test oracle that compares the expected and actual output at strategic points during test case execution. We show that the oracle is effective at detecting errors and efficient in terms of resource utilization
Conference: Automated Software Engineering - ASE , pp. 186-195, 2004
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
    • ...Current model-based GUI testing techniques either test only a subset of event sequences by restricting the sequence to length two or length three [2], [3] or use a random method [4], rather than a systematic one, to test longer sequences [2], meaning that they can only consider a limited context...

    Xun Yuanet al. GUI Interaction Testing: Incorporating Event Context

    • ...Memon and Xie [8] present an automated test oracle for...
    • ...The Memon and Xie [8] approach is mainly applicable to regression testing only, with the assumption that the recorded model is correct, and the model can be fragile with regards to small changes in the SUT behaviour that are irrelevant from the test oracle perspective...

    Teemu Kanstrén. Program Comprehension for User-Assisted Test Oracle Generation

    • ...Other graph-exploration techniques have been used in previous work [30,37]...
    • ...As noted earlier, once a model of a GUI’s event space has been created, there are many ways to traverse it. Earlier work used goal-directed search [11], random walk [37], and bounded breadth-first search [30]...

    Atif M. Memon. An event-flow model of GUI-based applications for testing

    • ...Over the past six years, we have been developing model-based techniques for GUI test-case generation (Memon and Xie, 2005; Memon et al., 2005; Xie and Memon, 2005) and test oracle creation (Memon and Xie, 2004)...

    Atif M. Memon. Employing user profiles to test a new version of a GUI component in it...

    • ...The preliminary work includes the development of a new experimentation platform (consisting of a test case generator, test oracle generator, test executor, coverage evaluator and regression tester), a reduced GUI model [5], new test case generation techniques for evolving GUI software [5, 10], and new test oracles for GUIs [4]...
    • ...The results showed that the new oracle is effective at detecting errors and efficient in resource utilization [4]...

    Qing Xie. Developing cost-effective model-based techniques for GUI testing

Sort by: