University of Twente Student Theses

Login

Improving diagnosis by Grouping Test Cases to Reduce Complexity

Willemsen, M.J. (2018) Improving diagnosis by Grouping Test Cases to Reduce Complexity.

[img] PDF
1MB
Abstract:The problem with model based testing is that diagnosing the results is hard. The diagnosis is a reoccurring step in the testing process. This is why the diagnosis should be simplified. If many test cases fail, diagnosing these failures becomes a challenge. Due to the number of the test cases and the number of steps in each test case, the failures become hard to comprehend. It can be unclear why tests fail, and which tests fail because of the same fault in the code. To solve the problem of size and incomprehensiveness two major solutions have been identified. The two solutions are complementary. The first solution is grouping test cases with a similar fault. The second solution is to use root cause analysis or fault localisation to identify the step in the test case that produces the fault. By grouping test cases, all test cases that have the same underlying problem, the same faulty line of code in the system under test, can be merged into a single group. This reduces the number of test cases to be analysed by hand. Root cause analysis helps in the analysis of a single test case. Root cause analysis tries to identify the step in a test case that causes the failure. Without this fault causing step, the test case will pass. The diagnosis is simplified since finding the faulty step helps in translating the failure into code and helps in reproducing the failure.
Item Type:Essay (Master)
Clients:
Axini B.V., Amsterdam
Faculty:EEMCS: Electrical Engineering, Mathematics and Computer Science
Subject:54 computer science
Programme:Computer Science MSc (60300)
Link to this item:https://purl.utwente.nl/essays/75676
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page