Reducing the Cost of Model-Based Testing through Test Case Diversity

Abstract : Model-based testing (MBT) suffers from two main problems which in many real world systems make MBT impractical: scalability and automatic oracle generation. When no automated oracle is available, or when testing must be performed on actual hardware or a restricted-access network, for example, only a small set of test cases can be executed and evaluated. However, MBT techniques usually generate large sets of test cases when applied to real systems, regardless of the coverage criteria. Therefore, one needs to select a small enough subset of these test cases that have the highest possible fault revealing power. In this paper, we investigate and compare various techniques for rewarding diversity in the selected test cases as a way to increase the likelihood of fault detection. We use a similarity measure defined on the representation of the test cases and use it in several algorithms that aim at maximizing the diversity of test cases. Using an industrial system with actual faults, we found that rewarding diversity leads to higher fault detection compared to the techniques commonly reported in the literature: coverage-based and random selection. Among the investigated algorithms, diversification using Genetic Algorithms is the most cost-effective technique.
Document type :
Conference papers
Complete list of metadatas

Cited literature [24 references]  Display  Hide  Download

https://hal.inria.fr/hal-01055243
Contributor : Hal Ifip <>
Submitted on : Tuesday, August 12, 2014 - 9:23:30 AM
Last modification on : Wednesday, August 16, 2017 - 3:22:39 PM
Long-term archiving on : Wednesday, November 26, 2014 - 10:35:57 PM

File

64350062.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Hadi Hemmati, Andrea Arcuri, Lionel Briand. Reducing the Cost of Model-Based Testing through Test Case Diversity. 22nd IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS), Nov 2010, Natal, Brazil. pp.63-78, ⟨10.1007/978-3-642-16573-3_6⟩. ⟨hal-01055243⟩

Share

Metrics

Record views

400

Files downloads

374