Error Detection Rate of MC/DC for a Case Study from the Automotive Domain

Abstract : Chilenski and Miller [1] claim that the error detection probability of a test set with full modified condition/decision coverage (MC/DC) on the system under test converges to 100% for an increasing number of test cases, but there are also examples where the error detection probability of an MC/DC adequate test set is indeed zero. In this work we analyze the effective error detection rate of a test set that achieves maximum possible MC/DC on the code for a case study from the automotive domain. First we generate the test cases automatically with a model checker. Then we mutate the original program to generate three different error scenarios: the first error scenario focuses on errors in the value domain, the second error scenario focuses on errors in the domain of the variable names and the third error scenario focuses on errors within the operators of the boolean expressions in the decisions of the case study. Applying the test set to these mutated program versions shows that all errors of the values are detected, but the error detection rate for mutated variable names or mutated operators is quite disappointing (for our case study 22% of the mutated variable names, resp. 8% of the mutated operators are not detected by the original MC/DC test set). With this work we show that testing a system with a test set that achieves maximum possible MC/DC on the code detects less errors than expected.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [14 references]  Display  Hide  Download

https://hal.inria.fr/hal-01055391
Contributor : Hal Ifip <>
Submitted on : Tuesday, August 12, 2014 - 4:10:22 PM
Last modification on : Friday, December 1, 2017 - 1:09:49 AM
Document(s) archivé(s) le : Wednesday, November 26, 2014 - 11:10:42 PM

File

submit.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Susanne Kandl, Raimund Kirner. Error Detection Rate of MC/DC for a Case Study from the Automotive Domain. 8th IFIP WG 10.2 International Workshop on Software Technologies for Embedded and Ubiquitous Systems (SEUS), Oct 2010, Waidhofen/Ybbs, Austria. pp.131-142, ⟨10.1007/978-3-642-16256-5_14⟩. ⟨hal-01055391⟩

Share

Metrics

Record views

221

Files downloads

217