Error Detection Rate of MC/DC for a Case Study from the Automotive Domain

Abstract : Chilenski and Miller [1] claim that the error detection probability of a test set with full modified condition/decision coverage (MC/DC) on the system under test converges to 100% for an increasing number of test cases, but there are also examples where the error detection probability of an MC/DC adequate test set is indeed zero. In this work we analyze the effective error detection rate of a test set that achieves maximum possible MC/DC on the code for a case study from the automotive domain. First we generate the test cases automatically with a model checker. Then we mutate the original program to generate three different error scenarios: the first error scenario focuses on errors in the value domain, the second error scenario focuses on errors in the domain of the variable names and the third error scenario focuses on errors within the operators of the boolean expressions in the decisions of the case study. Applying the test set to these mutated program versions shows that all errors of the values are detected, but the error detection rate for mutated variable names or mutated operators is quite disappointing (for our case study 22% of the mutated variable names, resp. 8% of the mutated operators are not detected by the original MC/DC test set). With this work we show that testing a system with a test set that achieves maximum possible MC/DC on the code detects less errors than expected.
Type de document :
Communication dans un congrès
Sang Lyul Min; Robert Pettit; Peter Puschner; Theo Ungerer. 8th IFIP WG 10.2 International Workshop on Software Technologies for Embedded and Ubiquitous Systems (SEUS), Oct 2010, Waidhofen/Ybbs, Austria. Springer, Lecture Notes in Computer Science, LNCS-6399, pp.131-142, 2010, Software Technologies for Embedded and Ubiquitous Systems. 〈10.1007/978-3-642-16256-5_14〉
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01055391
Contributeur : Hal Ifip <>
Soumis le : mardi 12 août 2014 - 16:10:22
Dernière modification le : vendredi 1 décembre 2017 - 01:09:49
Document(s) archivé(s) le : mercredi 26 novembre 2014 - 23:10:42

Fichier

submit.pdf
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Susanne Kandl, Raimund Kirner. Error Detection Rate of MC/DC for a Case Study from the Automotive Domain. Sang Lyul Min; Robert Pettit; Peter Puschner; Theo Ungerer. 8th IFIP WG 10.2 International Workshop on Software Technologies for Embedded and Ubiquitous Systems (SEUS), Oct 2010, Waidhofen/Ybbs, Austria. Springer, Lecture Notes in Computer Science, LNCS-6399, pp.131-142, 2010, Software Technologies for Embedded and Ubiquitous Systems. 〈10.1007/978-3-642-16256-5_14〉. 〈hal-01055391〉

Partager

Métriques

Consultations de la notice

212

Téléchargements de fichiers

202