Extending Coverage Criteria by Evaluating Their Robustness to Code Structure Changes

Abstract : Code coverage is usually used as a measurement of testing quality and as adequacy criterion. Unfortunately, code coverage is very sensitive to modifications of the code structure, and, therefore, the same test suite can achieve different degrees of coverage on the same program written in two syntactically different ways. For this reason, code coverage can provide the tester with misleading information.In order to understand how a testing criterion is affected by code structure modifications, we introduce a way to measure the sensitivity of coverage to code changes. We formalize the modifications of the code structure using semantic preserving code-to-code transformations and we propose a framework to evaluate coverage robustness to these transformations, extending actual existing coverage criteria.This allows us to define which programs and which test suites can be considered robust with respect to a certain set of transformations. We can identify when the obtained coverage is fragile and we extend the concept of coverage criterion by introducing an index that measures the fragility of the coverage of a given test suite. We show how to compute the fragility index and we evidence that also well-written industrial code and realistic test suites can be fragile. Moreover, we suggest how to deal with this kind of testing fragility.
Type de document :
Communication dans un congrès
Brian Nielsen; Carsten Weise. 24th International Conference on Testing Software and Systems (ICTSS), Nov 2012, Aalborg, Denmark. Springer, Lecture Notes in Computer Science, LNCS-7641, pp.168-183, 2012, Testing Software and Systems. 〈10.1007/978-3-642-34691-0_13〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01482400
Contributeur : Hal Ifip <>
Soumis le : vendredi 3 mars 2017 - 15:17:16
Dernière modification le : vendredi 3 mars 2017 - 15:25:07
Document(s) archivé(s) le : mardi 6 juin 2017 - 13:06:10

Fichier

978-3-642-34691-0_13_Chapter.p...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Angelo Gargantini, Marco Guarnieri, Eros Magri. Extending Coverage Criteria by Evaluating Their Robustness to Code Structure Changes. Brian Nielsen; Carsten Weise. 24th International Conference on Testing Software and Systems (ICTSS), Nov 2012, Aalborg, Denmark. Springer, Lecture Notes in Computer Science, LNCS-7641, pp.168-183, 2012, Testing Software and Systems. 〈10.1007/978-3-642-34691-0_13〉. 〈hal-01482400〉

Partager

Métriques

Consultations de la notice

43

Téléchargements de fichiers

12