Reducing the Cost of Model-Based Testing through Test Case Diversity

Abstract : Model-based testing (MBT) suffers from two main problems which in many real world systems make MBT impractical: scalability and automatic oracle generation. When no automated oracle is available, or when testing must be performed on actual hardware or a restricted-access network, for example, only a small set of test cases can be executed and evaluated. However, MBT techniques usually generate large sets of test cases when applied to real systems, regardless of the coverage criteria. Therefore, one needs to select a small enough subset of these test cases that have the highest possible fault revealing power. In this paper, we investigate and compare various techniques for rewarding diversity in the selected test cases as a way to increase the likelihood of fault detection. We use a similarity measure defined on the representation of the test cases and use it in several algorithms that aim at maximizing the diversity of test cases. Using an industrial system with actual faults, we found that rewarding diversity leads to higher fault detection compared to the techniques commonly reported in the literature: coverage-based and random selection. Among the investigated algorithms, diversification using Genetic Algorithms is the most cost-effective technique.
Type de document :
Communication dans un congrès
Alexandre Petrenko; Adenilso Simão; José Carlos Maldonado. 22nd IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS), Nov 2010, Natal, Brazil. Springer, Lecture Notes in Computer Science, LNCS-6435, pp.63-78, 2010, Testing Software and Systems. 〈10.1007/978-3-642-16573-3_6〉
Liste complète des métadonnées

Littérature citée [24 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01055243
Contributeur : Hal Ifip <>
Soumis le : mardi 12 août 2014 - 09:23:30
Dernière modification le : mercredi 16 août 2017 - 15:22:39
Document(s) archivé(s) le : mercredi 26 novembre 2014 - 22:35:57

Fichier

64350062.pdf
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Hadi Hemmati, Andrea Arcuri, Lionel Briand. Reducing the Cost of Model-Based Testing through Test Case Diversity. Alexandre Petrenko; Adenilso Simão; José Carlos Maldonado. 22nd IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS), Nov 2010, Natal, Brazil. Springer, Lecture Notes in Computer Science, LNCS-6435, pp.63-78, 2010, Testing Software and Systems. 〈10.1007/978-3-642-16573-3_6〉. 〈hal-01055243〉

Partager

Métriques

Consultations de la notice

139

Téléchargements de fichiers

191