Multimorphic Testing

Paul Temple 1 Mathieu Acher 1 Jean-Marc Jézéquel 1
1 DiverSe - Diversity-centric Software Engineering
Inria Rennes – Bretagne Atlantique , IRISA_D4 - LANGAGE ET GÉNIE LOGICIEL
Abstract : The functional correctness of a software application is, of course, a prime concern, but other issues such as its execution time, precision , or energy consumption might also be important in some contexts. Systematically testing these quantitative properties is still extremely difficult, in particular, because there exists no method to tell the developer whether such a test set is "good enough" or even whether a test set is better than another one. This paper proposes a new method, called Multimorphic testing, to assess the relative effectiveness of a test suite for revealing performance variations of a software system. By analogy with mutation testing, our core idea is to vary software parameters, and to check whether it makes any difference on the outcome of the tests: i.e. are some tests able to " kill " bad morphs (configurations)? Our method can be used to evaluate the quality of a test suite with respect to a quantitative property of interest, such as execution time or computation accuracy.
Document type :
Conference papers
Complete list of metadatas

Cited literature [5 references]  Display  Hide  Download
Contributor : Paul Temple <>
Submitted on : Tuesday, March 13, 2018 - 12:08:26 PM
Last modification on : Friday, March 1, 2019 - 4:30:02 PM
Long-term archiving on : Thursday, June 14, 2018 - 1:54:04 PM


Files produced by the author(s)



Paul Temple, Mathieu Acher, Jean-Marc Jézéquel. Multimorphic Testing. ICSE '18 - ACM/IEEE 40th International Conference on Software Engineering, May 2018, Gothenburg, Sweden. pp.1-2, ⟨10.1145/3183440.3195043⟩. ⟨hal-01730163v2⟩



Record views


Files downloads