Multimorphic Testing

Paul Temple 1 Mathieu Acher 1 Jean-Marc Jézéquel 1
1 DiverSe - Diversity-centric Software Engineering
Inria Rennes – Bretagne Atlantique , IRISA-D4 - LANGAGE ET GÉNIE LOGICIEL
Abstract : The functional correctness of a software application is, of course, a prime concern, but other issues such as its execution time, precision , or energy consumption might also be important in some contexts. Systematically testing these quantitative properties is still extremely difficult, in particular, because there exists no method to tell the developer whether such a test set is "good enough" or even whether a test set is better than another one. This paper proposes a new method, called Multimorphic testing, to assess the relative effectiveness of a test suite for revealing performance variations of a software system. By analogy with mutation testing, our core idea is to vary software parameters, and to check whether it makes any difference on the outcome of the tests: i.e. are some tests able to " kill " bad morphs (configurations)? Our method can be used to evaluate the quality of a test suite with respect to a quantitative property of interest, such as execution time or computation accuracy.
Document type :
Conference papers
Complete list of metadatas

Cited literature [5 references]  Display  Hide  Download

https://hal.inria.fr/hal-01730163
Contributor : Paul Temple <>
Submitted on : Tuesday, March 13, 2018 - 12:08:26 PM
Last modification on : Friday, September 13, 2019 - 9:48:41 AM
Long-term archiving on : Thursday, June 14, 2018 - 1:54:04 PM

File

Multimorphic.pdf
Files produced by the author(s)

Identifiers

Citation

Paul Temple, Mathieu Acher, Jean-Marc Jézéquel. Multimorphic Testing. ICSE '18 - ACM/IEEE 40th International Conference on Software Engineering, May 2018, Gothenburg, Sweden. pp.1-2, ⟨10.1145/3183440.3195043⟩. ⟨hal-01730163v2⟩

Share

Metrics

Record views

408

Files downloads

273