Evaluating the Efficiency of Continuous Testing during Test-Driven Development

Serge Demeyer 1 Benoît Verhaeghe 2 Anne Etien 2 Nicolas Anquetil 2 Stéphane Ducasse 2
2 RMOD - Analyses and Languages Constructs for Object-Oriented Application Evolution
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : Continuous testing is a novel feature within modern programming environments, where unit tests constantly run in the background providing early feedback about breaking changes. One of the more challenging aspects of such a continuous testing tool is choosing the heuristic which selects the tests to run based on the changes recently applied. To help tool builders select the most appropriate test selection heuristic, we assess their efficiency in a continuous testing context. We observe on two small but representative cases that a continuous testing tool generates significant reductions in number of tests that need to be executed. Nevertheless, these heuristics sometimes result in false negatives, thus in rare occasions discard pertinent tests.
Document type :
Conference papers
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.inria.fr/hal-01717343
Contributor : Lse Lse <>
Submitted on : Monday, February 26, 2018 - 11:41:25 AM
Last modification on : Friday, March 22, 2019 - 1:36:26 AM
Long-term archiving on : Monday, May 28, 2018 - 12:47:04 PM

File

Demeyer201VSTCameraReady.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Serge Demeyer, Benoît Verhaeghe, Anne Etien, Nicolas Anquetil, Stéphane Ducasse. Evaluating the Efficiency of Continuous Testing during Test-Driven Development. VST 2018 - 2nd IEEE International Workshop on Validation, Analysis and Evolution of Software Tests, Mar 2018, Campobasso, Italy. pp.1-5, ⟨10.1109/VST.2018.8327152⟩. ⟨hal-01717343⟩

Share

Metrics

Record views

425

Files downloads

402