Replaying IDE Interactions to Evaluate and Improve Change Prediction Approaches

Abstract : Change prediction helps developers by recommending program entities that will have to be changed alongside the entities currently being changed. To evaluate their accuracy, current change prediction approaches use data from versioning systems such as CVS or SVN. These data sources provide a coarse-grained view of the development history that flattens the sequence of changes in a single commit. They are thus not a valid basis for evaluation in the case of developmentstyle prediction, where the order of the predictions has to match the order of the changes a developer makes. We propose a benchmark for the evaluation of change prediction approaches based on fine-grained change data recorded from IDE usage. Moreover, the change prediction approaches themselves can use the more accurate data to fine-tune their prediction. We present an evaluation procedure and use it on several change prediction approaches, both novel and from the literature, and report on the results.
Document type :
Conference papers
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/inria-00531788
Contributor : Lse Lse <>
Submitted on : Friday, November 5, 2010 - 10:59:23 AM
Last modification on : Thursday, February 21, 2019 - 10:52:50 AM
Long-term archiving on : Friday, October 26, 2012 - 3:00:32 PM

File

Robbes2010changePrediction.pdf
Files produced by the author(s)

Identifiers

Citation

Romain Robbes, Damien Pollet, Michele Lanza. Replaying IDE Interactions to Evaluate and Improve Change Prediction Approaches. 7th IEEE Working Conference on Mining Software Repositories (MSR), May 2010, Cape Town, South Africa. ⟨10.1109/MSR.2010.5463278⟩. ⟨inria-00531788⟩

Share

Metrics

Record views

499

Files downloads

286