MonEx: An Integrated Experiment Monitoring Framework Standing on Off-The-Shelf Components

Abstract : Most computer experiments include a phase where metrics are gathered from and about various kinds of resources. This phase is often done via manual, non-reproducible and error-prone steps. Infrastructure monitoring tools facilitate collecting experiments’ data to some extent. However, there is no conventional way for doing so, and there is still much work to be done (e.g. capturing user experiments) to leverage the monitoring activity for monitoring experiments. To overcome those challenges, we define the requirements of experiments monitoring, clarifying Experiment Monitoring Frameworks’ scope and mainly focusing on reusability of experiments’ data, and portability of experiments’ metrics. We then propose MonEx EMF that satisfies those requirements. MonEx is built on top of infrastructure monitoring solutions and supports various monitoring approaches. It fully integrates into the experiment workflow by encompassing all steps from data acquisition to producing publishable figures. Hence, MonEx represents a first step towards unifying methods of collecting experiments’ data.
Type de document :
Communication dans un congrès
P-RECS 2018: 1st International Workshop on Practical Reproducible Evaluation of Computer Systems, Jun 2018, Tempe, AZ, United States. 2018, 〈http://www.hpdc.org/2018/〉. 〈10.1145/3214239.3214240〉
Liste complète des métadonnées

Littérature citée [2 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01793561
Contributeur : Abdulqawi Saif <>
Soumis le : lundi 11 juin 2018 - 14:37:34
Dernière modification le : lundi 18 juin 2018 - 12:35:41

Identifiants

Citation

Abdulqawi Saif, Alexandre Merlin, Lucas Nussbaum, Ye-Qiong Song. MonEx: An Integrated Experiment Monitoring Framework Standing on Off-The-Shelf Components. P-RECS 2018: 1st International Workshop on Practical Reproducible Evaluation of Computer Systems, Jun 2018, Tempe, AZ, United States. 2018, 〈http://www.hpdc.org/2018/〉. 〈10.1145/3214239.3214240〉. 〈hal-01793561v2〉

Partager

Métriques

Consultations de la notice

142

Téléchargements de fichiers

53