MonEx: An Integrated Experiment Monitoring Framework Standing on Off-The-Shelf Components

Abdulqawi Saif 1, 2 Alexandre Merlin 2 Lucas Nussbaum 2 Ye-Qiong Song 3
2 RESIST - Resilience and Elasticity for Security and ScalabiliTy of dynamic networked systems
Inria Nancy - Grand Est, LORIA - NSS - Department of Networks, Systems and Services
3 MADYNES - Management of dynamic networks and services
Inria Nancy - Grand Est, LORIA - NSS - Department of Networks, Systems and Services
Abstract : Most computer experiments include a phase where metrics are gathered from and about various kinds of resources. This phase is often done via manual, non-reproducible and error-prone steps. Infrastructure monitoring tools facilitate collecting experiments’ data to some extent. However, there is no conventional way for doing so, and there is still much work to be done (e.g. capturing user experiments) to leverage the monitoring activity for monitoring experiments. To overcome those challenges, we define the requirements of experiments monitoring, clarifying Experiment Monitoring Frameworks’ scope and mainly focusing on reusability of experiments’ data, and portability of experiments’ metrics. We then propose MonEx EMF that satisfies those requirements. MonEx is built on top of infrastructure monitoring solutions and supports various monitoring approaches. It fully integrates into the experiment workflow by encompassing all steps from data acquisition to producing publishable figures. Hence, MonEx represents a first step towards unifying methods of collecting experiments’ data.
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.inria.fr/hal-01793561
Contributor : Abdulqawi Saif <>
Submitted on : Monday, June 11, 2018 - 2:37:34 PM
Last modification on : Thursday, February 7, 2019 - 5:34:42 PM
Long-term archiving on : Wednesday, September 26, 2018 - 6:32:11 PM

Identifiers

Citation

Abdulqawi Saif, Alexandre Merlin, Lucas Nussbaum, Ye-Qiong Song. MonEx: An Integrated Experiment Monitoring Framework Standing on Off-The-Shelf Components. P-RECS 2018: 1st International Workshop on Practical Reproducible Evaluation of Computer Systems, Jun 2018, Tempe, AZ, United States. ⟨10.1145/3214239.3214240⟩. ⟨hal-01793561v2⟩

Share

Metrics

Record views

247

Files downloads

175