A survey of general-purpose experiment management tools for distributed systems

Tomasz Buchert 1 Cristian Ruiz 2 Lucas Nussbaum 1 Olivier Richard 2
1 MADYNES - Management of dynamic networks and services
Inria Nancy - Grand Est, LORIA - NSS - Department of Networks, Systems and Services
2 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : In the field of large-scale distributed systems, experimentation is particularly difficult. The studied systems are complex, often nondeterministic and unreliable, software is plagued with bugs, whereas the experiment workflows are unclear and hard to reproduce. These obstacles led many independent researchers to design tools to control their experiments, boost productivity and improve quality of scientific results. Despite much research in the domain of distributed systems experiment management, the current fragmentation of efforts asks for a general analysis. We therefore propose to build a framework to uncover missing functionality of these tools, enable meaningful comparisons be-tween them and find recommendations for future improvements and research. The contribution in this paper is twofold. First, we provide an extensive list of features offered by general-purpose experiment management tools dedicated to distributed systems research on real platforms. We then use it to assess existing solutions and compare them, outlining possible future paths for improvements.
Type de document :
Article dans une revue
Future Generation Computer Systems, Elsevier, 2015, 45, pp.1 - 12. 〈10.1016/j.future.2014.10.007〉
Liste complète des métadonnées

Littérature citée [50 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01087519
Contributeur : Lucas Nussbaum <>
Soumis le : mercredi 26 novembre 2014 - 11:47:54
Dernière modification le : mercredi 29 novembre 2017 - 15:59:59
Document(s) archivé(s) le : vendredi 27 février 2015 - 11:31:48

Fichier

main.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Tomasz Buchert, Cristian Ruiz, Lucas Nussbaum, Olivier Richard. A survey of general-purpose experiment management tools for distributed systems. Future Generation Computer Systems, Elsevier, 2015, 45, pp.1 - 12. 〈10.1016/j.future.2014.10.007〉. 〈hal-01087519〉

Partager

Métriques

Consultations de la notice

621

Téléchargements de fichiers

651