Testing Testbeds Towards Reproducibility

Lucas Nussbaum 1
1 MADYNES - Management of dynamic networks and services
Inria Nancy - Grand Est, LORIA - NSS - Department of Networks, Systems and Services
Abstract : When using testbeds in the context of experimental computer science, the ability to produce trustworthy and reproducible experiments results depends greatly on the trustworthiness of the infrastructure itself. Unfortunately, several factors many issues such as software misconfiguration, hardware heterogeneity, or service failures, can remain undetected and affect the quality of experimental results. This paper presents the design and implementation of an automated testbed testing framework. This framework was deployed in the context of the Grid'5000 project, and uncovered more than one hundred of issues. (see also https://hal.inria.fr/hal-01538682 for an extended version of this work)
Complete list of metadatas

Contributor : Lucas Nussbaum <>
Submitted on : Monday, October 30, 2017 - 3:52:02 PM
Last modification on : Thursday, February 7, 2019 - 5:34:45 PM


  • HAL Id : hal-01626303, version 1


Lucas Nussbaum. Testing Testbeds Towards Reproducibility. GEFI 17 meeting - Global Experimentation for Future Internet, Oct 2017, Rio de Janeiro, Brazil. ⟨hal-01626303⟩



Record views


Files downloads