Experimental Methodologies for Large-Scale Systems: a Survey

Jens Gustedt 1 Emmanuel Jeannot 1 Martin Quinson 1
1 ALGORILLE - Algorithms for the Grid
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : The increasing complexity of available infrastructures with specific features (caches, hyperthreading, dual core, etc.) or with complex architectures (hierarchical, parallel, distributed, etc.) makes it extremely difficult to build analytical models that allow for a satisfying prediction. Hence, it raises the question on how to validate algorithms if a realistic analytic analysis is not possible any longer. As for some many other sciences, the one answer is experimental validation. Nevertheless, experimentation in Computer Science is a difficult subject that today still opens more questions than it solves: What may an experiment validate? What is a ''good experiment''? How to build an experimental environment that allows for "good experiments"? etc. In this paper we will provide some hints on this subject and show how some tools can help in performing ''good experiments'', mainly in the context of parallel and distributed computing. More precisely we will focus on four main experimental methodologies, namely in-situ (real-scale) experiments (with an emphasis on PlanetLab and Grid'5000), Emulation (with an emphasis on Wrekavoc) benchmarking and simulation (with an emphasis on SimGRID and GridSim). We will provide a comparison of these tools and methodologies from a quantitative but also qualitative point of view.
Type de document :
Article dans une revue
Parallel Processing Letters, World Scientific Publishing, 2009, 19 (3), pp.399-418. 〈10.1142/S0129626409000304〉
Liste complète des métadonnées

https://hal.inria.fr/inria-00364180
Contributeur : Jens Gustedt <>
Soumis le : lundi 26 octobre 2009 - 14:59:35
Dernière modification le : dimanche 20 mai 2018 - 20:20:10
Document(s) archivé(s) le : samedi 26 novembre 2016 - 14:22:34

Fichier

RR-6859.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Jens Gustedt, Emmanuel Jeannot, Martin Quinson. Experimental Methodologies for Large-Scale Systems: a Survey. Parallel Processing Letters, World Scientific Publishing, 2009, 19 (3), pp.399-418. 〈10.1142/S0129626409000304〉. 〈inria-00364180v2〉

Partager

Métriques

Consultations de la notice

647

Téléchargements de fichiers

3130