Adding Virtualization Capabilities to Grid'5000

Daniel Balouek; Alexandra Carpen Amarie; Ghislain Charrier; Frédéric Desprez; Emmanuel Jeannot; Emmanuel Jeanvoine; Adrien Lèbre; David Margery; Nicolas Niclausse; Lucas Nussbaum; Olivier Richard; Christian Pérez; Flavien Quesnel; Cyril Rohr; Luc Sarzyniec

hal-00720910, version 1

Adding Virtualization Capabilities to Grid'5000

Daniel Balouek^a^, 1, Alexandra Carpen Amarie^a^, 2, Ghislain Charrier ()^a^, 2, Frédéric Desprez ()^a^, 3, Emmanuel Jeannot^a^, 4, Emmanuel Jeanvoine ⁵, Adrien Lèbre ()^a^, 6, 7, David Margery ()^a^, 2, Nicolas Niclausse^a^, 8, Lucas Nussbaum () ⁹, Olivier Richard () ¹⁰, Christian Pérez (, )^a^, 3, Flavien Quesnel (, ) ^6, 7, Cyril Rohr (, )^a^, 2, Luc Sarzyniec ()^b^, 11

N° RR-8026 (2012)

Résumé : Almost ten years after its premises, the Grid'5000 testbed has become one of the most complete testbed for designing or evaluating large-scale distributed systems. Initially dedicated to the study of High Performance Computing, the infrastructure has evolved to address wider concerns related to Desktop Computing, the Internet of Services and more recently the Cloud Computing paradigm. This report present recent improvements of the Grid'5000 software and services stack to support large-scale experiments using virtualization technologies as building blocks. Such contributions include the deployment of customized software environments, the reservation of dedicated network domain and the possibility to isolate them from the others, and the automation of experiments with a REST API. We illustrate the interest of these contributions by describing three different use-cases of large-scale experiments on the Grid'5000 testbed. The first one leverages virtual machines to conduct larger experiments spread over 4000 peers. The second one describes the deployment of 10000 KVM instances over 4 Grid'5000 sites. Finally, the last use case introduces a one-click deployment tool to easily deploy major IaaS solutions. The conclusion highlights some important challenges of Grid'5000 related to the use of OpenFlow and to the management of applications dealing with tremendous amount of data.

a – INRIA
b – Université Henri Poincaré - Nancy I
1 : Laboratoire de l'Informatique du Parallélisme (LIP)
Université de Lyon – CNRS : UMR5668 – INRIA – École Normale Supérieure - Lyon – Université Claude Bernard - Lyon I
2 : MYRIADS (INRIA - IRISA)
INRIA – CNRS : UMR6074 – Université de Rennes 1 – Institut National des Sciences Appliquées (INSA) : - RENNES
3 : AVALON (LIP Lyon / Inria Grenoble Rhône-Alpes)
CNRS : UMR5668 – INRIA – École Normale Supérieure - Lyon – Laboratoire d'informatique du Parallélisme – Université Claude Bernard - Lyon I
4 : RUNTIME (INRIA Bordeaux - Sud-Ouest)
INRIA – CNRS : UMR5800 – Université Sciences et Technologies - Bordeaux I – École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)
5 : Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA)
INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
6 : ASCOLA (INRIA - EMN)
INRIA – École Nationale Supérieure des Mines - Nantes
7 : Laboratoire d'Informatique de Nantes Atlantique (LINA)
CNRS : UMR6241 – Université de Nantes – École Nationale Supérieure des Mines - Nantes
8 : Service DREAM (INRIA Sophia Antipolis - Méditerranée)
INRIA
9 : ALGORILLE (INRIA Lorraine - LORIA)
INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
10 : Laboratoire d'Informatique de Grenoble (LIG)
Université Joseph Fourier - Grenoble I – Institut Polytechnique de Grenoble - Grenoble Institute of Technology – Université Pierre-Mendès-France - Grenoble II – CNRS : UMR5217
11 : MAIA (INRIA Lorraine - LORIA)
INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)

Collaboration : Grid'5000

hal-00720910, version 1
http://hal.inria.fr/hal-00720910
oai:hal.inria.fr:hal-00720910
Contributeur : Frédéric Desprez <>
Soumis le : Jeudi 26 Juillet 2012, 10:37:50
Dernière modification le : Lundi 30 Juillet 2012, 10:25:03

Voir la fiche détaillée

Documents associés

PDF :

Exporter

Bibtex EndNote TEI RefWorks

%% hal-00720910, version 1
%% http://hal.inria.fr/hal-00720910
@techreport{balouek:hal-00720910,
    hal_id = {hal-00720910},
    url = {http://hal.inria.fr/hal-00720910},
    title = {{Adding Virtualization Capabilities to Grid'5000}},
    author = {Balouek, Daniel and Carpen Amarie, Alexandra and Charrier, Ghislain and Desprez, Fr{\'e}d{\'e}ric and Jeannot, Emmanuel and Jeanvoine, Emmanuel and L{\`e}bre, Adrien and Margery, David and Niclausse, Nicolas and Nussbaum, Lucas and Richard, Olivier and P{\'e}rez, Christian and Quesnel, Flavien and Rohr, Cyril and Sarzyniec, Luc},
    abstract = {{Almost ten years after its premises, the Grid'5000 testbed has become one of the most complete testbed for designing or evaluating large-scale distributed systems. Initially dedicated to the study of High Performance Computing, the infrastructure has evolved to address wider concerns related to Desktop Computing, the Internet of Services and more recently the Cloud Computing paradigm. This report present recent improvements of the Grid'5000 software and services stack to support large-scale experiments using virtualization technologies as building blocks. Such contributions include the deployment of customized software environments, the reservation of dedicated network domain and the possibility to isolate them from the others, and the automation of experiments with a REST API. We illustrate the interest of these contributions by describing three different use-cases of large-scale experiments on the Grid'5000 testbed. The first one leverages virtual machines to conduct larger experiments spread over 4000 peers. The second one describes the deployment of 10000 KVM instances over 4 Grid'5000 sites. Finally, the last use case introduces a one-click deployment tool to easily deploy major IaaS solutions. The conclusion highlights some important challenges of Grid'5000 related to the use of OpenFlow and to the management of applications dealing with tremendous amount of data.}},
    language = {Anglais},
    affiliation = {Laboratoire de l'Informatique du Parall{\'e}lisme - LIP , MYRIADS - INRIA - IRISA , AVALON - LIP Lyon / Inria Grenoble Rh{\^o}ne-Alpes , RUNTIME - INRIA Bordeaux - Sud-Ouest , Laboratoire Lorrain de Recherche en Informatique et ses Applications - LORIA , ASCOLA - INRIA - EMN , Laboratoire d'Informatique de Nantes Atlantique - LINA , Service DREAM - INRIA Sophia Antipolis - M{\'e}diterran{\'e}e , ALGORILLE - INRIA Lorraine - LORIA , Laboratoire d'Informatique de Grenoble - LIG , MAIA - INRIA Lorraine - LORIA},
    pages = {18},
    type = {Rapport de recherche},
    institution = {INRIA},
    number = {RR-8026},
    collaboration = {Grid'5000 },
    year = {2012},
    month = Jul,
    pdf = {http://hal.inria.fr/hal-00720910/PDF/RR-8026.pdf},
}

%F hal-00720910, version 1
%0 Report
%U http://hal.inria.fr/hal-00720910
%2 INFO:INFO_DC
%T Adding Virtualization Capabilities to Grid'5000
%A Balouek, Daniel
%A Carpen Amarie, Alexandra
%A Charrier, Ghislain
%A Desprez, Frédéric
%A Jeannot, Emmanuel
%A Jeanvoine, Emmanuel
%A Lèbre, Adrien
%A Margery, David
%A Niclausse, Nicolas
%A Nussbaum, Lucas
%A Richard, Olivier
%A Pérez, Christian
%A Quesnel, Flavien
%A Rohr, Cyril
%A Sarzyniec, Luc
%+ Laboratoire de l'Informatique du Parallélisme - LIP , MYRIADS - INRIA - IRISA , AVALON - LIP Lyon / Inria Grenoble Rhône-Alpes , RUNTIME - INRIA Bordeaux - Sud-Ouest , Laboratoire Lorrain de Recherche en Informatique et ses Applications - LORIA , ASCOLA - INRIA - EMN , Laboratoire d'Informatique de Nantes Atlantique - LINA , Service DREAM - INRIA Sophia Antipolis - Méditerranée , ALGORILLE - INRIA Lorraine - LORIA , Laboratoire d'Informatique de Grenoble - LIG , MAIA - INRIA Lorraine - LORIA
%X Almost ten years after its premises, the Grid'5000 testbed has become one of the most complete testbed for designing or evaluating large-scale distributed systems. Initially dedicated to the study of High Performance Computing, the infrastructure has evolved to address wider concerns related to Desktop Computing, the Internet of Services and more recently the Cloud Computing paradigm. This report present recent improvements of the Grid'5000 software and services stack to support large-scale experiments using virtualization technologies as building blocks. Such contributions include the deployment of customized software environments, the reservation of dedicated network domain and the possibility to isolate them from the others, and the automation of experiments with a REST API. We illustrate the interest of these contributions by describing three different use-cases of large-scale experiments on the Grid'5000 testbed. The first one leverages virtual machines to conduct larger experiments spread over 4000 peers. The second one describes the deployment of 10000 KVM instances over 4 Grid'5000 sites. Finally, the last use case introduces a one-click deployment tool to easily deploy major IaaS solutions. The conclusion highlights some important challenges of Grid'5000 related to the use of OpenFlow and to the management of applications dealing with tremendous amount of data.
%2 Dix ans environ après ses prémisses, la plate-forme Grid'5000 est devenue une des plates-formes les plus complètes utilisée pour la conception et l'évaluation de systèmes distribués à grande échelle. Dédiée initialement au calcul à haute performance, l'infrastructure a évolué pour supporter un ensemble de problèmes plus vaste liés au calcul de type Desktop, l'internet des objets et plus récemment l'informatique dans les nuages (aussi appelé Cloud Computing). Ce rapport présente les améliorations récentes apportées au logiciels et pile de services pour supporter les expérimentations à grande échelle utilisant les technologies de virtualisation comme blocs de base. Nos contributions incluent le déploiement d'environnements logiciels customisés, la réservation de domaines réseaux dédiés et la possibilité de les isoler entre eux, et l'automatisation des expérimentations grâce à une API REST. Nous illustrons l'intérêt de ces contributions en décrivant trois expériences à large échelle sur la plate-forme Grid'5000. La première expérience utilise des machines virtuelles pour conduire des expérimentations de grande taille sur 4000 pairs. La seconde expérience décrit le déploiement de 10000 instances KVM sur 4 sites Grid'5000. Enfin le dernier exemple présente un outil de déploiement simple pour déployer des solutions de Cloud de type IaaS. La conclusion discute de prochains défis importants de Grid'5000 liés à l'utilisation d'OpenFlow et à la gestion d'applications gérant des grandes masses de données.
%G Anglais
%2 Rapport de recherche
%P 18
%8 2012-07-26
%Z RR-8026
%Z ADT Aladdin, AE Hemera
%Z Grid'5000

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="report"><head>Rapports</head>
<biblStruct type="report" xml:id="hal-00720910"><monogr>
<author><persName><forename>Daniel</forename><surname>Balouek</surname></persName>
<affiliation>
<orgName type="laboratory">LIP</orgName>
<orgName type="team">Laboratoire de l'Informatique du Parallélisme</orgName>
<country>FR</country>
<orgName type="institution">Université de Lyon</orgName>
<orgName type="institution">CNRS : UMR5668</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
</affiliation>
</author>
<author><persName><forename>Alexandra</forename><surname>Carpen Amarie</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MYRIADS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) : - RENNES</orgName>
</affiliation>
</author>
<author><persName><forename>Ghislain</forename><surname>Charrier</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MYRIADS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) : - RENNES</orgName>
</affiliation>
</author>
<author><persName><forename>Frédéric</forename><surname>Desprez</surname></persName>
<affiliation>
<orgName type="laboratory">LIP Lyon / Inria Grenoble Rhône-Alpes</orgName>
<orgName type="team">AVALON</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5668</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Laboratoire d'informatique du Parallélisme</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
</affiliation>
</author>
<author><persName><forename>Emmanuel</forename><surname>Jeannot</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Bordeaux - Sud-Ouest</orgName>
<orgName type="team">RUNTIME</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR5800</orgName>
<orgName type="institution">Université Sciences et Technologies - Bordeaux I</orgName>
<orgName type="institution">École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)</orgName>
</affiliation>
</author>
<author><persName><forename>Emmanuel</forename><surname>Jeanvoine</surname></persName>
<affiliation>
<orgName type="laboratory">LORIA</orgName>
<orgName type="team">Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR7503</orgName>
<orgName type="institution">Université Henri Poincaré - Nancy I</orgName>
<orgName type="institution">Université Nancy II</orgName>
<orgName type="institution">Institut National Polytechnique de Lorraine (INPL)</orgName>
</affiliation>
</author>
<author><persName><forename>Adrien</forename><surname>Lèbre</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - EMN</orgName>
<orgName type="team">ASCOLA</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Nationale Supérieure des Mines - Nantes</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">LINA</orgName>
<orgName type="team">Laboratoire d'Informatique de Nantes Atlantique</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR6241</orgName>
<orgName type="institution">Université de Nantes</orgName>
<orgName type="institution">École Nationale Supérieure des Mines - Nantes</orgName>
</affiliation>
</author>
<author><persName><forename>David</forename><surname>Margery</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MYRIADS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) : - RENNES</orgName>
</affiliation>
</author>
<author><persName><forename>Nicolas</forename><surname>Niclausse</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Sophia Antipolis - Méditerranée</orgName>
<orgName type="team">Service DREAM</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
</affiliation>
</author>
<author><persName><forename>Lucas</forename><surname>Nussbaum</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Lorraine - LORIA</orgName>
<orgName type="team">ALGORILLE</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR7503</orgName>
<orgName type="institution">Université Henri Poincaré - Nancy I</orgName>
<orgName type="institution">Université Nancy II</orgName>
<orgName type="institution">Institut National Polytechnique de Lorraine (INPL)</orgName>
</affiliation>
</author>
<author><persName><forename>Olivier</forename><surname>Richard</surname></persName>
<affiliation>
<orgName type="laboratory">LIG</orgName>
<orgName type="team">Laboratoire d'Informatique de Grenoble</orgName>
<country>FR</country>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Institut Polytechnique de Grenoble - Grenoble Institute of Technology</orgName>
<orgName type="institution">Université Pierre-Mendès-France - Grenoble II</orgName>
<orgName type="institution">CNRS : UMR5217</orgName>
</affiliation>
</author>
<author><persName><forename>Christian</forename><surname>Pérez</surname></persName>
<affiliation>
<orgName type="laboratory">LIP Lyon / Inria Grenoble Rhône-Alpes</orgName>
<orgName type="team">AVALON</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5668</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Laboratoire d'informatique du Parallélisme</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
</affiliation>
</author>
<author><persName><forename>Flavien</forename><surname>Quesnel</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - EMN</orgName>
<orgName type="team">ASCOLA</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Nationale Supérieure des Mines - Nantes</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">LINA</orgName>
<orgName type="team">Laboratoire d'Informatique de Nantes Atlantique</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR6241</orgName>
<orgName type="institution">Université de Nantes</orgName>
<orgName type="institution">École Nationale Supérieure des Mines - Nantes</orgName>
</affiliation>
</author>
<author><persName><forename>Cyril</forename><surname>Rohr</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MYRIADS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) : - RENNES</orgName>
</affiliation>
</author>
<author><persName><forename>Luc</forename><surname>Sarzyniec</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Lorraine - LORIA</orgName>
<orgName type="team">MAIA</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR7503</orgName>
<orgName type="institution">Université Henri Poincaré - Nancy I</orgName>
<orgName type="institution">Université Nancy II</orgName>
<orgName type="institution">Institut National Polytechnique de Lorraine (INPL)</orgName>
</affiliation>
</author>
<title type="main" level="m">Adding Virtualization Capabilities to Grid'5000</title><title type="main" level="m">Adding Virtualization Capabilities to Grid'5000</title><imprint><biblScope type="publicationDate">2012-07-26</biblScope><biblScope type="pp">18</biblScope></imprint></monogr><idno type="HALid">http://hal.inria.fr/hal-00720910</idno><idno type="HALFile">http://hal.inria.fr/hal-00720910/PDF/RR-8026.pdf</idno></biblStruct>
</listBibl>
</listBibl>