Supporting Experimental Computer Science

Frédéric Desprez; Geoffrey Fox; Emmanuel Jeannot; Kate Keahey; Michael Kozuch; David Margery; Pierre Neyron; Lucas Nussbaum; Christian Pérez; Olivier Richard; Warren Smith; Gregor Von Laszewski; Jens Vöckler

hal-00722605, version 1

Supporting Experimental Computer Science

Frédéric Desprez ()^d^, 1, Geoffrey Fox^g^, 2, Emmanuel Jeannot^d^, 3, Kate Keahey ()^a^, 4, Michael Kozuch^b^, 5, David Margery ()^d^, 6, Pierre Neyron ()^c^, 7, Lucas Nussbaum () ⁸, Christian Pérez (, )^d^, 1, Olivier Richard ()^e^, 7, Warren Smith^f^, 9, Gregor Von Laszewski^g^, 2, Jens Vöckler^h^, 10

N° RR-8035 (2012)

Abstract: The ability to conduct consistent, controlled, and repeatable large-scale experiments in all areas of computer science related to parallel, large-scale, or distributed computing and networking is critical to the future and development of computer science. Yet conducting such experiments is still too often a challenge for researchers, students, and practitioners because of the unavailability of dedicated resources, inability to create controlled experimental conditions, and variability in software. Availability, repeatability, and open sharing of electronic products are all still difficult to achieve. To discuss those challenges and share experiences in their solution, the Workshop on Experimental Support for Computer Science brought together scientists involved in building and operating infrastructures dedicated to sup- porting computer science experiments to discuss challenges and solutions in this space. The workshop was held in November 2011 and was collocated with the SC11 conference in Seattle, Washington. Our objec- tives were to share experiences and knowledge related to supporting large-scale experiments conducted on experimental infrastructures, understand user requirements, and discuss methodologies and opportunities created by emerging technologies. This report ties together the workshop presentations and discussion and the consensus that emerged on the state of the field and directions for moving forward.

a – Argonne National Laboratory
b – Intel
c – CNRS
d – INRIA
e – Polytech'Grenoble and Joseph Fourier University
f – Texas Advanced Computing Center
g – Indiana University
h – University of Southern California
1: AVALON (LIP Lyon / Inria Grenoble Rhône-Alpes)
CNRS : UMR5668 – INRIA – École Normale Supérieure - Lyon – Laboratoire d'informatique du Parallélisme – Université Claude Bernard - Lyon I
2: Pervasive Technology Institute
Indiana University
3: RUNTIME (INRIA Bordeaux - Sud-Ouest)
INRIA – CNRS : UMR5800 – Université Sciences et Technologies - Bordeaux I – École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)
4: Argonne National Laboratory (ANL)
US Department of Energy – University of Chicago
5: INTEL
Intel
6: MYRIADS (INRIA - IRISA)
INRIA – CNRS : UMR6074 – Université de Rennes 1 – Institut National des Sciences Appliquées (INSA) : - RENNES
7: Laboratoire d'Informatique de Grenoble (LIG)
Université Joseph Fourier - Grenoble I – Institut polytechnique de Grenoble (Grenoble INP) – Université Pierre-Mendès-France - Grenoble II – CNRS : UMR5217
8: ALGORILLE (INRIA Nancy - Grand Est / LORIA)
INRIA – CNRS : UMR7503 – Université de Lorraine
9: Texas Advanced Computing Center
Texas Advanced Computing Center
10: Information Sciences Institute [California]
University of Southern California

Collaboration : Grid'5000

hal-00722605, version 1
http://hal.inria.fr/hal-00722605
oai:hal.inria.fr:hal-00722605
From: Frédéric Desprez <>
Submitted on: Thursday, 2 August 2012 15:58:32
Updated on: Thursday, 25 October 2012 14:20:53

See detailed view

Associated documents

PDF :

Export

Bibtex EndNote TEI RefWorks

%% hal-00722605, version 1
%% http://hal.inria.fr/hal-00722605
@techreport{desprez:hal-00722605,
    hal_id = {hal-00722605},
    url = {http://hal.inria.fr/hal-00722605},
    title = {{Supporting Experimental Computer Science}},
    author = {Desprez, Fr{\'e}d{\'e}ric and Fox, Geoffrey and Jeannot, Emmanuel and Keahey, Kate and Kozuch, Michael and Margery, David and Neyron, Pierre and Nussbaum, Lucas and P{\'e}rez, Christian and Richard, Olivier and Smith, Warren and Von Laszewski, Gregor and V{\"o}ckler, Jens},
    abstract = {{The ability to conduct consistent, controlled, and repeatable large-scale experiments in all areas of computer science related to parallel, large-scale, or distributed computing and networking is critical to the future and development of computer science. Yet conducting such experiments is still too often a challenge for researchers, students, and practitioners because of the unavailability of dedicated resources, inability to create controlled experimental conditions, and variability in software. Availability, repeatability, and open sharing of electronic products are all still difficult to achieve. To discuss those challenges and share experiences in their solution, the Workshop on Experimental Support for Computer Science brought together scientists involved in building and operating infrastructures dedicated to sup- porting computer science experiments to discuss challenges and solutions in this space. The workshop was held in November 2011 and was collocated with the SC11 conference in Seattle, Washington. Our objec- tives were to share experiences and knowledge related to supporting large-scale experiments conducted on experimental infrastructures, understand user requirements, and discuss methodologies and opportunities created by emerging technologies. This report ties together the workshop presentations and discussion and the consensus that emerged on the state of the field and directions for moving forward.}},
    language = {English},
    affiliation = {AVALON - LIP Lyon / Inria Grenoble Rh{\^o}ne-Alpes , Pervasive Technology Institute , RUNTIME - INRIA Bordeaux - Sud-Ouest , Argonne National Laboratory - ANL , INTEL , MYRIADS - INRIA - IRISA , Laboratoire d'Informatique de Grenoble - LIG , ALGORILLE - INRIA Nancy - Grand Est / LORIA , Texas Advanced Computing Center , Information Sciences Institute [California]},
    pages = {29},
    type = {Research Report},
    institution = {INRIA},
    number = {RR-8035},
    collaboration = {Grid'5000 },
    year = {2012},
    month = Jul,
    pdf = {http://hal.inria.fr/hal-00722605/PDF/RR-8035.pdf},
}

%F hal-00722605, version 1
%0 Report
%U http://hal.inria.fr/hal-00722605
%2 INFO:INFO_DC
%T Supporting Experimental Computer Science
%A Desprez, Frédéric
%A Fox, Geoffrey
%A Jeannot, Emmanuel
%A Keahey, Kate
%A Kozuch, Michael
%A Margery, David
%A Neyron, Pierre
%A Nussbaum, Lucas
%A Pérez, Christian
%A Richard, Olivier
%A Smith, Warren
%A Von Laszewski, Gregor
%A Vöckler, Jens
%+ AVALON - LIP Lyon / Inria Grenoble Rhône-Alpes , Pervasive Technology Institute , RUNTIME - INRIA Bordeaux - Sud-Ouest , Argonne National Laboratory - ANL , INTEL , MYRIADS - INRIA - IRISA , Laboratoire d'Informatique de Grenoble - LIG , ALGORILLE - INRIA Nancy - Grand Est / LORIA , Texas Advanced Computing Center , Information Sciences Institute [California]
%Z ALGORILLE
%X The ability to conduct consistent, controlled, and repeatable large-scale experiments in all areas of computer science related to parallel, large-scale, or distributed computing and networking is critical to the future and development of computer science. Yet conducting such experiments is still too often a challenge for researchers, students, and practitioners because of the unavailability of dedicated resources, inability to create controlled experimental conditions, and variability in software. Availability, repeatability, and open sharing of electronic products are all still difficult to achieve. To discuss those challenges and share experiences in their solution, the Workshop on Experimental Support for Computer Science brought together scientists involved in building and operating infrastructures dedicated to sup- porting computer science experiments to discuss challenges and solutions in this space. The workshop was held in November 2011 and was collocated with the SC11 conference in Seattle, Washington. Our objec- tives were to share experiences and knowledge related to supporting large-scale experiments conducted on experimental infrastructures, understand user requirements, and discuss methodologies and opportunities created by emerging technologies. This report ties together the workshop presentations and discussion and the consensus that emerged on the state of the field and directions for moving forward.
%2 La possibilité d'effectuer des expériences à grande échelle consistantes, contrôlées, et reproductibles dans tous les domaines de l'informatique liés au parallélisme et au calcul distribué est critique pour le futur et le développement de l'informatique. Le lancement de telles expérimentations est souvent difficile pour les chercheurs, les étudiants et les développeurs et ceci en partie à cause de l'absence de ressources dédiées, l'impossibilité de créer des conditions expérimentales contrôlées et l'évolution des logiciels. La disponibilité, la reproductibilité, et le partage ouvert de plates-formes informatiques sont toujours difficiles à atteindre. Afin de discuter de ces challenges et de partager nos expériences sur les solutions à ces problèmes, le workshop "Experimental Support for Computer Science" a réuni des scientifiques impliqués dans la construction et la maintenance de plates-formes expérimentales dédiées au support pour les expériences informatiques pour discuter des challenges et de leurs solutions. Ce workshop s'est tenu en novembre 2011 au sein de la conférence SC11 à Seattle, Washington. Notre objectif était de partager notre expériences et nos connais- sances autour du support pour les expériences à grande échelle lancées sur des plates-formes d'expérimentation, comprendre les besoins des utilisateurs et discuter des méthodes et des opportunités créées par ces technologies émergentes. Ce rapport présente les contributions liées aux présentations du workshop et aux discussions qui ont eu lieu et le consensus issu sur l'état de l'art et des directions pour les travaux futurs.
%G English
%2 Research Report
%P 29
%8 2012-07-31
%2 http://hal.inria.fr/index.php?halsid=asmidnrlsdkrnhgjrfnivesbv3&view_this_doc=hal-00720815&version=1
%Z RR-8035
%Z Grid'5000

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="report"><head>Research reports</head>
<biblStruct type="report" xml:id="hal-00722605"><monogr>
<author><persName><forename>Frédéric</forename><surname>Desprez</surname></persName>
<affiliation>
<orgName type="laboratory">LIP Lyon / Inria Grenoble Rhône-Alpes</orgName>
<orgName type="team">AVALON</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5668</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Laboratoire d'informatique du Parallélisme</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
</affiliation>
</author>
<author><persName><forename>Geoffrey</forename><surname>Fox</surname></persName>
<affiliation>
<orgName type="team">Pervasive Technology Institute</orgName>
<country>IN</country>
<orgName type="institution">Indiana University</orgName>
</affiliation>
</author>
<author><persName><forename>Emmanuel</forename><surname>Jeannot</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Bordeaux - Sud-Ouest</orgName>
<orgName type="team">RUNTIME</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR5800</orgName>
<orgName type="institution">Université Sciences et Technologies - Bordeaux I</orgName>
<orgName type="institution">École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)</orgName>
</affiliation>
</author>
<author><persName><forename>Kate</forename><surname>Keahey</surname></persName>
<affiliation>
<orgName type="laboratory">ANL</orgName>
<orgName type="team">Argonne National Laboratory</orgName>
<country>US</country>
<orgName type="institution">US Department of Energy</orgName>
<orgName type="institution">University of Chicago</orgName>
</affiliation>
</author>
<author><persName><forename>Michael</forename><surname>Kozuch</surname></persName>
<affiliation>
<orgName type="team">INTEL</orgName>
<country>US</country>
<orgName type="institution">Intel</orgName>
</affiliation>
</author>
<author><persName><forename>David</forename><surname>Margery</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MYRIADS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) : - RENNES</orgName>
</affiliation>
</author>
<author><persName><forename>Pierre</forename><surname>Neyron</surname></persName>
<affiliation>
<orgName type="laboratory">LIG</orgName>
<orgName type="team">Laboratoire d'Informatique de Grenoble</orgName>
<country>FR</country>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Institut polytechnique de Grenoble (Grenoble INP)</orgName>
<orgName type="institution">Université Pierre-Mendès-France - Grenoble II</orgName>
<orgName type="institution">CNRS : UMR5217</orgName>
</affiliation>
</author>
<author><persName><forename>Lucas</forename><surname>Nussbaum</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Nancy - Grand Est / LORIA</orgName>
<orgName type="team">ALGORILLE</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR7503</orgName>
<orgName type="institution">Université de Lorraine</orgName>
</affiliation>
</author>
<author><persName><forename>Christian</forename><surname>Pérez</surname></persName>
<affiliation>
<orgName type="laboratory">LIP Lyon / Inria Grenoble Rhône-Alpes</orgName>
<orgName type="team">AVALON</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5668</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Laboratoire d'informatique du Parallélisme</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
</affiliation>
</author>
<author><persName><forename>Olivier</forename><surname>Richard</surname></persName>
<affiliation>
<orgName type="laboratory">LIG</orgName>
<orgName type="team">Laboratoire d'Informatique de Grenoble</orgName>
<country>FR</country>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Institut polytechnique de Grenoble (Grenoble INP)</orgName>
<orgName type="institution">Université Pierre-Mendès-France - Grenoble II</orgName>
<orgName type="institution">CNRS : UMR5217</orgName>
</affiliation>
</author>
<author><persName><forename>Warren</forename><surname>Smith</surname></persName>
<affiliation>
<orgName type="team">Texas Advanced Computing Center</orgName>
<country>US</country>
<orgName type="institution">Texas Advanced Computing Center</orgName>
</affiliation>
</author>
<author><persName><forename>Gregor</forename><surname>Von Laszewski</surname></persName>
<affiliation>
<orgName type="team">Pervasive Technology Institute</orgName>
<country>IN</country>
<orgName type="institution">Indiana University</orgName>
</affiliation>
</author>
<author><persName><forename>Jens</forename><surname>Vöckler</surname></persName>
<affiliation>
<orgName type="team">Information Sciences Institute [California]</orgName>
<country>US</country>
<orgName type="institution">University of Southern California</orgName>
</affiliation>
</author>
<title type="main" level="m">Supporting Experimental Computer Science</title><title type="main" level="m">Supporting Experimental Computer Science</title><imprint><biblScope type="publicationDate">2012-07-31</biblScope><biblScope type="pp">29</biblScope></imprint></monogr><idno type="HALid">http://hal.inria.fr/hal-00722605</idno><idno type="HALFile">http://hal.inria.fr/hal-00722605/PDF/RR-8035.pdf</idno></biblStruct>
</listBibl>
</listBibl>

Supporting Experimental Computer Science

Associated documents

See also

Export