Accéder directement au contenu Accéder directement à la navigation
Communication dans un congrès

Instrumental Data Management and Scientific Workflow Execution: the CEA case study

Francieli Zanon Boito 1, 2, 3 Jean-François Méhaut 2 Thierry Deutsch 4 Brice Videau 4 Frédéric Desprez 3, 2
1 DATAMOVE - Data Aware Large Scale Computing
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
3 CORSE - Compiler Optimization and Run-time Systems
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
4 LSIM - Laboratory of Atomistic Simulation
MEM - Modélisation et Exploration des Matériaux : DRF/IRIG/MEM
Abstract : In this paper, we study a typical scenario in research facilities. Instrumental data is generated by lab equipment such as microscopes, collected by researchers into USB devices, and analyzed in their own computers. In this scenario, an instrumental data management framework could store data in a institutionlevel storage infrastructure and allow to execute tasks to analyze this data in some available processing nodes. This setup has the advantages of promoting reproducible research and the efficient usage of the expensive lab equipment (in addition to increasing researchers productivity). We detail the requirements for such a framework regarding the needs of our case study of the CEA, review existing solutions and recommend the choice of Galaxy. We then analyze the performance limitations of the proposed architecture, and point to the connection between centralized storage and the processing nodes as the critical point. We also conduct a performance evaluation over an experimental platform to observe the limitations encountered in practice. We finish by pointing issues that are not addressed by existing solutions, and are therefore future work perspectives for the research field.
Type de document :
Communication dans un congrès
Liste complète des métadonnées

Littérature citée [18 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-02076963
Contributeur : Francieli Zanon Boito <>
Soumis le : vendredi 22 mars 2019 - 14:53:35
Dernière modification le : jeudi 19 novembre 2020 - 13:02:09
Archivage à long terme le : : dimanche 23 juin 2019 - 15:11:22

Fichier

mpp2019 (1).pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Francieli Zanon Boito, Jean-François Méhaut, Thierry Deutsch, Brice Videau, Frédéric Desprez. Instrumental Data Management and Scientific Workflow Execution: the CEA case study. IPDPSW 2019 - International Parallel and Distributed Processing Symposium Workshops, May 2019, Rio de Janeiro, Brazil. pp.850-857, ⟨10.1109/IPDPSW.2019.00139⟩. ⟨hal-02076963⟩

Partager

Métriques

Consultations de la notice

524

Téléchargements de fichiers

916