On the Root Causes of Cross-Application I/O Interference in HPC Storage Systems

Abstract : —As we move toward the exascale era, performance variability in HPC systems remains a challenge. I/O interference , a major cause of this variability, is becoming more important every day with the growing number of concurrent applications that share larger machines. Earlier research efforts on mitigating I/O interference focus on a single potential cause of interference (e.g., the network). Yet the root causes of I/O interference can be diverse. In this work, we conduct an extensive experimental campaign to explore the various root causes of I/O interference in HPC storage systems. We use microbenchmarks on the Grid'5000 testbed to evaluate how the applications' access pattern, the network components, the file system's configuration, and the backend storage devices influence I/O interference. Our studies reveal that in many situations interference is a result of bad flow control in the I/O path, rather than being caused by some single bottleneck in one of its components. We further show that interference-free behavior is not necessarily a sign of optimal performance. To the best of our knowledge, our work provides the first deep insight into the role of each of the potential root causes of interference and their interplay. Our findings can help developers and platform owners improve I/O performance and motivate further research addressing the problem across all components of the I/O stack.
Type de document :
Communication dans un congrès
IPDPS 2016 - The 30th IEEE International Parallel and Distributed Processing Symposium, May 2016, Chicago, United States
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01270630
Contributeur : Orçun Yildiz <>
Soumis le : lundi 8 février 2016 - 11:53:00
Dernière modification le : mercredi 2 août 2017 - 10:09:43
Document(s) archivé(s) le : samedi 12 novembre 2016 - 13:30:21

Fichier

IPDPS'16-CR.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01270630, version 1

Citation

Orcun Yildiz, Matthieu Dorier, Shadi Ibrahim, Robert Ross, Gabriel Antoniu. On the Root Causes of Cross-Application I/O Interference in HPC Storage Systems. IPDPS 2016 - The 30th IEEE International Parallel and Distributed Processing Symposium, May 2016, Chicago, United States. 〈hal-01270630〉

Partager

Métriques

Consultations de la notice

606

Téléchargements de fichiers

274