Omnisc'IO: A Grammar-Based Approach to Spatial and Temporal I/O Patterns Prediction

Matthieu Dorier 1, 2 Shadi Ibrahim 1 Gabriel Antoniu 1 Robert Ross 3
1 KerData - Scalable Storage for Clouds and Beyond
IRISA-D1 - SYSTÈMES LARGE ÉCHELLE, Inria Rennes – Bretagne Atlantique
3 MCS
ANL - Argonne National Laboratory [Lemont]
Abstract : The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching and scheduling techniques. To further improve these techniques, modeling and predicting spatial and temporal I/O patterns of HPC applications as they run has became crucial. In this paper we present Omnisc'IO, an approach that builds a grammar-based model of the I/O behavior of any HPC application, and uses it to predict when future I/O operations will occur, where and how much data will be accessed. Omnisc'IO is transparently integrated into the POSIX and MPI I/O stacks, and does not require any modification in applications or higher level I/O libraries. It works without any prior knowledge of the application, and converges towards accurate predictions within a couple of iterations only. Its implementation is very efficient both in computation time and memory footprint.
Type de document :
Communication dans un congrès
SC14 - International Conference for High Performance Computing, Networking, Storage and Analysis, Nov 2014, New Orleans, United States. 2014
Liste complète des métadonnées

Littérature citée [30 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01025670
Contributeur : Matthieu Dorier <>
Soumis le : jeudi 24 juillet 2014 - 09:38:55
Dernière modification le : mercredi 16 mai 2018 - 11:23:28
Document(s) archivé(s) le : lundi 24 novembre 2014 - 19:46:11

Fichier

paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01025670, version 1

Citation

Matthieu Dorier, Shadi Ibrahim, Gabriel Antoniu, Robert Ross. Omnisc'IO: A Grammar-Based Approach to Spatial and Temporal I/O Patterns Prediction. SC14 - International Conference for High Performance Computing, Networking, Storage and Analysis, Nov 2014, New Orleans, United States. 2014. 〈hal-01025670〉

Partager

Métriques

Consultations de la notice

869

Téléchargements de fichiers

480