What size should your Burst-Buffers be?

Guillaume Aupy 1 Olivier Beaumont 2 Lionel Eyraud-Dubois 2
1 TADAAM - Topology-Aware System-Scale Data Management for High-Performance Computing
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
2 Realopt - Reformulations based algorithms for Combinatorial Optimization
LaBRI - Laboratoire Bordelais de Recherche en Informatique, IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : Burst-Buffers are high throughput, small size intermediate storage systems typically based on SSDs or NVRAM that are designed to be used as a potential buffer between the computing nodes of a supercomputer and its main storage system consisting of hard drives. Their purpose is to absorb the bursts of I/O that many HPC applications experience (for example for saving checkpoints or data from intermediate results). In this paper, we propose a probabilistic model for evaluating the performance of Burst-Buffers. From a model of application and a data management strategy, we build a Markov chain based model of the system, that allows to quickly answer issues about dimensioning of the system: for a given set of applications, and for a given Burst-Buffer size and bandwidth, how often does the buffer overflow? We also provide extensive simulation results to validate our modeling approach.
Type de document :
Pré-publication, Document de travail
2017
Liste complète des métadonnées

Littérature citée [26 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01623846
Contributeur : Olivier Beaumont <>
Soumis le : mercredi 25 octobre 2017 - 17:12:00
Dernière modification le : mardi 17 avril 2018 - 09:04:35
Document(s) archivé(s) le : vendredi 26 janvier 2018 - 14:38:34

Fichier

mainRR.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01623846, version 1

Collections

Citation

Guillaume Aupy, Olivier Beaumont, Lionel Eyraud-Dubois. What size should your Burst-Buffers be?. 2017. 〈hal-01623846〉

Partager

Métriques

Consultations de la notice

263

Téléchargements de fichiers

99