Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

What size should your Burst-Buffers be?

Guillaume Aupy 1 Olivier Beaumont 2 Lionel Eyraud-Dubois 2
1 TADAAM - Topology-Aware System-Scale Data Management for High-Performance Computing
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
2 Realopt - Reformulations based algorithms for Combinatorial Optimization
LaBRI - Laboratoire Bordelais de Recherche en Informatique, IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : Burst-Buffers are high throughput, small size intermediate storage systems typically based on SSDs or NVRAM that are designed to be used as a potential buffer between the computing nodes of a supercomputer and its main storage system consisting of hard drives. Their purpose is to absorb the bursts of I/O that many HPC applications experience (for example for saving checkpoints or data from intermediate results). In this paper, we propose a probabilistic model for evaluating the performance of Burst-Buffers. From a model of application and a data management strategy, we build a Markov chain based model of the system, that allows to quickly answer issues about dimensioning of the system: for a given set of applications, and for a given Burst-Buffer size and bandwidth, how often does the buffer overflow? We also provide extensive simulation results to validate our modeling approach.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [24 references]  Display  Hide  Download

https://hal.inria.fr/hal-01623846
Contributor : Olivier Beaumont <>
Submitted on : Wednesday, October 25, 2017 - 5:12:00 PM
Last modification on : Thursday, January 9, 2020 - 9:56:10 AM
Long-term archiving on: : Friday, January 26, 2018 - 2:38:34 PM

File

mainRR.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01623846, version 1

Collections

Citation

Guillaume Aupy, Olivier Beaumont, Lionel Eyraud-Dubois. What size should your Burst-Buffers be?. 2017. ⟨hal-01623846v1⟩

Share

Metrics

Record views

313

Files downloads

117