What Size Should your Buffers to Disks be? - Archive ouverte HAL Access content directly
Conference Papers Year : 2018

What Size Should your Buffers to Disks be?

(1) , (2) , (2)
1
2

Abstract

Burst-Buffers are high throughput, small size intermediate storage systems typically based on SSDs or NVRAM that are designed to be used as a potential buffer between the computing nodes of a supercomputer and its main storage system consisting of hard drives. Their purpose is to absorb the bursts of I/O that many HPC applications experience (for example for saving checkpoints or data from intermediate results). In this paper, we propose a probabilistic model for evaluating the performance of Burst-Buffers. From a model of application and a data management strategy, we build a Markov chain based model of the system, that allows to quickly answer issues about dimensioning of the system: for a given set of applications, and for a given Burst-Buffer size and bandwidth, how often does the buffer overflow? We also provide extensive simulation results to validate our modeling approach.
Fichier principal
Vignette du fichier
main-v2.pdf (480.01 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01623846 , version 1 (25-10-2017)
hal-01623846 , version 2 (13-07-2018)

Identifiers

Cite

Guillaume Aupy, Olivier Beaumont, Lionel Eyraud-Dubois. What Size Should your Buffers to Disks be?. International Parallel and Distributed Processing Symposium (IPDPS), May 2018, Vancouver, Canada. ⟨10.1109/IPDPS.2018.00075⟩. ⟨hal-01623846v2⟩
287 View
394 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More