Skip to Main content Skip to Navigation
Reports

Damaris: Leveraging Multicore Parallelism to Mask I/O Jitter

Matthieu Dorier 1 Gabriel Antoniu 2 Franck Cappello 3, 4, 5 Marc Snir 6 Leigh Orf 7
2 KerData - Scalable Storage for Clouds and Beyond
IRISA-D1 - SYSTÈMES LARGE ÉCHELLE, Inria Rennes – Bretagne Atlantique
3 GRAND-LARGE - Global parallel and distributed computing
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LIFL - Laboratoire d'Informatique Fondamentale de Lille, LRI - Laboratoire de Recherche en Informatique
Abstract : With exascale computing on the horizon, the performance variability of I/O systems represents a key challenge in sustaining high performance. In many HPC applications, I/O is concurrently performed by all processes, which leads to I/O bursts. This causes resource contention and substantial variability of I/O performance, which significantly impacts the overall application performance. In this paper, we first explore the influence of user-configurable parameters and I/O approaches on write performance variability. We then propose a new approach, called Damaris, which leverages dedicated I/O cores on each multicore SMP node to efficiently perform asynchronous data processing and I/O. We evaluate our approach on two different platforms including the Kraken Cray XT5 supercomputer, with the CM1 atmospheric model, which is one of the target HPC applications for the Blue Waters project. By gathering data into large files while avoiding synchronization between cores, our solution brings several benefits: 1) it increases the sustained write throughput by a factor of almost 15; 2) it provides almost 70\% overall application speedup on 9K cores; 3) it fully hides I/O-related costs; 4) it enables a 600\% compression ratio without any additional overhead, leading to a major reduction of storage requirements.
Complete list of metadatas

https://hal.inria.fr/inria-00614597
Contributor : Matthieu Dorier <>
Submitted on : Tuesday, December 6, 2011 - 5:11:13 PM
Last modification on : Monday, December 9, 2019 - 5:24:06 PM
Document(s) archivé(s) le : Wednesday, March 7, 2012 - 3:05:31 AM

Files

RR-7706.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00614597, version 2

Collections

Citation

Matthieu Dorier, Gabriel Antoniu, Franck Cappello, Marc Snir, Leigh Orf. Damaris: Leveraging Multicore Parallelism to Mask I/O Jitter. [Research Report] RR-7706, 2011, pp.33. ⟨inria-00614597v2⟩

Share

Metrics

Record views

104

Files downloads

121