Efficient support for MPI-IO atomicity based on versioning

Viet-Trung Tran 1 Bogdan Nicolae 1 Gabriel Antoniu 1 Luc Bougé 1
1 KerData - Scalable Storage for Clouds and Beyond
Inria Rennes – Bretagne Atlantique , IRISA-D1 - SYSTÈMES LARGE ÉCHELLE
Abstract : We consider the challenge of building data management systems that meet an important requirement of today's data-intensive HPC applications: to provide a high I/O throughput while supporting highly concurrent data accesses. In this context, many applications rely on MPI-IO and require atomic, non-contiguous I/O operations that concurrently access shared data. In most existing implementations the atomicity requirement is often implemented through locking-based schemes, which have proven inefficient, especially for non-contiguous I/O. We claim that using a versioning-enabled storage backend has the potential to avoid expensive synchronization as exhibited by locking-based schemes, which is much more efficient. We describe a prototype implementation on top of ROMIO along this idea, and report on promising experimental results with standard MPI-IO benchmarks specifically designed to evaluate the performance of non-contiguous, overlapped I/O accesses under MPI atomicity guarantees.
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download

https://hal.inria.fr/inria-00546956
Contributor : Viet-Trung Tran <>
Submitted on : Wednesday, December 15, 2010 - 11:17:14 AM
Last modification on : Friday, November 16, 2018 - 1:40:36 AM
Long-term archiving on : Wednesday, March 16, 2011 - 2:55:27 AM

File

RR-7487.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00546956, version 1

Citation

Viet-Trung Tran, Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Efficient support for MPI-IO atomicity based on versioning. [Research Report] RR-7487, INRIA. 2010, pp.24. ⟨inria-00546956⟩

Share

Metrics

Record views

485

Files downloads

358