Efficient support for MPI-IO atomicity based on versioning

Viet-Trung Tran 1 Bogdan Nicolae 1 Gabriel Antoniu 1 Luc Bougé 1
1 KerData - Scalable Storage for Clouds and Beyond
Inria Rennes – Bretagne Atlantique , IRISA-D1 - SYSTÈMES LARGE ÉCHELLE
Abstract : We consider the challenge of building data management systems that meet an important requirement of today's data-intensive HPC applications: to provide a high I/O throughput while supporting highly concurrent data accesses. In this context, many applications rely on MPI-IO and require atomic, non-contiguous I/O operations that concurrently access shared data. In most existing implementations the atomicity requirement is often implemented through locking-based schemes, which have proven inefficient, especially for non-contiguous I/O. We claim that using a versioning-enabled storage backend has the potential to avoid expensive synchronization as exhibited by locking-based schemes, which is much more efficient. We describe a prototype implementation on top of ROMIO along this idea, and report on promising experimental results with standard MPI-IO benchmarks specifically designed to evaluate the performance of non-contiguous, overlapped I/O accesses under MPI atomicity guarantees.
Complete list of metadatas

https://hal.inria.fr/inria-00565358
Contributor : Gabriel Antoniu <>
Submitted on : Friday, February 11, 2011 - 8:33:23 PM
Last modification on : Friday, November 16, 2018 - 1:40:44 AM

Links full text

Identifiers

Citation

Viet-Trung Tran, Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Efficient support for MPI-IO atomicity based on versioning. 11th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGrid 2011), May 2011, Newport Beach, CA, United States. pp.514-523, ⟨10.1109/CCGrid.2011.60⟩. ⟨inria-00565358⟩

Share

Metrics

Record views

410