Skip to Main content Skip to Navigation
New interface
Conference papers

Efficient support for MPI-IO atomicity based on versioning

Viet-Trung Tran 1 Bogdan Nicolae 1 Gabriel Antoniu 1 Luc Bougé 1 
1 KerData - Scalable Storage for Clouds and Beyond
Inria Rennes – Bretagne Atlantique , IRISA-D1 - SYSTÈMES LARGE ÉCHELLE
Abstract : We consider the challenge of building data management systems that meet an important requirement of today's data-intensive HPC applications: to provide a high I/O throughput while supporting highly concurrent data accesses. In this context, many applications rely on MPI-IO and require atomic, non-contiguous I/O operations that concurrently access shared data. In most existing implementations the atomicity requirement is often implemented through locking-based schemes, which have proven inefficient, especially for non-contiguous I/O. We claim that using a versioning-enabled storage backend has the potential to avoid expensive synchronization as exhibited by locking-based schemes, which is much more efficient. We describe a prototype implementation on top of ROMIO along this idea, and report on promising experimental results with standard MPI-IO benchmarks specifically designed to evaluate the performance of non-contiguous, overlapped I/O accesses under MPI atomicity guarantees.
Complete list of metadata
Contributor : Gabriel Antoniu Connect in order to contact the contributor
Submitted on : Friday, February 11, 2011 - 8:33:23 PM
Last modification on : Thursday, January 20, 2022 - 4:20:13 PM

Links full text



Viet-Trung Tran, Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Efficient support for MPI-IO atomicity based on versioning. 11th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGrid 2011), May 2011, Newport Beach, CA, United States. pp.514-523, ⟨10.1109/CCGrid.2011.60⟩. ⟨inria-00565358⟩



Record views