Skip to Main content Skip to Navigation
Conference papers

Towards a storage backend optimized for atomic MPI-I/O for parallel scientific applications

Viet-Trung Tran 1
1 KerData - Scalable Storage for Clouds and Beyond
Inria Rennes – Bretagne Atlantique , IRISA-D1 - SYSTÈMES LARGE ÉCHELLE
Abstract : We consider the challenges of building data management systems that are optimized for parallel I/O of scientific applications. One of those challenges focuses on the requirement of high I/O throughput for concurrent data accesses while obeying MPI atomicity semantics. In most existing implementations, the atomicity is often implemented through locking-based schemes, which have proven inefficient. In this proposal, we argue that a novel versioning-based scheme can avoid the need to perform expensive synchronization by using multiple snapshots of the same data, which is much more efficient. We describe our prototype of a versioning-based storage back-end and report on promising experimental results.
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download

https://hal.inria.fr/inria-00627667
Contributor : Viet-Trung Tran <>
Submitted on : Thursday, September 29, 2011 - 12:03:02 PM
Last modification on : Friday, July 10, 2020 - 4:26:03 PM
Long-term archiving on: : Friday, December 30, 2011 - 2:25:30 AM

File

paper.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00627667, version 1

Citation

Viet-Trung Tran. Towards a storage backend optimized for atomic MPI-I/O for parallel scientific applications. Parallel and Distributed Processing Workshops and Phd Forum (IPDPSW), May 2011, Anchorage, United States. ⟨inria-00627667⟩

Share

Metrics

Record views

382

Files downloads

375