Data Redistribution using One-sided Transfers to In-memory HDF5 Files - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2011

Data Redistribution using One-sided Transfers to In-memory HDF5 Files

Abstract

Outputs of simulation codes making use of the HDF5 file format are usually and mainly composed of several different attributes and datasets, storing either lightweight pieces of information or containing heavy parts of data. These objects, when written or read through the HDF5 layer, create metadata and data IO operations of different block sizes, which depend on the precision and dimension of the arrays that are being manipulated. By making use of simple block redistribution strategies, we present in this paper a case study showing HDF5 IO performance improvements for "in-memory" files stored in a distributed shared memory buffer using one-sided communications through the HDF5 API.
Fichier principal
Vignette du fichier
paper_41.pdf (186.67 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00648396 , version 1 (05-12-2011)

Identifiers

Cite

Jérome Soumagne, John Biddiscombe, Aurélien Esnard. Data Redistribution using One-sided Transfers to In-memory HDF5 Files. Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface, 2011, Santorini, Greece. pp.198--207, ⟨10.1007/978-3-642-24449-0_23⟩. ⟨hal-00648396⟩

Collections

CNRS INRIA INRIA2
184 View
236 Download

Altmetric

Share

Gmail Facebook X LinkedIn More