aIOLi: an input/output library for cluster of SMP

Adrien Lèbre 1 Yves Denneulin 1, 2
2 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : As clusters use grows, lots of scientific applications (biology, climatology, nuclear physics...) have been rewritten to fully exploit this extra CPU power and storage capacity. This kind of software uses and creates huge amounts of data with typical parallel I/O access patterns. Several issues, like "out-of-core limitation" or "efficient parallel input/output access" already known in a local context (on SMP nodes for example), have to be handled in a distributed environment such as a cluster. Several solutions have been proposed by the scientific community to handle these issues, like parallel file systems or parallel I/O libraries, but their specific API limits portability and requires good knowledge of their internal mechanisms. This paper presents an efficient I/O library, aIOLi, for parallel access to remote storages in SMP clusters. Thanks to the SMP kernel features, our framework provides parallel I/O without inter-processes synchronization mechanisms as well as a simple interface based on the classic UNIX system calls (creat/open/read/write/close). Our experiments show that the aIOLi solution allows achieving performance close to the limits of the remote storage system.
Type de document :
Communication dans un congrès
Cluster Computing and the Grid, 2005. CCGrid 2005. IEEE International Symposium on, May 2005, Cardiff, United Kingdom. 2005, 〈10.1109/CCGRID.2005.1558684〉
Liste complète des métadonnées

https://hal.inria.fr/hal-00687248
Contributeur : Ist Rennes <>
Soumis le : jeudi 12 avril 2012 - 16:39:53
Dernière modification le : mercredi 11 avril 2018 - 01:55:43

Identifiants

Collections

Citation

Adrien Lèbre, Yves Denneulin. aIOLi: an input/output library for cluster of SMP. Cluster Computing and the Grid, 2005. CCGrid 2005. IEEE International Symposium on, May 2005, Cardiff, United Kingdom. 2005, 〈10.1109/CCGRID.2005.1558684〉. 〈hal-00687248〉

Partager

Métriques

Consultations de la notice

256