CFIO2: Overlapping Communications and I/O with Computations Using RDMA Technology

Abstract : The output data produced by numerical climate model simulations have increased greatly in complexity and size. The exploding volume of climate data is becoming a challenge for climate scientists. Our previous work, Climate Fast Input/Output (CFIO) library, implemented a two-phase I/O method to overlap I/O with computations, and achieved high throughput. In this paper, we present CFIO2, which can overlap communications with computations using Remote Direct Memory Access(RDMA) technology. We design a simple communication interactions model to implement asynchronous and concurrent data transfer. The experimental results show that CFIO2 can provide higher throughput than CFIO and can shorten the overall simulation time for climate model significantly.
Type de document :
Communication dans un congrès
Ching-Hsien Hsu; Xuanhua Shi; Valentina Salapura. 11th IFIP International Conference on Network and Parallel Computing (NPC), Sep 2014, Ilan, Taiwan. Springer, Lecture Notes in Computer Science, LNCS-8707, pp.542-545, 2014, Network and Parallel Computing. 〈10.1007/978-3-662-44917-2_48〉
Liste complète des métadonnées

Littérature citée [2 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01403137
Contributeur : Hal Ifip <>
Soumis le : vendredi 25 novembre 2016 - 14:45:09
Dernière modification le : vendredi 1 décembre 2017 - 01:10:09
Document(s) archivé(s) le : lundi 20 mars 2017 - 19:26:34

Fichier

978-3-662-44917-2_48_Chapter.p...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Cheng Zhang, Xiaomeng Huang, Yong Hu, Shizhen Xu, Haohuan Fu, et al.. CFIO2: Overlapping Communications and I/O with Computations Using RDMA Technology. Ching-Hsien Hsu; Xuanhua Shi; Valentina Salapura. 11th IFIP International Conference on Network and Parallel Computing (NPC), Sep 2014, Ilan, Taiwan. Springer, Lecture Notes in Computer Science, LNCS-8707, pp.542-545, 2014, Network and Parallel Computing. 〈10.1007/978-3-662-44917-2_48〉. 〈hal-01403137〉

Partager

Métriques

Consultations de la notice

38

Téléchargements de fichiers

27