Skip to Main content Skip to Navigation
Conference papers

CFIO2: Overlapping Communications and I/O with Computations Using RDMA Technology

Abstract : The output data produced by numerical climate model simulations have increased greatly in complexity and size. The exploding volume of climate data is becoming a challenge for climate scientists. Our previous work, Climate Fast Input/Output (CFIO) library, implemented a two-phase I/O method to overlap I/O with computations, and achieved high throughput. In this paper, we present CFIO2, which can overlap communications with computations using Remote Direct Memory Access(RDMA) technology. We design a simple communication interactions model to implement asynchronous and concurrent data transfer. The experimental results show that CFIO2 can provide higher throughput than CFIO and can shorten the overall simulation time for climate model significantly.
Document type :
Conference papers
Complete list of metadata

Cited literature [2 references]  Display  Hide  Download

https://hal.inria.fr/hal-01403137
Contributor : Hal Ifip <>
Submitted on : Friday, November 25, 2016 - 2:45:09 PM
Last modification on : Tuesday, June 1, 2021 - 2:34:10 PM
Long-term archiving on: : Monday, March 20, 2017 - 7:26:34 PM

File

978-3-662-44917-2_48_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Cheng Zhang, Xiaomeng Huang, Yong Hu, Shizhen Xu, Haohuan Fu, et al.. CFIO2: Overlapping Communications and I/O with Computations Using RDMA Technology. 11th IFIP International Conference on Network and Parallel Computing (NPC), Sep 2014, Ilan, Taiwan. pp.542-545, ⟨10.1007/978-3-662-44917-2_48⟩. ⟨hal-01403137⟩

Share

Metrics

Record views

121

Files downloads

293