Skip to Main content Skip to Navigation

Estimation of the impact of I/O forwarding on application performance

Abstract : In high performance computing architectures, the I/O forwarding technique is often used to alleviate contention in the access to the shared parallel file system servers. Intermediate I/O nodes are placed between compute nodes and these servers, and are responsible for forwarding requests. In this scenario, it is important to properly distribute the number of available I/O nodes among the running jobs to promote an efficient usage of these resources and improve I/O performance. However, the impact different numbers of I/O nodes have on an application bandwidth depends on its characteristics. In this report, we explore the idea of predicting application performance by extracting information from a coarse-grained aggregated trace from a previous execution, and then using this information to match each of the application's I/O phases to an equivalent benchmark, for which we could have performance results. We test this idea by applying it to five different applications over three case studies, and find a mean error of approximately 20%. We extensively discuss the obtained results and limitations to the approach, pointing at future work opportunities.
Complete list of metadata

Cited literature [12 references]  Display  Hide  Download
Contributor : Francieli Zanon Boito Connect in order to contact the contributor
Submitted on : Friday, October 16, 2020 - 7:03:00 PM
Last modification on : Saturday, December 4, 2021 - 3:07:27 AM
Long-term archiving on: : Sunday, January 17, 2021 - 11:36:29 PM


Files produced by the author(s)


  • HAL Id : hal-02969780, version 1


Francieli Zanon Boito. Estimation of the impact of I/O forwarding on application performance. [Research Report] RR-9366, Inria. 2020, pp.20. ⟨hal-02969780⟩



Record views


Files downloads