Resilience and fault tolerance in high-performance computing for numerical weather and climate prediction - Archive ouverte HAL Access content directly
Journal Articles International Journal of High Performance Computing Applications Year : 2021

Resilience and fault tolerance in high-performance computing for numerical weather and climate prediction

Abstract

Progress in numerical weather and climate prediction accuracy greatly depends on the growth of the available computing power. As the number of cores in top computing facilities pushes into the millions, increased average frequency of hardware and software failures forces users to review their algorithms and systems in order to protect simulations from breakdown. This report surveys hardware, application-level and algorithm-level resilience approaches of particular relevance to timecritical numerical weather and climate prediction systems. A selection of applicable existing strategies is analysed, featuring interpolation-restart and compressed checkpointing for the numerical schemes, in-memory checkpointing, user-level failure mitigation and backup-based methods for the systems. Numerical examples showcase the performance of the techniques in addressing faults, with particular emphasis on iterative solvers for linear systems, a staple of atmospheric fluid flow solvers. The potential impact of these strategies is discussed in relation to current development of numerical weather prediction algorithms and systems towards the exascale. Trade-offs between performance, efficiency and effectiveness of resiliency strategies are analysed and some recommendations outlined for future developments.
Fichier principal
Vignette du fichier
1094342021990433.pdf (1.67 Mo) Télécharger le fichier
Origin : Publication funded by an institution

Dates and versions

hal-03138061 , version 1 (10-02-2021)

Identifiers

Cite

Tommaso Benacchio, Luca Bonaventura, Mirco Altenbernd, Chris D Cantwell, Peter D Düben, et al.. Resilience and fault tolerance in high-performance computing for numerical weather and climate prediction. International Journal of High Performance Computing Applications, 2021, 35 (4), pp.285-311. ⟨10.1177/1094342021990433⟩. ⟨hal-03138061⟩
73 View
78 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More