Skip to Main content Skip to Navigation
Journal articles

Composing resilience techniques: ABFT, periodic and incremental checkpointing

Abstract : Algorithm Based Fault Tolerant (ABFT) approaches promise unparalleled scalability and performance in failure-prone environments. Thanks to recent advances in the understanding of the involved mechanisms, a growing number of important algorithms (including all widely used factorizations) have been proven ABFT-capable. In the context of larger applications, these algorithms provide a temporal section of the execution, where the data is protected by its own intrinsic properties, and can therefore be algorithmically recomputed without the need of checkpoints. However, while typical scientific applications spend a significant fraction of their execution time in library calls that can be ABFT-protected, they interleave sections that are difficult or even impossible to protect with ABFT. As a consequence, the only practical fault-tolerance approach for these applications is checkpoint/restart. In this paper we propose a model to investigate the efficiency of a composite protocol, that alternates between ABFT and checkpoint/restart for the effective protection of an iterative application composed of ABFT- aware and ABFT-unaware sections. We also consider an incremental checkpointing composite approach in which the algorithmic knowledge is leveraged by a novel optimal dynamic program- ming to compute checkpoint dates. We validate these models using a simulator. The model and simulator show that the composite approach drastically increases the performance delivered by an execution platform, especially at scale, by providing the means to increase the interval between checkpoints while simultaneously decreasing the volume of each checkpoint.
Document type :
Journal articles
Complete list of metadata
Contributor : Equipe Roma Connect in order to contact the contributor
Submitted on : Sunday, December 7, 2014 - 9:06:14 PM
Last modification on : Friday, September 30, 2022 - 4:12:08 AM


  • HAL Id : hal-01091930, version 1



George Bosilca, Aurélien Bouteiller, Thomas Herault, Yves Robert, Jack Dongarra. Composing resilience techniques: ABFT, periodic and incremental checkpointing. International Journal of Networking and Computing, Higashi Hiroshima : Dept. of Computer Engineering, Hiroshima University, 2015, 5 (1), pp.2-25. ⟨hal-01091930⟩



Record views