Composing resilience techniques: ABFT, periodic and incremental checkpointing - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue International Journal of Networking and Computing Année : 2015

Composing resilience techniques: ABFT, periodic and incremental checkpointing

Résumé

Algorithm Based Fault Tolerant (ABFT) approaches promise unparalleled scalability and performance in failure-prone environments. Thanks to recent advances in the understanding of the involved mechanisms, a growing number of important algorithms (including all widely used factorizations) have been proven ABFT-capable. In the context of larger applications, these algorithms provide a temporal section of the execution, where the data is protected by its own intrinsic properties, and can therefore be algorithmically recomputed without the need of checkpoints. However, while typical scientific applications spend a significant fraction of their execution time in library calls that can be ABFT-protected, they interleave sections that are difficult or even impossible to protect with ABFT. As a consequence, the only practical fault-tolerance approach for these applications is checkpoint/restart. In this paper we propose a model to investigate the efficiency of a composite protocol, that alternates between ABFT and checkpoint/restart for the effective protection of an iterative application composed of ABFT- aware and ABFT-unaware sections. We also consider an incremental checkpointing composite approach in which the algorithmic knowledge is leveraged by a novel optimal dynamic program- ming to compute checkpoint dates. We validate these models using a simulator. The model and simulator show that the composite approach drastically increases the performance delivered by an execution platform, especially at scale, by providing the means to increase the interval between checkpoints while simultaneously decreasing the volume of each checkpoint.
Fichier non déposé

Dates et versions

hal-01091930 , version 1 (07-12-2014)

Identifiants

  • HAL Id : hal-01091930 , version 1

Citer

George Bosilca, Aurélien Bouteiller, Thomas Herault, Yves Robert, Jack Dongarra. Composing resilience techniques: ABFT, periodic and incremental checkpointing. International Journal of Networking and Computing, 2015, 5 (1), pp.2-25. ⟨hal-01091930⟩
287 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More