Uncoordinated Checkpointing Without Domino Effect for Send-Deterministic MPI Applications

Abstract : — As reported by many recent studies, the mean time between failures of future post-petascale su-percomputers is likely to reduce, compared to the current situation. The most popular fault tolerance approach for MPI applications on HPC Platforms relies on coordinated checkpointing which raises two major issues: a) global restart wastes energy since all processes are forced to rollback even in the case of a single failure; b) checkpoint coordination may slow down the application execution because of congestions on I/O resources. Alternative approaches based on uncoordinated checkpointing and message logging require logging all messages, imposing a high memory/storage occupation and a significant overhead on communications. It has recently been observed that many MPI HPC applications are send-deterministic, allowing to design new fault tolerance protocols. In this paper, we propose an uncoordinated checkpointing protocol for send-deterministic MPI HPC applications that (i) logs only a subset of the application messages and (ii) does not require to restart systematically all processes when a failure occurs. We first describe our protocol and prove its correctness. Through experimental evaluations, we show that its implementation in MPICH2 has a negligible overhead on application performance. Then we perform a quantitative evaluation of the properties of our protocol using the NAS Benchmarks. Using a clustering approach, we demonstrate that this protocol actually succeeds to combine the two expected properties: a) it logs only a small fraction of the messages and b) it reduces by a factor approaching 2 the average number of processes to rollback compared to coordinated checkpointing.
Type de document :
Communication dans un congrès
25th IEEE International Parallel \& Distributed Processing Symposium (IPDPS2011), 2011, Anchorage, United States. 2011, 〈10.1109/IPDPS.2011.95〉
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01121937
Contributeur : Thomas Ropars <>
Soumis le : lundi 2 mars 2015 - 21:06:28
Dernière modification le : vendredi 31 août 2018 - 09:14:36
Document(s) archivé(s) le : mardi 2 juin 2015 - 09:55:33

Fichier

ipdps2011.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Amina Guermouche, Thomas Ropars, Elisabeth Brunet, Marc Snir, Franck Cappello. Uncoordinated Checkpointing Without Domino Effect for Send-Deterministic MPI Applications. 25th IEEE International Parallel \& Distributed Processing Symposium (IPDPS2011), 2011, Anchorage, United States. 2011, 〈10.1109/IPDPS.2011.95〉. 〈hal-01121937〉

Partager

Métriques

Consultations de la notice

481

Téléchargements de fichiers

142