Failure Detection and Propagation in HPC systems

Abstract : Building an infrastructure for Exascale applications requires, in addition to many other key components, a stable and efficient failure detector. This paper describes the design and evaluation of a robust failure detector, able to maintain and distribute the correct list of alive resources within proven and scalable bounds. The detection and distribution of the fault information follow different overlay topologies that together guarantee minimal disturbance to the applications. A virtual observation ring minimizes the overhead by allowing each node to be observed by another single node, providing an unobtrusive behavior. The propagation stage is using a non-uniform variant of a reliable broadcast over a circulant graph overlay network, and guarantees a logarithmic fault propagation. Extensive simulations, together with experiments on the Titan ORNL supercomputer, show that the algorithm performs extremely well, and exhibits all the desired properties of an Exascale-ready algorithm.
Complete list of metadatas

Cited literature [28 references]  Display  Hide  Download

https://hal.inria.fr/hal-01352109
Contributor : Pierre Sens <>
Submitted on : Wednesday, October 26, 2016 - 3:22:56 PM
Last modification on : Wednesday, June 12, 2019 - 1:34:50 AM

File

sc16-hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01352109, version 1

Citation

George Bosilca, Aurélien Bouteiller, Amina Guermouche, Thomas Hérault, Yves Robert, et al.. Failure Detection and Propagation in HPC systems. SC 2016 - The International Conference for High Performance Computing, Networking, Storage and Analysis, Nov 2016, Salt Lake City, United States. ⟨hal-01352109⟩

Share

Metrics

Record views

857

Files downloads

496