HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Hierarchical Clustering Strategies for Fault Tolerance in Large Scale HPC Systems

Abstract : Future high performance computing systems will need to use novel techniques to allow scientific applications to progress despite frequent failures. Checkpoint-Restart is currently the most popular way to mitigate the impact of failures during long-running executions. Different techniques try to reduce the cost of Checkpoint-Restart, some of them such as local checkpointing and erasure codes aim to reduce the time to checkpoint while others such as uncoordinated checkpoint and message-logging aim to decrease the cost of recovery. In this paper, we study how to combine all these techniques together in order to optimize both: checkpointing and recovery. We present several clustering and topology challenges that lead us to an optimization problem in a four-dimensional space: reliability level, recovery cost, encoding time and message logging overhead. We propose a novel clustering method inspired from brain topology studies in neuroscience and evaluate it with a Tsunami simulation application in TSUBAME2. Our evaluation with 1024 processes shows that our novel clustering method can guarantee good performance for all of the four mentioned dimensions of our optimization problem.
Complete list of metadata

Cited literature [27 references]  Display  Hide  Download

Contributor : Thomas Ropars Connect in order to contact the contributor
Submitted on : Monday, March 2, 2015 - 9:49:59 PM
Last modification on : Thursday, July 8, 2021 - 3:49:23 AM
Long-term archiving on: : Sunday, May 31, 2015 - 11:35:22 AM


Files produced by the author(s)



Leonardo Bautista-Gomez, Thomas Ropars, Naoya Maruyama, Franck Cappello, Satoshi Matsuoka. Hierarchical Clustering Strategies for Fault Tolerance in Large Scale HPC Systems. IEEE Cluster 2012, 2012, Beijing, China. ⟨10.1109/CLUSTER.2012.71⟩. ⟨hal-01121947⟩



Record views


Files downloads