Skip to Main content Skip to Navigation
Conference papers

Impact of over-decomposition on coordinated checkpoint/rollback protocol

Abstract : Failure free execution will become rare in the future exascale computers. Thus, fault tolerance is now an active field of research. In this paper, we study the impact of decomposing an application in much more parallelism that the physical parallelism on the rollback step of fault tolerant coordinated protocols. This over-decomposition gives the runtime a better opportunity to balance workload after failure without the need of spare nodes, while preserving performance. We show that the overhead on normal execution remains low for relevant factor of over-decomposition. With over-decomposition, restart execution on the remaining nodes after failures shows very good performance compared to classic decomposition approach: our experiments show that the execution time after restart can be reduced by 42 %. We also consider a partial restart protocol to reduce the amount of lost work in case of failure by tracking the task dependencies inside processes. In some cases and thanks to over-decomposition, this partial restart time can represent only 54 % of the global restart time.
Complete list of metadata
Contributor : Grégory Mounié Connect in order to contact the contributor
Submitted on : Tuesday, March 5, 2013 - 11:06:19 AM
Last modification on : Wednesday, July 6, 2022 - 4:11:45 AM

Links full text



Xavier Besseron, Thierry Gautier. Impact of over-decomposition on coordinated checkpoint/rollback protocol. Workshop on Resiliency in High-Performance Computing, 17-th International European Conference On Parallel and Distributed Computing, 2011, Bordeaux, France. ⟨10.1007/978-3-642-29740-3_36⟩. ⟨hal-00796863⟩



Record views