Skip to Main content Skip to Navigation
Conference papers

Design and Comparison of Resilient Scheduling Heuristics for Parallel Jobs

Abstract : This paper focuses on the resilient scheduling of parallel jobs on high-performance computing (HPC) platforms to minimize the overall completion time, or makespan. We revisit the classical problem while assuming that jobs are subject to transient or silent errors, and hence may need to be re-executed each time they fail to complete successfully. This work generalizes the classical framework where jobs are known offline and do not fail: in the classical framework, list scheduling that gives priority to longest jobs is known to be a 3-approximation when imposing to use shelves, and a 2-approximation without this restriction. We show that when jobs can fail, using shelves can be arbitrarily bad, but unrestricted list scheduling remains a 2-approximation. The paper focuses on the design of several heuristics, some list-based and some shelf-based, along with different priority rules and backfilling strategies. We assess and compare their performance through an extensive set of simulations, using both synthetic jobs and log traces from the Mira supercomputer.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/hal-03029842
Contributor : Equipe Roma <>
Submitted on : Monday, November 30, 2020 - 8:58:31 PM
Last modification on : Thursday, December 3, 2020 - 1:27:36 PM

File

rigid_apdcm_hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03029842, version 1

Collections

Citation

Anne Benoit, Valentin Le Fèvre, Padma Raghavan, Yves Robert, Hongyang Sun. Design and Comparison of Resilient Scheduling Heuristics for Parallel Jobs. APDCM 2020 - Workshop on Advances in Parallel and Distributed Computational Models (colocated with IPDPS), May 2020, New Orleans, LA, United States. pp.1-27. ⟨hal-03029842⟩

Share

Metrics

Record views

9

Files downloads

46