Skip to Main content Skip to Navigation
Conference papers

When Amdahl Meets Young/Daly

Abstract : This paper investigates the optimal number of processors to execute a parallel job, whose speedup profile obeys Amdahl's law, on a large-scale platform subject to fail-stop and silent errors. We combine the traditional checkpointing and rollback recovery strategies with verification mechanisms to cope with both error sources. We provide an exact formula to express the execution overhead incurred by a periodic checkpointing pattern of length T and with P processors, and we give first-order approximations for the optimal values T * and P * as a function of the individual processor failure rate λind. A striking result is that P * is of the order λ −1/4 ind if the checkpointing cost grows linearly with the number of processors, and of the order λ −1/3 ind if the checkpointing cost stays bounded for any P. We conduct an extensive set of simulations to support the theoretical study. The results confirm the accuracy of first-order approximation under a wide range of parameter settings.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/hal-01355963
Contributor : Equipe Roma <>
Submitted on : Wednesday, August 24, 2016 - 3:23:41 PM
Last modification on : Wednesday, November 20, 2019 - 3:18:36 AM
Long-term archiving on: : Friday, November 25, 2016 - 1:44:17 PM

File

cluster2016.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01355963, version 1

Collections

Citation

Aurélien Cavelan, Jiafan Li, Yves Robert, Hongyang Sun. When Amdahl Meets Young/Daly. Cluster'2016, Sep 2016, Taipei, Taiwan, France. ⟨hal-01355963⟩

Share

Metrics

Record views

354

Files downloads

216