Skip to Main content Skip to Navigation
Conference papers

When Amdahl Meets Young/Daly

Abstract : This paper investigates the optimal number of processors to execute a parallel job, whose speedup profile obeys Amdahl's law, on a large-scale platform subject to fail-stop and silent errors. We combine the traditional checkpointing and rollback recovery strategies with verification mechanisms to cope with both error sources. We provide an exact formula to express the execution overhead incurred by a periodic checkpointing pattern of length T and with P processors, and we give first-order approximations for the optimal values T * and P * as a function of the individual processor failure rate λind. A striking result is that P * is of the order λ −1/4 ind if the checkpointing cost grows linearly with the number of processors, and of the order λ −1/3 ind if the checkpointing cost stays bounded for any P. We conduct an extensive set of simulations to support the theoretical study. The results confirm the accuracy of first-order approximation under a wide range of parameter settings.
Document type :
Conference papers
Complete list of metadata

https://hal.inria.fr/hal-01355963
Contributor : Equipe Roma Connect in order to contact the contributor
Submitted on : Wednesday, August 24, 2016 - 3:23:41 PM
Last modification on : Saturday, September 11, 2021 - 3:18:19 AM
Long-term archiving on: : Friday, November 25, 2016 - 1:44:17 PM

File

cluster2016.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01355963, version 1

Collections

Citation

Aurélien Cavelan, Jiafan Li, Yves Robert, Hongyang Sun. When Amdahl Meets Young/Daly. Cluster'2016, Sep 2016, Taipei, Taiwan, France. ⟨hal-01355963⟩

Share

Metrics

Record views

387

Files downloads

335