Tradeoff to minimize extra-computations and stopping criterion tests for parallel iterative schemes

Olivier Beaumont 1, 2 El Mostafa Daoudi 3 Nicolas Maillard 4 Pierre Manneback 5 Jean-Louis Roch 6, *
* Corresponding author
2 SCALAPPLIX - Algorithms and high performance computing for grand challenge applications
INRIA Futurs, Université Bordeaux Segalen - Bordeaux 2, Université Sciences et Technologies - Bordeaux 1, École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), CNRS - Centre National de la Recherche Scientifique : UMR5800
6 MOAIS - PrograMming and scheduling design fOr Applications in Interactive Simulation
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : Parallel synchronous iterative algorithms are often penalized by global synchro- nization, due to the cost of stopping tests that are achieved. It is well known that such global synchronizations are expensive for parallel implementations on distrib- uted systems, especially on clusters of processors or computational grids, where the heterogeneity and the number of processors imply a large overhead for this global operation. The aim of this work is to propose a new control technique for the stopping tests, original to the best of our knowledge, which enables to reduce the number of global synchronization near to the optimum, while keeping the number of iterations close to the number performed by standard synchronous algorithm. The main advantage of the proposed technique is that the semantic of the sequential al- gorithm is not modified, so that convergence is preserved and identical outputs are guaranteed. Our method is based on an amortized technique inspired by Floyd's and Brent's algorithms to detect periodicity in a sequence.
Complete list of metadatas

Cited literature [6 references]  Display  Hide  Download

https://hal.inria.fr/hal-00777293
Contributor : Jean-Louis Roch <>
Submitted on : Tuesday, January 29, 2013 - 1:56:49 PM
Last modification on : Friday, August 9, 2019 - 3:26:02 PM
Long-term archiving on : Saturday, April 1, 2017 - 6:28:16 AM

File

2004-BDMMR-tradeoffiterative.p...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00777293, version 1

Citation

Olivier Beaumont, El Mostafa Daoudi, Nicolas Maillard, Pierre Manneback, Jean-Louis Roch. Tradeoff to minimize extra-computations and stopping criterion tests for parallel iterative schemes. [Research Report] 2004, pp.13. ⟨hal-00777293⟩

Share

Metrics

Record views

1288

Files downloads

225