Optimization methodology for Parallel Programming of Homogeneous or Hybrid Clusters

Stéphane Vialle 1, 2 Sylvain Contassot-Vivier 3
3 ALGORILLE - Algorithms for the Grid
Inria Nancy - Grand Est, LORIA - NSS - Department of Networks, Systems and Services
Abstract : This chapter proposes a study of the optimization process of parallel applications to be run on modern architectures (multi-core CPU nodes with GPUs). Different optimization schemes are proposed for overlapping computations with communications, and for computation kernels. Development methodologies are introduced to obtain different optimization degrees and specific criteria are defined to help developers find the most suited degree of optimization according to the considered application and parallel system. According to our experience in industrial collaborations, we analyze both performance and code complexity increase. This last point is an important issue, especially in the industry, as it directly impacts development and maintenance costs. Complete experiments are performed to evaluate the different variants of a benchmark application that consists in a dense matrix product. In those experiments, different runtime parameters and cluster configurations are tested. Then, the results are analyzed to evaluate the interest of the different optimization degrees as well as to validate the interest of the proposed optimization methodology.
Type de document :
Chapitre d'ouvrage
F. Magoules. Patterns for parallel programming on GPUs, Saxe-Coburg Publications, 2014, 978-1-874672-57-9
Liste complète des métadonnées

https://hal.inria.fr/hal-01101225
Contributeur : Sylvain Contassot-Vivier <>
Soumis le : jeudi 8 janvier 2015 - 10:44:02
Dernière modification le : jeudi 11 janvier 2018 - 06:25:23

Identifiants

  • HAL Id : hal-01101225, version 1

Citation

Stéphane Vialle, Sylvain Contassot-Vivier. Optimization methodology for Parallel Programming of Homogeneous or Hybrid Clusters. F. Magoules. Patterns for parallel programming on GPUs, Saxe-Coburg Publications, 2014, 978-1-874672-57-9. 〈hal-01101225〉

Partager

Métriques

Consultations de la notice

209