PVM implementation of heterogeneous ScaLAPACK dense linear solvers

Vincent Boudet 1 Fabrice Rastello 1 Yves Robert 1
1 REMAP - Regularity and massive parallel computing
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
Abstract : This paper discusses some algorithmic issues when computing with a heterogeneous network of workstations (the typical poor man's parallel computer). How is it possible to efficiently implement numerical linear algebra kernels like those included in the ScaLAPACK library ? Dealing with processors of different speeds requires to use more involved strategies than purely static block-cyclic data distributions. Dynamic data distribution is a first possibility but may prove impractical and not scalable due to communication and control overhead. Static data distributions tuned to balance execution times constitute another possibility but may prove inefficient due to variations in the processor speeds (e.g. because of different workloads during the computation). There is a challenge in determining a trade-off between the data distribution parameters and the process spawning and possible migration (redistribution) policies. We introduce a semi-static distribution strategy that can be refined on the fly, and we show that it is well-suited to parallelizing several kernels of the ScaLAPACK library such as LU and QR decompositions.
Type de document :
Communication dans un congrès
J. Dongarra and E. Luque and T. Margalef. Recent Advances in Parallel Virtual Machine and Message Passing Interface, 1999, Unknown, Springer Verlag, 1697, pp.333-340, 1999, LNCS 1697. 〈10.1007/3-540-48158-3_41〉
Liste complète des métadonnées

https://hal.inria.fr/hal-00856660
Contributeur : Equipe Roma <>
Soumis le : lundi 2 septembre 2013 - 10:30:47
Dernière modification le : vendredi 20 avril 2018 - 15:44:24

Identifiants

Collections

Citation

Vincent Boudet, Fabrice Rastello, Yves Robert. PVM implementation of heterogeneous ScaLAPACK dense linear solvers. J. Dongarra and E. Luque and T. Margalef. Recent Advances in Parallel Virtual Machine and Message Passing Interface, 1999, Unknown, Springer Verlag, 1697, pp.333-340, 1999, LNCS 1697. 〈10.1007/3-540-48158-3_41〉. 〈hal-00856660〉

Partager

Métriques

Consultations de la notice

143