Using Static Allocation Algorithms for Matrix Matrix Multiplication on Multicores and GPUs

Lionel Eyraud-Dubois 1, 2 Thomas Lambert 1, 3
1 Realopt - Reformulations based algorithms for Combinatorial Optimization
LaBRI - Laboratoire Bordelais de Recherche en Informatique, IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : We consider the problem of data allocation when performing matrix multiplication on a heterogeneous node, with multicores and GPUs. Classical (cyclic) allocations designed for homogeneous settings are not appropriate, but the advent of task-based runtime systems makes it possible to use more general allocations. Previous theoretical work has proposed square and cube partitioning algorithms aimed at minimizing data movement for matrix multiplication. We propose techniques to adapt these continuous square partitionings to allocating discrete tiles of a matrix, and strategies to adapt the static allocation at run-time. We use these techniques in an implementation of Matrix Multiplication based on the StarPU runtime system, and we show through extensive experiments that this implementation allows to consistently obtain a lower communication volume while improving slightly the execution time, compared to standard state-of-the-art dynamic strategies.
Type de document :
Communication dans un congrès
ICPP 2018 - 47th International Conference on Parallel Processing, Aug 2018, Eugene, OR, United States. 〈10.1145/3225058.3225066〉
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01670678
Contributeur : Lionel Eyraud-Dubois <>
Soumis le : jeudi 31 mai 2018 - 15:36:08
Dernière modification le : vendredi 30 novembre 2018 - 20:20:03
Document(s) archivé(s) le : samedi 1 septembre 2018 - 14:34:29

Fichier

icpp.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Lionel Eyraud-Dubois, Thomas Lambert. Using Static Allocation Algorithms for Matrix Matrix Multiplication on Multicores and GPUs. ICPP 2018 - 47th International Conference on Parallel Processing, Aug 2018, Eugene, OR, United States. 〈10.1145/3225058.3225066〉. 〈hal-01670678v2〉

Partager

Métriques

Consultations de la notice

117

Téléchargements de fichiers

62