Hierarchical DAG Scheduling for Hybrid Distributed Systems

Abstract : Accelerator-enhanced computing platforms have drawn a lot of attention due to their massive peak com-putational capacity. Despite significant advances in the pro-gramming interfaces to such hybrid architectures, traditional programming paradigms struggle mapping the resulting multi-dimensional heterogeneity and the expression of algorithm parallelism, resulting in sub-optimal effective performance. Task-based programming paradigms have the capability to alleviate some of the programming challenges on distributed hybrid many-core architectures. In this paper we take this concept a step further by showing that the potential of task-based programming paradigms can be greatly increased with minimal modification of the underlying runtime combined with the right algorithmic changes. We propose two novel recursive algorithmic variants for one-sided factorizations and describe the changes to the PaRSEC task-scheduling runtime to build a framework where the task granularity is dynamically adjusted to adapt the degree of available parallelism and kernel effi-ciency according to runtime conditions. Based on an extensive set of results we show that, with one-sided factorizations, i.e. Cholesky and QR, a carefully written algorithm, supported by an adaptive tasks-based runtime, is capable of reaching a degree of performance and scalability never achieved before in distributed hybrid environments.
Type de document :
Communication dans un congrès
IEEE International Parallel & Distributed Processing Symposium (IPDPS 2015), May 2015, Hyderabad, India
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01078359
Contributeur : Mathieu Faverge <>
Soumis le : mardi 16 décembre 2014 - 11:07:09
Dernière modification le : jeudi 11 janvier 2018 - 06:22:35
Document(s) archivé(s) le : lundi 23 mars 2015 - 13:44:53

Fichier

recursive.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01078359, version 1

Collections

Citation

Wei Wu, Aurelien Bouteiller, George Bosilca, Mathieu Faverge, Jack Dongarra. Hierarchical DAG Scheduling for Hybrid Distributed Systems. IEEE International Parallel & Distributed Processing Symposium (IPDPS 2015), May 2015, Hyderabad, India. 〈hal-01078359〉

Partager

Métriques

Consultations de la notice

432

Téléchargements de fichiers

628