Parallel scheduling of task trees with limited memory

Abstract : This paper investigates the execution of tree-shaped task graphs using multiple processors. Each edge of such a tree represents some large data. A task can only be executed if all input and output data fit into memory, and a data can only be removed from memory after the completion of the task that uses it as an input data. Such trees arise in the multifrontal method of sparse matrix factorization. The peak memory needed for the processing of the entire tree depends on the execution order of the tasks. With one processor the objective of the tree traversal is to minimize the required memory. This problem was well studied and optimal polynomial algorithms were proposed. Here, we extend the problem by considering multiple processors, which is of obvious interest in the application area of matrix factorization. With multiple processors comes the additional objective to minimize the time needed to traverse the tree, i.e., to minimize the makespan. Not surprisingly, this problem proves to be much harder than the sequential one. We study the computational complexity of this problem and provide inapproximability results even for unit weight trees. We design a series of practical heuristics achieving different trade-offs between the minimization of peak memory usage and makespan. Some of these heuristics are able to process a tree while keeping the memory usage under a given memory limit. The different heuristics are evaluated in an extensive experimental evaluation using realistic trees.
Type de document :
Article dans une revue
ACM Transactions on Parallel Computing, Association for Computing Machinery, 2015, 2 (2), pp.36. 〈10.1145/2779052〉
Liste complète des métadonnées

Littérature citée [23 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01160118
Contributeur : Equipe Roma <>
Soumis le : jeudi 4 juin 2015 - 15:06:47
Dernière modification le : vendredi 20 avril 2018 - 15:44:27
Document(s) archivé(s) le : mardi 25 avril 2017 - 03:19:32

Fichier

journal-revision-TOPC.pdf
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Collections

Citation

Lionel Eyraud-Dubois, Loris Marchal, Oliver Sinnen, Frédéric Vivien. Parallel scheduling of task trees with limited memory. ACM Transactions on Parallel Computing, Association for Computing Machinery, 2015, 2 (2), pp.36. 〈10.1145/2779052〉. 〈hal-01160118〉

Partager

Métriques

Consultations de la notice

488

Téléchargements de fichiers

110