A scalable and generic task scheduling system for communication libraries

François Trahay 1, 2 Alexandre Denis 1, 2
2 RUNTIME - Efficient runtime systems for parallel architectures
Inria Bordeaux - Sud-Ouest, UB - Université de Bordeaux, CNRS - Centre National de la Recherche Scientifique : UMR5800
Abstract : Since the advent of multi-core processors, the physionomy of typical clusters has dramatically evolved. This new massively multi-core era is a major change in architecture, causing the evolution of programming models towards hybrid MPI+threads, therefore requiring new features at low-level. Modern communication subsystems now have to deal with multi-threading: the impact of thread-safety, the contention on network interfaces or the consequence of data locality on performance have to be studied carefully. In this paper, we present PIOMan, a scalable and generic lightweight task scheduling system for communication libraries. It is designed to ensure concurrent progression of multiple tasks of a communication library (polling, offload, multi-rail) through the use of multiple cores, while preserving locality to avoid contention and allow a scalability to a large number of cores and threads. We have implemented the model, evaluated its performance, and compared it to state of the art solutions regarding overhead, scalability, and communication and computation overlap.
Type de document :
Communication dans un congrès
IEEE International Conference on Cluster Computing, Aug 2009, New Orleans, LA, United States. 2009
Liste complète des métadonnées


https://hal.inria.fr/inria-00408521
Contributeur : François Trahay <>
Soumis le : jeudi 30 juillet 2009 - 19:24:14
Dernière modification le : jeudi 10 septembre 2015 - 01:06:36
Document(s) archivé(s) le : lundi 15 octobre 2012 - 15:50:39

Fichier

cluster09.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00408521, version 1

Collections

Citation

François Trahay, Alexandre Denis. A scalable and generic task scheduling system for communication libraries. IEEE International Conference on Cluster Computing, Aug 2009, New Orleans, LA, United States. 2009. <inria-00408521>

Partager

Métriques

Consultations de
la notice

365

Téléchargements du document

193