Dynamic Fractional Resource Scheduling versus Batch Scheduling

Abstract : We propose a novel job scheduling approach for homogeneous cluster computing platforms. Its key feature is the use of virtual machine technology to share fractional node resources in a precise and controlled manner. Other VM-based scheduling approaches have focused primarily on technical issues or extensions to existing batch scheduling systems, while we take a more aggressive approach and seek to find heuristics that maximize an objective metric correlated with job performance. We derive absolute performance bounds and develop algorithms for the online, non-clairvoyant version of our scheduling problem. We further evaluate these algorithms in simulation against both synthetic and real-world HPC workloads and compare our algorithms to standard batch scheduling approaches. We find that our approach improves over batch scheduling by orders of magnitude in terms of job stretch, while leading to comparable or better resource utilization. Our results demonstrate that virtualization technology coupled with lightweight online scheduling strategies can afford dramatic improvements in performance for executing HPC workloads.
Type de document :
Article dans une revue
IEEE Transactions on Parallel and Distributed Systems, Institute of Electrical and Electronics Engineers, 2012, 23 (3), pp.521-529. 〈10.1109/TPDS.2011.183〉
Liste complète des métadonnées

Littérature citée [4 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00763373
Contributeur : Equipe Roma <>
Soumis le : jeudi 18 octobre 2018 - 09:10:24
Dernière modification le : jeudi 18 octobre 2018 - 14:53:53

Fichier

paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Mark Stillwell, Frédéric Vivien, Henri Casanova. Dynamic Fractional Resource Scheduling versus Batch Scheduling. IEEE Transactions on Parallel and Distributed Systems, Institute of Electrical and Electronics Engineers, 2012, 23 (3), pp.521-529. 〈10.1109/TPDS.2011.183〉. 〈hal-00763373〉

Partager

Métriques

Consultations de la notice

188

Téléchargements de fichiers

6