IBB: Improved K-Resource Aware Backfill Balanced Scheduling for HTCondor

Abstract : HTCondor, a batch system characterized by its matchmaking mechanism, schedules job in FCFS way, so its performance is not ideal as expected. Backfilling is a technique to address the above problem. Most backfilling algorithms are based on CPU information and have large room for improvements with considering other resource information. The K-resource aware scheduling algorithm Backfill Balanced (BB) selects backfill job which can best balance the usage of all resources and achieve better performance compared with the classical backfilling algorithm. However, BB does not realize that small jobs’ impacts on resource utilization are negligible and they mainly contribute to reduce the average response time. Here we propose the IBB algorithm, which utilizes the characteristics of small jobs to guide a better job selection. We implemented IBB on HTCondor to improve its performance. Experiments results show that IBB can provide up to 60 % performance gains in most performance metrics compared with BB.
Type de document :
Communication dans un congrès
Guang R. Gao; Depei Qian; Xinbo Gao; Barbara Chapman; Wenguang Chen. 13th IFIP International Conference on Network and Parallel Computing (NPC), Oct 2016, Xi'an, China. Springer International Publishing, Lecture Notes in Computer Science, LNCS-9966, pp.85-92, 2016, Network and Parallel Computing. 〈10.1007/978-3-319-47099-3_7〉
Liste complète des métadonnées

Littérature citée [12 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01648004
Contributeur : Hal Ifip <>
Soumis le : vendredi 24 novembre 2017 - 16:49:12
Dernière modification le : vendredi 24 novembre 2017 - 16:50:59

Fichier

 Accès restreint
Fichier visible le : 2019-01-01

Connectez-vous pour demander l'accès au fichier

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Lan Liu, Zhongzhi Luan, Haozhan Wang, Depei Qian. IBB: Improved K-Resource Aware Backfill Balanced Scheduling for HTCondor. Guang R. Gao; Depei Qian; Xinbo Gao; Barbara Chapman; Wenguang Chen. 13th IFIP International Conference on Network and Parallel Computing (NPC), Oct 2016, Xi'an, China. Springer International Publishing, Lecture Notes in Computer Science, LNCS-9966, pp.85-92, 2016, Network and Parallel Computing. 〈10.1007/978-3-319-47099-3_7〉. 〈hal-01648004〉

Partager

Métriques

Consultations de la notice

42