Automatic Middleware Deployment Planning on Clusters

Pushpinder Kaur Chouhan 1 Holly Dail 1 Eddy Caron 2, 1 Frédéric Vivien 3
2 AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
3 ROMA - Optimisation des ressources : modèles, algorithmes et ordonnancement
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
Abstract : The use of remotely distributed computing resources as a single system offers great potential for compute-intensive applications. Increasingly, users have access to hundreds or thousands of machines at once and wish to utilize those resources concurrently. To provide a reasonable user experience, such systems must provide an effective, scalable scheduling system. Unfortunately, the great majority of job schedulers are centralized and many do not scale well to thousands or even hundreds of nodes. In this paper we study how distributed scheduling systems can be designed most effectively; we focus on the problem of selecting an optimal arrangement of schedulers, or a deployment, for hierarchically organized systems. We show that the optimal deployment is a complete spanning d-ary tree; this result conforms with results from the scheduling literature. More importantly, we present an approach for determining the optimal degree d for the tree. To test our approach, we use DIET, a middleware system that uses hierarchical schedulers. We develop detailed performance models for DIET and validate these models in a real-world environment. Finally, we demonstrate that our approach selects deployments that are near-optimal in practice.
Type de document :
Article dans une revue
International Journal of High Performance Computing Applications, SAGE Publications, 2006, 20 (4), pp.14
Liste complète des métadonnées

https://hal.inria.fr/hal-01429834
Contributeur : Eddy Caron <>
Soumis le : lundi 9 janvier 2017 - 11:12:28
Dernière modification le : vendredi 20 avril 2018 - 15:44:27

Identifiants

  • HAL Id : hal-01429834, version 1

Collections

Citation

Pushpinder Kaur Chouhan, Holly Dail, Eddy Caron, Frédéric Vivien. Automatic Middleware Deployment Planning on Clusters. International Journal of High Performance Computing Applications, SAGE Publications, 2006, 20 (4), pp.14. 〈hal-01429834〉

Partager

Métriques

Consultations de la notice

322