Skip to Main content Skip to Navigation
Journal articles

Automatic Middleware Deployment Planning on Clusters

Pushpinder Kaur Chouhan 1 Holly Dail 1 Eddy Caron 2, 1 Frédéric Vivien 3
2 AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
3 ROMA - Optimisation des ressources : modèles, algorithmes et ordonnancement
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
Abstract : The use of remotely distributed computing resources as a single system offers great potential for compute-intensive applications. Increasingly, users have access to hundreds or thousands of machines at once and wish to utilize those resources concurrently. To provide a reasonable user experience, such systems must provide an effective, scalable scheduling system. Unfortunately, the great majority of job schedulers are centralized and many do not scale well to thousands or even hundreds of nodes. In this paper we study how distributed scheduling systems can be designed most effectively; we focus on the problem of selecting an optimal arrangement of schedulers, or a deployment, for hierarchically organized systems. We show that the optimal deployment is a complete spanning d-ary tree; this result conforms with results from the scheduling literature. More importantly, we present an approach for determining the optimal degree d for the tree. To test our approach, we use DIET, a middleware system that uses hierarchical schedulers. We develop detailed performance models for DIET and validate these models in a real-world environment. Finally, we demonstrate that our approach selects deployments that are near-optimal in practice.
Complete list of metadata
Contributor : Eddy Caron Connect in order to contact the contributor
Submitted on : Monday, January 9, 2017 - 11:12:28 AM
Last modification on : Thursday, May 12, 2022 - 5:08:02 PM


  • HAL Id : hal-01429834, version 1



Pushpinder Kaur Chouhan, Holly Dail, Eddy Caron, Frédéric Vivien. Automatic Middleware Deployment Planning on Clusters. International Journal of High Performance Computing Applications, SAGE Publications, 2006, 20 (4), pp.14. ⟨hal-01429834⟩



Record views