Resource Allocation Using Virtual Clusters

Abstract : We propose a novel approach for sharing cluster resources among competing jobs. The key advantage of our approach over current solutions is that it increases cluster utilization while optimizing a user-centric metric that captures both notions of performance and fairness. We motivate and formalize the corresponding resource allocation problem, determine its complexity, and propose several algorithms to solve it in the case of a static workload that consists of sequential jobs. Via extensive simulation experiments we identify an algorithm that runs quickly, that is always on par with or better than its competitors, and that produces resource allocations that are close to optimal. We find that the extension of our approach to parallel jobs leads to similarly good results. Finally, we explain how to extend our work to dynamic workloads.
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download

https://hal.inria.fr/inria-00422634
Contributor : Frédéric Vivien <>
Submitted on : Thursday, October 8, 2009 - 9:51:29 AM
Last modification on : Friday, April 20, 2018 - 3:44:23 PM
Long-term archiving on : Wednesday, June 16, 2010 - 12:29:33 AM

File

IEEEXplore_6_.pdf
Publisher files allowed on an open archive

Identifiers

Collections

Citation

Mark Stillwell, David Schanzenbach, Henri Casanova, Frédéric Vivien. Resource Allocation Using Virtual Clusters. 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, 2009. CCGRID '09., May 2009, Shanghai, China. ⟨10.1109/CCGRID.2009.23⟩. ⟨inria-00422634⟩

Share

Metrics

Record views

387

Files downloads

246