Scalable Load Balancing in Cluster Storage Systems

Abstract : Enterprise and cloud data centers are comprised of tens of thousands of servers providing petabytes of storage to a large number of users and applications. At such a scale, these storage systems face two key challenges: (a) hot-spots due to the dynamic popularity of stored objects and (b) high reconfiguration costs of data migration due to bandwidth oversubscription in the data center network. Existing storage solutions, however, are unsuitable to address these challenges because of the large number of servers and data objects. This paper describes the design, implementation, and evaluation of Ursa, which scales to a large number of storage nodes and objects and aims to minimize latency and bandwidth costs during system reconfiguration. Toward this goal, Ursa formulates an optimization problem that selects a subset of objects from hot-spot servers and performs topology-aware migration to minimize reconfiguration costs. As exact optimization is computationally expensive, we devise scalable approximation techniques for node selection and efficient divide-and-conquer computation. Our evaluation shows Ursa achieves cost-effective load balancing while scaling to large systems and is time-responsive in computing placement decisions, e.g., about two minutes for 10K nodes and 10M objects.
Type de document :
Communication dans un congrès
Fabio Kon; Anne-Marie Kermarrec. 12th International Middleware Conference (MIDDLEWARE), Dec 2011, Lisbon, Portugal. Springer, Lecture Notes in Computer Science, LNCS-7049, pp.101-122, 2011, Middleware 2011. 〈10.1007/978-3-642-25821-3_6〉
Liste complète des métadonnées

Littérature citée [25 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01597772
Contributeur : Hal Ifip <>
Soumis le : jeudi 28 septembre 2017 - 17:11:57
Dernière modification le : jeudi 28 septembre 2017 - 17:16:46
Document(s) archivé(s) le : vendredi 29 décembre 2017 - 15:16:30

Fichier

978-3-642-25821-3_6_Chapter.pd...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Gae-Won You, Seung-Won Hwang, Navendu Jain. Scalable Load Balancing in Cluster Storage Systems. Fabio Kon; Anne-Marie Kermarrec. 12th International Middleware Conference (MIDDLEWARE), Dec 2011, Lisbon, Portugal. Springer, Lecture Notes in Computer Science, LNCS-7049, pp.101-122, 2011, Middleware 2011. 〈10.1007/978-3-642-25821-3_6〉. 〈hal-01597772〉

Partager

Métriques

Consultations de la notice

54

Téléchargements de fichiers

30