SOFTScale: Stealing Opportunistically for Transient Scaling

Abstract : Dynamic capacity provisioning is a well studied approach to handling gradual changes in data center load. However, abrupt spikes in load are still problematic in that the work in the system rises very quickly during the setup time needed to turn on additional capacity. Performance can be severely affected even if it takes only 5 seconds to bring additional capacity online.In this paper, we propose SOFTScale, an approach to handling load spikes in multi-tier data centers without having to over-provision resources. SOFTScale works by opportunistically stealing resources from other tiers to alleviate the bottleneck tier, even when the tiers are carefully provisioned at capacity. SOFTScale is especially useful during the transient overload periods when additional capacity is being brought online.Via implementation on a 28-server multi-tier testbed, we investigate a range of possible load spikes, including an artificial doubling or tripling of load, as well as large spikes in real traces. We find that SOFTScale can meet our stringent 95th percentile response time Service Level Agreement goal of 500ms without using any additional resources even under some extreme load spikes that would normally cause the system (without SOFTScale) to exhibit response times as high as 96 seconds.
Type de document :
Communication dans un congrès
Priya Narasimhan; Peter Triantafillou. 13th International Middleware Conference (MIDDLEWARE), Dec 2012, Montreal, QC, Canada. Springer, Lecture Notes in Computer Science, LNCS-7662, pp.142-163, 2012, Middleware 2012. 〈10.1007/978-3-642-35170-9_8〉
Liste complète des métadonnées

Littérature citée [40 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01555559
Contributeur : Hal Ifip <>
Soumis le : mardi 4 juillet 2017 - 11:33:08
Dernière modification le : mardi 4 juillet 2017 - 11:34:12
Document(s) archivé(s) le : vendredi 15 décembre 2017 - 00:25:02

Fichier

978-3-642-35170-9_8_Chapter.pd...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Anshul Gandhi, Timothy Zhu, Mor Harchol-Balter, Michael Kozuch. SOFTScale: Stealing Opportunistically for Transient Scaling. Priya Narasimhan; Peter Triantafillou. 13th International Middleware Conference (MIDDLEWARE), Dec 2012, Montreal, QC, Canada. Springer, Lecture Notes in Computer Science, LNCS-7662, pp.142-163, 2012, Middleware 2012. 〈10.1007/978-3-642-35170-9_8〉. 〈hal-01555559〉

Partager

Métriques

Consultations de la notice

14

Téléchargements de fichiers

12