Load-aware shedding in stream processing systems

Abstract : Load shedding is a technique employed by stream processing systems to handle unpredictable spikes in the input load whenever available computing resources are not adequately provisioned. A load shedder drops tuples to keep the input load below a critical threshold and thus avoid tuple queuing and system trashing. In this paper we propose Load-Aware Shedding (LAS), a novel load shedding solution that drops tuples with the aim of maintaining queuing times below a tunable threshold. Tuple execution durations are estimated at runtime using efficient sketch data structures. We provide a theoretical analysis proving that LAS is an (ε, δ)-approximation of the optimal online load shedder and show its performance through a practical evaluation based both on simulations and on a running prototype.
Type de document :
Communication dans un congrès
10th ACM International Conference on Distributed and Event-based Systems (DEBS), Jun 2016, Irvine, United States. pp.61 - 68, 2016, 〈10.1145/2933267.2933311〉
Liste complète des métadonnées

Littérature citée [11 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01413212
Contributeur : Yann Busnel <>
Soumis le : lundi 12 décembre 2016 - 08:58:50
Dernière modification le : mercredi 12 septembre 2018 - 01:28:25
Document(s) archivé(s) le : jeudi 23 mars 2017 - 10:24:25

Fichier

main-no-cc.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Nicoló Rivetti, Yann Busnel, Leonardo Querzoni. Load-aware shedding in stream processing systems. 10th ACM International Conference on Distributed and Event-based Systems (DEBS), Jun 2016, Irvine, United States. pp.61 - 68, 2016, 〈10.1145/2933267.2933311〉. 〈hal-01413212〉

Partager

Métriques

Consultations de la notice

1367

Téléchargements de fichiers

80