Skip to Main content Skip to Navigation
Conference papers

Load-aware shedding in stream processing systems

Abstract : Load shedding is a technique employed by stream processing systems to handle unpredictable spikes in the input load whenever available computing resources are not adequately provisioned. A load shedder drops tuples to keep the input load below a critical threshold and thus avoid tuple queuing and system trashing. In this paper we propose Load-Aware Shedding (LAS), a novel load shedding solution that drops tuples with the aim of maintaining queuing times below a tunable threshold. Tuple execution durations are estimated at runtime using efficient sketch data structures. We provide a theoretical analysis proving that LAS is an (ε, δ)-approximation of the optimal online load shedder and show its performance through a practical evaluation based both on simulations and on a running prototype.
Complete list of metadata

Cited literature [11 references]  Display  Hide  Download

https://hal.inria.fr/hal-01413212
Contributor : Yann Busnel <>
Submitted on : Monday, December 12, 2016 - 8:58:50 AM
Last modification on : Thursday, April 22, 2021 - 1:20:03 PM
Long-term archiving on: : Thursday, March 23, 2017 - 10:24:25 AM

File

main-no-cc.pdf
Files produced by the author(s)

Identifiers

Citation

Nicoló Rivetti, Yann Busnel, Leonardo Querzoni. Load-aware shedding in stream processing systems. 10th ACM International Conference on Distributed and Event-based Systems (DEBS), Jun 2016, Irvine, United States. pp.61 - 68, ⟨10.1145/2933267.2933311⟩. ⟨hal-01413212⟩

Share

Metrics

Record views

2363

Files downloads

502