Skip to Main content Skip to Navigation
Conference papers

Load-aware shedding in stream processing systems

Abstract : Load shedding is a technique employed by stream processing systems to handle unpredictable spikes in the input load whenever available computing resources are not adequately provisioned. A load shedder drops tuples to keep the input load below a critical threshold and thus avoid tuple queuing and system trashing. In this paper we propose Load-Aware Shedding (LAS), a novel load shedding solution that drops tuples with the aim of maintaining queuing times below a tunable threshold. Tuple execution durations are estimated at runtime using efficient sketch data structures. We provide a theoretical analysis proving that LAS is an (ε, δ)-approximation of the optimal online load shedder and show its performance through a practical evaluation based both on simulations and on a running prototype.
Complete list of metadata

Cited literature [11 references]  Display  Hide  Download
Contributor : Yann Busnel Connect in order to contact the contributor
Submitted on : Monday, December 12, 2016 - 8:58:50 AM
Last modification on : Monday, June 27, 2022 - 3:05:16 AM
Long-term archiving on: : Thursday, March 23, 2017 - 10:24:25 AM


Files produced by the author(s)



Nicoló Rivetti, yann Busnel, Leonardo Querzoni. Load-aware shedding in stream processing systems. 10th ACM International Conference on Distributed and Event-based Systems (DEBS), Jun 2016, Irvine, United States. pp.61 - 68, ⟨10.1145/2933267.2933311⟩. ⟨hal-01413212⟩



Record views


Files downloads