HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Model-based Stream Processing Auto-scaling in Geo-Distributed Environments

Abstract : Data stream processing is an attractive paradigm for analyzing IoT data at the edge of the Internet before transmitting processed results to a cloud. However, the relative scarcity of fog computing resources combined with the workloads' nonstationary properties make it impossible to allocate a static set of resources for each application. We propose Gesscale, a resource auto-scaler which guarantees that a stream processing application maintains a sufficient Maximum Sustainable Throughput to process its incoming data with no undue delay, while not using more resources than strictly necessary. Gesscale derives its decisions about when to rescale and which geo-distributed resource(s) to add or remove on a performance model that gives precise predictions about the future maximum sustainable throughput after reconfiguration. We show that this auto-scaler uses 17% less resources, generates 52% fewer reconfigurations, and processes more input data than baseline auto-scalers based on threshold triggers or a simpler performance model. Index Terms-Stream processing, auto-scaling, fog computing.
Complete list of metadata

Contributor : Guillaume Pierre Connect in order to contact the contributor
Submitted on : Friday, April 23, 2021 - 2:32:56 PM
Last modification on : Monday, April 4, 2022 - 9:28:21 AM
Long-term archiving on: : Saturday, July 24, 2021 - 6:42:21 PM


Files produced by the author(s)


  • HAL Id : hal-03206689, version 1


Hamidreza Arkian, Guillaume Pierre, Johan Tordsson, Erik Elmroth. Model-based Stream Processing Auto-scaling in Geo-Distributed Environments. ICCCN 2021 - 30th International Conference on Computer Communications and Networks, Jul 2021, Athens, Greece. pp.1-11. ⟨hal-03206689⟩



Record views


Files downloads