Model-based Stream Processing Auto-scaling in Geo-Distributed Environments - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Model-based Stream Processing Auto-scaling in Geo-Distributed Environments

Johan Tordsson
  • Fonction : Auteur
  • PersonId : 1059919
Erik Elmroth
  • Fonction : Auteur
  • PersonId : 1059920

Résumé

Data stream processing is an attractive paradigm for analyzing IoT data at the edge of the Internet before transmitting processed results to a cloud. However, the relative scarcity of fog computing resources combined with the workloads' nonstationary properties make it impossible to allocate a static set of resources for each application. We propose Gesscale, a resource auto-scaler which guarantees that a stream processing application maintains a sufficient Maximum Sustainable Throughput to process its incoming data with no undue delay, while not using more resources than strictly necessary. Gesscale derives its decisions about when to rescale and which geo-distributed resource(s) to add or remove on a performance model that gives precise predictions about the future maximum sustainable throughput after reconfiguration. We show that this auto-scaler uses 17% less resources, generates 52% fewer reconfigurations, and processes more input data than baseline auto-scalers based on threshold triggers or a simpler performance model. Index Terms-Stream processing, auto-scaling, fog computing.
Fichier principal
Vignette du fichier
main.pdf (837.02 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03206689 , version 1 (23-04-2021)

Identifiants

  • HAL Id : hal-03206689 , version 1

Citer

Hamidreza Arkian, Guillaume Pierre, Johan Tordsson, Erik Elmroth. Model-based Stream Processing Auto-scaling in Geo-Distributed Environments. ICCCN 2021 - 30th International Conference on Computer Communications and Networks, Jul 2021, Athens, Greece. pp.1-11. ⟨hal-03206689⟩
554 Consultations
558 Téléchargements

Partager

Gmail Facebook X LinkedIn More