Skip to Main content Skip to Navigation
Conference papers

An Optimal Model for Optimizing the Placement and Parallelism of Data Stream Processing Applications on Cloud-Edge Computing

Abstract : The Internet of Things has enabled many application scenarios where a large number of connected devices generate unbounded streams of data, often processed by data stream processing frameworks deployed in the cloud. Edge computing enables offloading processing from the cloud and placing it close to where the data is generated, thereby reducing the time to process data events and deployment costs. However, edge resources are more computationally constrained than their cloud counterparts, raising two interrelated issues, namely deciding on the parallelism of processing tasks (a.k.a. operators) and their mapping onto available resources. In this work, we formulate the scenario of operator placement and parallelism as an optimal mixed-integer linear programming problem. The proposed model is termed as Cloud-Edge data Stream Placement (CESP). Experimental results using discrete-event simulation demonstrate that CESP can achieve an end-to-end latency at least 80% and monetary costs at least 30% better than traditional cloud deployment.
Complete list of metadata

Cited literature [20 references]  Display  Hide  Download

https://hal.inria.fr/hal-02926459
Contributor : Felipe Rodrigo de Souza <>
Submitted on : Monday, August 31, 2020 - 5:43:49 PM
Last modification on : Monday, March 8, 2021 - 1:01:09 PM
Long-term archiving on: : Tuesday, December 1, 2020 - 12:58:19 PM

File

sbac-pad_2020.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02926459, version 1

Collections

Citation

Felipe Rodrigo de Souza, Marcos Dias de Assuncao, Eddy Caron, Alexandre da Silva Veith. An Optimal Model for Optimizing the Placement and Parallelism of Data Stream Processing Applications on Cloud-Edge Computing. SBAC-PAD 2020 - IEEE 32nd International Symposium on Computer Architecture and High Performance Computing, Sep 2020, Porto, Portugal. ⟨hal-02926459⟩

Share

Metrics

Record views

109

Files downloads

271