Skip to Main content Skip to Navigation
Journal articles

Distributed Data Stream Processing and Edge Computing: A Survey on Resource Elasticity and Future Directions

Abstract : Under several emerging application scenarios, such as in smart cities, operational monitoring of large infrastructure, wearable assistance, and Internet of Things, continuous data streams must be processed under very short delays. Several solutions, including multiple software engines, have been developed for processing unbounded data streams in a scalable and efficient manner. More recently, architecture has been proposed to use edge computing for data stream processing. This paper surveys state of the art on stream processing engines and mechanisms for exploiting resource elasticity features of cloud computing in stream processing. Resource elasticity allows for an application or service to scale out/in according to fluctuating demands. Although such features have been extensively investigated for enterprise applications, stream processing poses challenges on achieving elastic systems that can make efficient resource management decisions based on current load. Elasticity becomes even more challenging in highly distributed environments comprising edge and cloud computing resources. This work examines some of these challenges and discusses solutions proposed in the literature to address them.
Complete list of metadatas

Cited literature [99 references]  Display  Hide  Download

https://hal.inria.fr/hal-01653842
Contributor : Marcos Dias de Assuncao <>
Submitted on : Saturday, December 2, 2017 - 7:58:49 AM
Last modification on : Tuesday, January 21, 2020 - 2:02:02 PM
Document(s) archivé(s) le : Saturday, March 3, 2018 - 12:34:24 PM

File

survey_stream_processing.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Marcos Dias de Assuncao, Alexandre da Silva Veith, Rajkumar Buyya. Distributed Data Stream Processing and Edge Computing: A Survey on Resource Elasticity and Future Directions. Journal of Network and Computer Applications, Elsevier, 2018, 103, pp.1-17. ⟨10.1016/j.jnca.2017.12.001⟩. ⟨hal-01653842⟩

Share

Metrics

Record views

679

Files downloads

3662