Skip to Main content Skip to Navigation
Conference papers

Shoal: Query Optimization and Operator Placement for Access Controlled Stream Processing Systems

Abstract : Distributed Data Stream Processing Systems (DDSPS) execute on transient data flowing through long-running, continuous, streaming queries, grouped together in query networks. Often, these continuous queries are outsourced by the querier to third-party computing platforms to help control the cost and maintenance associated with owning and operating such systems. Such outsourcing, however, may be contradictory to a data provider’s access controls as they may not permit their data to be viewed or accessed by an unintended third party. A data provider’s access controls may, therefore, prevent a querier from fully outsourcing their query. Current research in this space has provided alternative access control techniques that involve computation-enabling encryption techniques, specialized hardware, or specialized query operators that allow for a data provider to enforce access controls while still allowing a querier to employ a third-party system. However, no system considers access controls and their enforcement as part of the query optimization step. In this paper, we present Shoal, an optimizer that considers access controls as first class citizens when optimizing and distributing a network of query operators. We show that Shoal can generate more efficient queries versus the state-of-the-art, as well as detail how changes in access controls can generate new query plans at runtime.
Document type :
Conference papers
Complete list of metadata

Cited literature [32 references]  Display  Hide  Download
Contributor : Hal Ifip <>
Submitted on : Thursday, November 28, 2019 - 2:26:10 PM
Last modification on : Thursday, November 28, 2019 - 2:29:00 PM
Long-term archiving on: : Saturday, February 29, 2020 - 3:38:53 PM


 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2022-01-01

Please log in to resquest access to the document


Distributed under a Creative Commons Attribution 4.0 International License



Cory Thoma, Alexandros Labrinidis, Adam Lee. Shoal: Query Optimization and Operator Placement for Access Controlled Stream Processing Systems. 33th IFIP Annual Conference on Data and Applications Security and Privacy (DBSec), Jul 2019, Charleston, SC, United States. pp.261-280, ⟨10.1007/978-3-030-22479-0_14⟩. ⟨hal-02384602⟩



Record views