Delta: Scalable Data Dissemination under Capacity Constraints - Archive ouverte HAL Access content directly
Journal Articles Proceedings of the VLDB Endowment (PVLDB) Year : 2013

Delta: Scalable Data Dissemination under Capacity Constraints

Abstract

In content-based publish-subscribe (pub/sub) systems, users express their interests as queries over a stream of publications. Scaling up content-based pub/sub to very large numbers of subscriptions is challenging: users are interested in low latency, that is, getting subscription results fast, while the pub/sub system provider is mostly interested in scaling, i.e. being able to serve large numbers of subscribers, with low computational resources utilization. We present a novel approach for scalable content-based pub/sub in the presence of constraints on the available CPU and network resources, implemented within our pub/sub system Delta. We achieve scalability by off-loading some subscriptions from the pub/sub server, and leveraging view-based query rewriting to feed these subscriptions from the data accumulated in others. Our main contribution is a novel algorithm for organizing views in a multi-level dissemination network, exploiting view-based rewriting and powerful linear programming capabilities to scale to many views, respect capacity constraints, and minimize latency. The efficiency and effectiveness of our algorithm are confirmed through extensive experiments and a large deployment in a WAN.
Fichier principal
Vignette du fichier
paper.pdf (249.11 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00930107 , version 1 (14-01-2014)

Identifiers

  • HAL Id : hal-00930107 , version 1

Cite

Konstantinos Karanasos, Asterios Katsifodimos, Ioana Manolescu. Delta: Scalable Data Dissemination under Capacity Constraints. Proceedings of the VLDB Endowment (PVLDB), 2013, 7 (4), pp.217-228. ⟨hal-00930107⟩
227 View
162 Download

Share

Gmail Facebook Twitter LinkedIn More