Delta: Scalable Data Dissemination under Capacity Constraints

Konstantinos Karanasos 1 Asterios Katsifodimos 2, 3 Ioana Manolescu 2, 3
2 OAK - Database optimizations and architectures for complex large data
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : In content-based publish-subscribe (pub/sub) systems, users express their interests as queries over a stream of publications. Scaling up content-based pub/sub to very large numbers of subscriptions is challenging: users are interested in low latency, that is, getting subscription results fast, while the pub/sub system provider is mostly interested in scaling, i.e. being able to serve large numbers of subscribers, with low computational resources utilization. We present a novel approach for scalable content-based pub/sub in the presence of constraints on the available CPU and network resources, implemented within our pub/sub system Delta. We achieve scalability by off-loading some subscriptions from the pub/sub server, and leveraging view-based query rewriting to feed these subscriptions from the data accumulated in others. Our main contribution is a novel algorithm for organizing views in a multi-level dissemination network, exploiting view-based rewriting and powerful linear programming capabilities to scale to many views, respect capacity constraints, and minimize latency. The efficiency and effectiveness of our algorithm are confirmed through extensive experiments and a large deployment in a WAN.
Type de document :
Article dans une revue
Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2013, 7 (4), pp.217-228. 〈http://www.vldb.org/pvldb/vol7/p217-karanasos.pdf〉
Liste complète des métadonnées

Littérature citée [27 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00930107
Contributeur : Ioana Manolescu <>
Soumis le : mardi 14 janvier 2014 - 12:19:26
Dernière modification le : jeudi 5 avril 2018 - 12:30:20
Document(s) archivé(s) le : mardi 15 avril 2014 - 16:23:45

Fichier

paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00930107, version 1

Collections

Citation

Konstantinos Karanasos, Asterios Katsifodimos, Ioana Manolescu. Delta: Scalable Data Dissemination under Capacity Constraints. Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2013, 7 (4), pp.217-228. 〈http://www.vldb.org/pvldb/vol7/p217-karanasos.pdf〉. 〈hal-00930107〉

Partager

Métriques

Consultations de la notice

482

Téléchargements de fichiers

162