Skip to Main content Skip to Navigation
Journal articles

Towards quality-of-service driven consistency for Big Data management

Abstract : With the advent of Cloud Computing, Big Data management has become a fundamental challenge during the deployment and operation of distributed highly available and fault-tolerant storage systems such as the HBase extensible record-store. These systems can provide support for geo-replication, which comes with the issue of data consistency among distributed sites. In order to offer a best-in-class service to applications, one wants to maximise performance while minimising latency. In terms of data replication, that means incurring in as low latency as possible when moving data between distant data centres. Traditional consistency models introduce a significant problem for systems architects, which is specially important to note in cases where large amounts of data need to be replicated across wide-area networks. In such scenarios it might be suitable to use eventual consistency, and even though not always convenient, latency can be partly reduced and traded for consistency guarantees so that data-transfers do not impact performance. In contrast, this work proposes a broader range of data semantics for consistency while prioritising data at the cost of putting a minimum latency overhead on the rest of non-critical updates. Finally, we show how these semantics can help in finding an optimal data replication strategy for achieving just the required level of data consistency under low latency and a more efficient network bandwidth utilisation.
Complete list of metadata

Cited literature [33 references]  Display  Hide  Download

https://hal.inria.fr/hal-01370448
Contributor : Álvaro García-Recuero <>
Submitted on : Thursday, September 22, 2016 - 3:30:00 PM
Last modification on : Tuesday, June 15, 2021 - 4:27:43 PM

File

IJBDI.2014.063853.pdf
Publisher files allowed on an open archive

Identifiers

Citation

Álvaro García Recuero, Sérgio Esteves, Luís Veiga. Towards quality-of-service driven consistency for Big Data management. International Journal of Big Data Intelligence, Inderscience Publishers, 2014, 1 (1/2), ⟨10.1504/IJBDI.2014.063853⟩. ⟨hal-01370448⟩

Share

Metrics

Record views

402

Files downloads

304