A Generic API for Load Balancing in Structured P2P Systems

Maeva Antoine 1 Laurent Pellegrino 1 Fabrice Huet 1 Françoise Baude 1
1 SCALE - Safe Composition of Autonomous applications with Large-SCALE Execution environment
Laboratoire I3S - COMRED - COMmunications, Réseaux, systèmes Embarqués et Distribués
Abstract : Real world datasets are known to be highly skewed, often leading to an important load imbalance issue for distributed systems managing them. To address this issue, there exist almost as many load balancing strategies as there are different systems. When designing a scalable distributed system geared towards handling large amounts of information, it is often not so easy to anticipate which kind of strategy will be the most efficient to maintain adequate performance regarding response time, scalability and reliability at any time. Based on this observation, we describe the methodology behind the building of a generic API to implement and experiment any strategy independently from the rest of the code, prior to a definitive choice for instance. We then show how this API is compatible with famous existing systems and their load balancing scheme. We also present results from our own distributed system which targets the continuous storage of events structured according to the Semantic Web standards, further retrieved by interested parties. As such, our system constitutes a typical example of a Big Data environment.
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.inria.fr/hal-01101688
Contributor : Maeva Antoine <>
Submitted on : Wednesday, July 15, 2015 - 11:15:05 AM
Last modification on : Saturday, December 8, 2018 - 1:20:51 AM
Long-term archiving on : Wednesday, April 26, 2017 - 4:32:54 AM

File

api_loadbalancing.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Maeva Antoine, Laurent Pellegrino, Fabrice Huet, Françoise Baude. A Generic API for Load Balancing in Structured P2P Systems. 26th International Symposium on Computer Architecture and High Performance Computing, Oct 2014, Paris, France. pp.138 - 143, ⟨10.1109/SBAC-PADW.2014.17⟩. ⟨hal-01101688v2⟩

Share

Metrics

Record views

417

Files downloads

272