Hadoop-Benchmark: Rapid Prototyping and Evaluation of Self-Adaptive Behaviors in Hadoop Clusters

Bo Zhang 1, 2 Filip Krikava 3 Romain Rouvoy 1, 2, 4 Lionel Seinturier 1, 2
1 SPIRALS - Self-adaptation for distributed services and large software systems
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
2 Université de Lille, Sciences et Technologies
3 FIT - Faculty of Information Technology [Prague]
4 IUF - Institut Universitaire de France
Abstract : Optimizing Hadoop executions has attracted a lot of research contributions in particular in the domain of self-adaptive software systems. However, these research efforts are often hindered by the complexity of Hadoop operation and the difficulty to reproduce experimental evaluations that makes it hard to compare different approaches to one another. To address this limitation, we propose a research acceleration platform for rapid prototyping and evaluation of self-adaptive behavior in Hadoop clusters. Essentially, it provides automated approach to provision reproducible Hadoop environments and execute acknowledged benchmarks. It is based on the state-of-the-art container technology that supports both distributed configurations as well as standalone single-host setups. We demonstrate the approach on a complete implementation of a concrete Hadoop self-adaptive case study. The artifact is available at: https://github.com/Spirals-Team/hadoop-benchmark/raw/SEAMS17/artifact.zip
Keywords : Hadoop artefact self-adaptation
Document type :
Conference papers
Complete list of metadatas

Cited literature [10 references]  Display  Hide  Download
https://hal.inria.fr/hal-01475635
Contributor : Romain Rouvoy <>
Submitted on : Thursday, February 23, 2017 - 10:32:04 PM
Last modification on : Wednesday, December 11, 2019 - 2:48:11 PM

File

seams17.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01475635, version 1

Collections

INRIA | CNRS | CRISTAL-SPIRALS | CRISTAL | UNIV-LILLE

Citation

Bo Zhang, Filip Krikava, Romain Rouvoy, Lionel Seinturier. Hadoop-Benchmark: Rapid Prototyping and Evaluation of Self-Adaptive Behaviors in Hadoop Clusters. 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS'17), May 2017, Buenos Aires, Argentina. pp.6. ⟨hal-01475635⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

632

Files downloads

359

 

 

Contact

archive-ouverte@inria.fr