Hadoop-Benchmark: Rapid Prototyping and Evaluation of Self-Adaptive Behaviors in Hadoop Clusters

Abstract : Optimizing Hadoop executions has attracted a lot of research contributions in particular in the domain of self-adaptive software systems. However, these research efforts are often hindered by the complexity of Hadoop operation and the difficulty to reproduce experimental evaluations that makes it hard to compare different approaches to one another. To address this limitation, we propose a research acceleration platform for rapid prototyping and evaluation of self-adaptive behavior in Hadoop clusters. Essentially, it provides automated approach to provision reproducible Hadoop environments and execute acknowledged benchmarks. It is based on the state-of-the-art container technology that supports both distributed configurations as well as standalone single-host setups. We demonstrate the approach on a complete implementation of a concrete Hadoop self-adaptive case study. The artifact is available at: https://github.com/Spirals-Team/hadoop-benchmark/raw/SEAMS17/artifact.zip
Complete list of metadatas

Cited literature [10 references]  Display  Hide  Download

https://hal.inria.fr/hal-01475635
Contributor : Romain Rouvoy <>
Submitted on : Thursday, February 23, 2017 - 10:32:04 PM
Last modification on : Thursday, April 4, 2019 - 10:18:05 AM

File

seams17.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01475635, version 1

Citation

Bo Zhang, Filip Krikava, Romain Rouvoy, Lionel Seinturier. Hadoop-Benchmark: Rapid Prototyping and Evaluation of Self-Adaptive Behaviors in Hadoop Clusters. 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS'17), May 2017, Buenos Aires, Argentina. pp.6. ⟨hal-01475635⟩

Share

Metrics

Record views

614

Files downloads

270