Emulation of Storage Performance in Testbed Experiments with Distem

Abdulqawi Saif 1 Alexandre Merlin 1 Olivier Dautricourt 1, 2 Maël Houbre 2 Lucas Nussbaum 1 Ye-Qiong Song 3, 4
1 RESIST - Resilience and Elasticity for Security and ScalabiliTy of dynamic networked systems
Inria Nancy - Grand Est, LORIA - NSS - Department of Networks, Systems and Services
2 TELECOM Nancy
3 LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
4 SIMBIOT - SIMulating and Building IOT
LORIA - NSS - Department of Networks, Systems and Services
Abstract : Together with the CPU and the network, storage plays an essential role in the overall performance of applications, especially in the context of big data applications, that can deal with enormous datasets. However, testbeds have scarce support for experiments involving storage performance. Experimenters can use the storage devices provided on the testbed directly, but (1) they might not provide the suitable performance characteristics for their experiments; (2) it might leave an uncontrolled bias over the experiments' results. In this paper, we explore the feasibility of using Linux's control groups to emulate I/O performance for testbed experiments. We then use it in the Distem emulator to create a customizable I/O experimental environment. Using Distem, we perform experiments on Hadoop to highlight the advantage of emulating I/O performance. Results obtained from a cluster of 25 nodes show how the performance of Hadoop changes according to emulated storage performance.
Keywords : experimentation I/O performance emulation testbeds experimental environments
Document type :
Conference papers
Complete list of metadatas

Cited literature [12 references]  Display  Hide  Download
https://hal.inria.fr/hal-02078301
Contributor : Abdulqawi Saif <>
Submitted on : Monday, March 25, 2019 - 11:06:58 AM
Last modification on : Friday, April 26, 2019 - 8:49:00 AM
Long-term archiving on: Wednesday, June 26, 2019 - 1:31:05 PM

File

DistemIO.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02078301, version 1

Collections

CNRS | UNIV-LORRAINE | LORIA | LORIA-NSS | INRIA | GRID5000

Citation

Abdulqawi Saif, Alexandre Merlin, Olivier Dautricourt, Maël Houbre, Lucas Nussbaum, et al.. Emulation of Storage Performance in Testbed Experiments with Distem. CNERT 2019 - IEEE INFOCOM International Workshop on Computer and Networking Experimental Research using Testbeds, Apr 2019, Paris, France. pp.6. ⟨hal-02078301⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

111

Files downloads

115

 

 

Contact

archive-ouverte@inria.fr