Resilin: Elastic MapReduce over Multiple Clouds

Abstract : The MapReduce programming model offers a simple and efficient way of performing distributed computation over large data sets. To enable the usage of MapReduce in the cloud, Amazon Web Services offers Elastic MapReduce (EMR), a web service enabling users to easily run MapReduce jobs by leveraging Amazon resources (i.e. compute and storage). EMR takes care of tasks such as resource provisioning, performance tuning, and fault tolerance thus allowing the users to concentrate on the problem to be solved. However, EMR is restricted to Amazon's resources and is provided at an additional cost. In this paper, we present the design, implementation, and evaluation of Resilin, a novel EMR API-compatible system to perform distributed MapReduce computations. Resilin goes one step beyond Amazon's proprietary EMR solution and allows users (e.g. companies, scientists) to leverage resources from one or multiple public and/or private clouds. This gives Resilin users the opportunity to perform MapReduce computations over a large number of potentially geographically distributed resources. An extensive experimental evaluation conducted on multiple clusters of the Grid'5000 experimentation testbed shows that Resilin enables the use of geographically distributed resources with only limited impact on MapReduce jobs execution time.
Document type :
Conference papers
13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2013, Delft, Netherlands. ACM, 2013
Liste complète des métadonnées

https://hal.inria.fr/hal-00790406
Contributor : Anca Iordache <>
Submitted on : Wednesday, February 20, 2013 - 10:55:55 AM
Last modification on : Friday, November 16, 2018 - 1:39:30 AM

Identifiers

  • HAL Id : hal-00790406, version 1

Citation

Anca Iordache, Christine Morin, Nikos Parlavantzas, Eugen Feller, Pierre Riteau. Resilin: Elastic MapReduce over Multiple Clouds. 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2013, Delft, Netherlands. ACM, 2013. 〈hal-00790406〉

Share

Metrics

Record views

897