Resilin: Elastic MapReduce over Multiple Clouds

Abstract : The MapReduce programming model offers a simple and efficient way of performing distributed computation over large data sets. To enable the usage of MapReduce in the cloud, Amazon Web Services offers Elastic MapReduce (EMR), a web service enabling users to easily run MapReduce jobs by leveraging Amazon resources (i.e. compute and storage). EMR takes care of tasks such as resource provisioning, performance tuning, and fault tolerance thus allowing the users to concentrate on the problem to be solved. However, EMR is restricted to Amazon's resources and is provided at an additional cost. In this paper, we present the design, implementation, and evaluation of Resilin, a novel EMR API-compatible system to perform distributed MapReduce computations. Resilin goes one step beyond Amazon's proprietary EMR solution and allows users (e.g. companies, scientists) to leverage resources from one or multiple public and/or private clouds. This gives Resilin users the opportunity to perform MapReduce computations over a large number of potentially geographically distributed resources. An extensive experimental evaluation conducted on multiple clusters of the Grid'5000 experimentation testbed shows that Resilin enables the use of geographically distributed resources with only limited impact on MapReduce jobs execution time.
Type de document :
Communication dans un congrès
13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2013, Delft, Netherlands. ACM, 2013
Liste complète des métadonnées

https://hal.inria.fr/hal-00790406
Contributeur : Anca Iordache <>
Soumis le : mercredi 20 février 2013 - 10:55:55
Dernière modification le : vendredi 16 novembre 2018 - 01:39:30

Identifiants

  • HAL Id : hal-00790406, version 1

Citation

Anca Iordache, Christine Morin, Nikos Parlavantzas, Eugen Feller, Pierre Riteau. Resilin: Elastic MapReduce over Multiple Clouds. 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2013, Delft, Netherlands. ACM, 2013. 〈hal-00790406〉

Partager

Métriques

Consultations de la notice

897