TomusBlobs: Scalable Data-intensive Processing on Azure Clouds

Abstract : The emergence of cloud computing has brought the opportunity to use large-scale compute infrastructures for a broader and broader spectrum of applications and users. As the cloud paradigm gets attractive for the "elasticity'' in resource usage and associated costs (the users only pay for resources actually used), cloud applications still suffer from the high latencies and low performance of cloud storage services. As Big Data analysis on clouds becomes more and more relevant in many application areas, enabling high-throughput massive data processing on cloud data becomes a critical issue, as it impacts the overall application performance. In this paper we address this challenge at the level of cloud storage. We introduce a concurrency-optimized data storage system (called TomusBlobs) which federates the virtual disks associated to the Virtual Machines running the application code on the cloud. We demonstrate the performance benefits of our solution for efficient data-intensive processing by building an optimized prototype MapReduce framework for Microsoft's Azure cloud platform based on TomusBlobs. Finally, we specifically address the limitations of state-of-the-art MapReduce frameworks for reduce-intensive workloads, by proposing MapIterativeReduce as an extension of the MapReduce model. We validate the above contributions through large-scale experiments with synthetic benchmarks and with real-world applications on the Azure commercial cloud, using resources distributed across multiple data centers: they demonstrate that our solutions bring substantial benefits to data intensive applications compared to approaches relying on state-of-the-art cloud object storage.
Type de document :
Article dans une revue
Concurrency and Computation: Practice and Experience, Wiley, 2013, 〈10.1002/cpe.3034〉
Liste complète des métadonnées

Littérature citée [22 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00767034
Contributeur : Gabriel Antoniu <>
Soumis le : mercredi 31 août 2016 - 15:05:14
Dernière modification le : mercredi 11 avril 2018 - 02:00:28
Document(s) archivé(s) le : vendredi 2 décembre 2016 - 03:21:57

Fichier

paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Alexandru Costan, Radu Tudoran, Gabriel Antoniu, Goetz Brasche. TomusBlobs: Scalable Data-intensive Processing on Azure Clouds. Concurrency and Computation: Practice and Experience, Wiley, 2013, 〈10.1002/cpe.3034〉. 〈hal-00767034〉

Partager

Métriques

Consultations de la notice

1390

Téléchargements de fichiers

105