Enabling High Data Throughput in Desktop Grids Through Decentralized Data and Metadata Management: The BlobSeer Approach

Bogdan Nicolae 1 Gabriel Antoniu 1 Luc Bougé 1
1 KerData - Scalable Storage for Clouds and Beyond
Inria Rennes – Bretagne Atlantique , IRISA-D1 - SYSTÈMES LARGE ÉCHELLE
Abstract : Whereas traditional Desktop Grids rely on centralized servers for data management, some recent progress has been made to enable distributed, large in- put data, using to peer-to-peer (P2P) protocols and Content Distribution Networks (CDN). We make a step further and propose a generic, yet efficient data storage which enables the use of Desktop Grids for applications with high output data re- quirements, where the access grain and the access patterns may be random. Our solution builds on a blob management service enabling a large number of con- current clients to efficiently read/write and append huge data that are fragmented and distributed at a large scale. Scalability under heavy concurrency is achieved thanks to an original metadata scheme using a distributed segment tree built on top of a Distributed Hash Table (DHT). The proposed approach has been imple- mented and its benefits have successfully been demonstrated within our BlobSeer prototype on the Grid'5000 testbed.
Type de document :
Communication dans un congrès
Euro-Par 2009, Aug 2009, Delft, Netherlands. pp.404-416, 2009, 〈10.1007/978-3-642-03869-3_40〉
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00410956
Contributeur : Bogdan Nicolae <>
Soumis le : jeudi 22 octobre 2009 - 13:31:31
Dernière modification le : mercredi 11 avril 2018 - 01:57:12
Document(s) archivé(s) le : samedi 26 novembre 2016 - 13:29:32

Fichier

main.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Enabling High Data Throughput in Desktop Grids Through Decentralized Data and Metadata Management: The BlobSeer Approach. Euro-Par 2009, Aug 2009, Delft, Netherlands. pp.404-416, 2009, 〈10.1007/978-3-642-03869-3_40〉. 〈inria-00410956v2〉

Partager

Métriques

Consultations de la notice

575

Téléchargements de fichiers

171