Enabling High Data Throughput in Desktop Grids Through Decentralized Data and Metadata Management: The BlobSeer Approach - Archive ouverte HAL Access content directly
Conference Papers Year : 2009

Enabling High Data Throughput in Desktop Grids Through Decentralized Data and Metadata Management: The BlobSeer Approach

(1) , (1) , (1)
1
Bogdan Nicolae
  • Function : Author
  • PersonId : 862774
Gabriel Antoniu
Luc Bougé

Abstract

Whereas traditional Desktop Grids rely on centralized servers for data management, some recent progress has been made to enable distributed, large in- put data, using to peer-to-peer (P2P) protocols and Content Distribution Networks (CDN). We make a step further and propose a generic, yet efficient data storage which enables the use of Desktop Grids for applications with high output data re- quirements, where the access grain and the access patterns may be random. Our solution builds on a blob management service enabling a large number of con- current clients to efficiently read/write and append huge data that are fragmented and distributed at a large scale. Scalability under heavy concurrency is achieved thanks to an original metadata scheme using a distributed segment tree built on top of a Distributed Hash Table (DHT). The proposed approach has been imple- mented and its benefits have successfully been demonstrated within our BlobSeer prototype on the Grid'5000 testbed.
Fichier principal
Vignette du fichier
main.pdf (210.2 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00410956 , version 1 (25-08-2009)
inria-00410956 , version 2 (22-10-2009)

Identifiers

Cite

Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Enabling High Data Throughput in Desktop Grids Through Decentralized Data and Metadata Management: The BlobSeer Approach. Euro-Par 2009, TU Delft, Aug 2009, Delft, Netherlands. pp.404-416, ⟨10.1007/978-3-642-03869-3_40⟩. ⟨inria-00410956v2⟩
322 View
350 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More