Skip to Main content Skip to Navigation
New interface
Conference papers

Distributed Management of Massive Data: an Efficient Fine-Grain Data Access Scheme

Bogdan Nicolae 1 Gabriel Antoniu 1, * Luc Bougé 1 
* Corresponding author
1 PARIS - Programming distributed parallel systems for large scale numerical simulation
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, ENS Cachan - École normale supérieure - Cachan, Inria Rennes – Bretagne Atlantique
Abstract : This paper addresses the problem of efficiently storing and accessing massive data blocks in a large-scale distributed environment, while providing efficient fine-grain access to data subsets. This issue is crucial in the context of applications in the field of databases, data mining and multimedia. We propose a data sharing service based on distributed, RAM-based storage of data, while leveraging a DHT-based, natively parallel metadata management scheme. As opposed to the most commonly used grid storage infrastructures that provide mechanisms for explicit data localization and transfer, we provide a transparent access model, where data are accessed through global identifiers. Our proposal has been validated through a prototype implementation whose preliminary evaluation provides promising results.
Complete list of metadata

Cited literature [19 references]  Display  Hide  Download
Contributor : Bogdan Nicolae Connect in order to contact the contributor
Submitted on : Sunday, October 12, 2008 - 10:45:21 PM
Last modification on : Friday, February 4, 2022 - 3:24:37 AM
Long-term archiving on: : Tuesday, June 28, 2011 - 4:42:51 PM


Files produced by the author(s)



Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Distributed Management of Massive Data: an Efficient Fine-Grain Data Access Scheme. VECPAR '08: Proceedings of the 8th International Conference on High Performance Computing for Computational Science, Jun 2008, Toulouse, France. pp.532-543, ⟨10.1007/978-3-540-92859-1_47⟩. ⟨inria-00323248⟩



Record views


Files downloads