Distributed Management of Massive Data: an Efficient Fine-Grain Data Access Scheme

Bogdan Nicolae 1 Gabriel Antoniu 1, * Luc Bougé 1
* Auteur correspondant
1 PARIS - Programming distributed parallel systems for large scale numerical simulation
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, ENS Cachan - École normale supérieure - Cachan, Inria Rennes – Bretagne Atlantique
Abstract : This paper addresses the problem of efficiently storing and accessing massive data blocks in a large-scale distributed environment, while providing efficient fine-grain access to data subsets. This issue is crucial in the context of applications in the field of databases, data mining and multimedia. We propose a data sharing service based on distributed, RAM-based storage of data, while leveraging a DHT-based, natively parallel metadata management scheme. As opposed to the most commonly used grid storage infrastructures that provide mechanisms for explicit data localization and transfer, we provide a transparent access model, where data are accessed through global identifiers. Our proposal has been validated through a prototype implementation whose preliminary evaluation provides promising results.
Type de document :
Communication dans un congrès
VECPAR '08: Proceedings of the 8th International Conference on High Performance Computing for Computational Science, Jun 2008, Toulouse, France. 5336, pp.532-543, 2008, LNCS. 〈10.1007/978-3-540-92859-1_47〉
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00323248
Contributeur : Bogdan Nicolae <>
Soumis le : dimanche 12 octobre 2008 - 22:45:21
Dernière modification le : mercredi 16 mai 2018 - 11:23:04
Document(s) archivé(s) le : mardi 28 juin 2011 - 16:42:51

Fichiers

paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Distributed Management of Massive Data: an Efficient Fine-Grain Data Access Scheme. VECPAR '08: Proceedings of the 8th International Conference on High Performance Computing for Computational Science, Jun 2008, Toulouse, France. 5336, pp.532-543, 2008, LNCS. 〈10.1007/978-3-540-92859-1_47〉. 〈inria-00323248〉

Partager

Métriques

Consultations de la notice

366

Téléchargements de fichiers

173