Scalability of Replicated Metadata Services in Distributed File Systems

Abstract : There has been considerable interest recently in the use of highly-available configuration management services based on the Paxos family of algorithms to address long-standing problems in the management of large-scale heterogeneous distributed systems. These problems include providing distributed locking services, determining group membership, electing a leader, managing configuration parameters, etc. While these services are finding their way into the management of distributed middleware systems and data centers in general, there are still areas of applicability that remain largely unexplored. One such area is the management of metadata in distributed file systems. In this paper we show that a Paxos-based approach to building metadata services in distributed file systems can achieve high availability without incurring a performance penalty. Moreover, we demonstrate that it is easy to retrofit such an approach to existing systems (such as PVFS and HDFS) that currently use different approaches to availability. Our overall approach is based on the use of a general-purpose Paxos-compatible component (the embedded Oracle Berkeley database) along with a methodology for making it interoperate with existing distributed file system metadata services.
Type de document :
Communication dans un congrès
Karl Michael Göschka; Seif Haridi. 12th International Conference on Distributed Applications and Interoperable Systems (DAIS), Jun 2012, Stockholm, Sweden. Springer, Lecture Notes in Computer Science, LNCS-7272, pp.31-44, 2012, Distributed Applications and Interoperable Systems. 〈10.1007/978-3-642-30823-9_3〉
Liste complète des métadonnées

Littérature citée [24 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01527651
Contributeur : Hal Ifip <>
Soumis le : mercredi 24 mai 2017 - 17:23:09
Dernière modification le : mercredi 30 mai 2018 - 10:26:02
Document(s) archivé(s) le : lundi 28 août 2017 - 16:11:32

Fichier

978-3-642-30823-9_3_Chapter.pd...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Dimokritos Stamatakis, Nikos Tsikoudis, Ourania Smyrnaki, Kostas Magoutis. Scalability of Replicated Metadata Services in Distributed File Systems. Karl Michael Göschka; Seif Haridi. 12th International Conference on Distributed Applications and Interoperable Systems (DAIS), Jun 2012, Stockholm, Sweden. Springer, Lecture Notes in Computer Science, LNCS-7272, pp.31-44, 2012, Distributed Applications and Interoperable Systems. 〈10.1007/978-3-642-30823-9_3〉. 〈hal-01527651〉

Partager

Métriques

Consultations de la notice

70

Téléchargements de fichiers

49