Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping

Abstract : Cluster-based storage systems connected with TCP/IP networks are expected to achieve a high throughput by striping files across multiple storage servers. However, for the storage system interconnected with the TCP/IP network, several critical issues, like Incast effect and data access interference, invalidate the assumption that higher access parallelism always results in increased I/O throughput. To address this issue, we propose a new file striping strategy, named as storage server grouping (SSG), which changes file striping pattern across the storage servers based on the analysis of file popularity and impact of the number of storage servers on the clients' perceived performance (I/O speedup) to reduce the interference of data accesses to popular files and avoid dramatic reduction of system throughput caused by the Incast effect. Our experimental evaluation shows that SSG can improve I/O throughput by 22.1% on average.
Type de document :
Communication dans un congrès
Chen Ding; Zhiyuan Shao; Ran Zheng. IFIP International Conference on Network and Parallel Computing (NPC), Sep 2010, Zhengzhou, China. Springer, Lecture Notes in Computer Science, LNCS-6289, pp.373-389, 2010, Network and Parallel Computing. 〈10.1007/978-3-642-15672-4_31〉
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01054971
Contributeur : Hal Ifip <>
Soumis le : lundi 11 août 2014 - 09:23:41
Dernière modification le : vendredi 11 août 2017 - 17:44:00
Document(s) archivé(s) le : mercredi 26 novembre 2014 - 21:35:42

Fichier

final-paper.pdf
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Xuechen Zhang, Guiquan Liu, Song Jiang. Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping. Chen Ding; Zhiyuan Shao; Ran Zheng. IFIP International Conference on Network and Parallel Computing (NPC), Sep 2010, Zhengzhou, China. Springer, Lecture Notes in Computer Science, LNCS-6289, pp.373-389, 2010, Network and Parallel Computing. 〈10.1007/978-3-642-15672-4_31〉. 〈hal-01054971〉

Partager

Métriques

Consultations de la notice

46

Téléchargements de fichiers

68