Towards Scalable Array-Oriented Active Storage: the Pyramid Approach

Viet-Trung Tran 1 Bogdan Nicolae 2 Gabriel Antoniu 1
1 KerData - Scalable Storage for Clouds and Beyond
IRISA-D1 - SYSTÈMES LARGE ÉCHELLE, Inria Rennes – Bretagne Atlantique
2 GRAND-LARGE - Global parallel and distributed computing
LRI - Laboratoire de Recherche en Informatique, LIFL - Laboratoire d'Informatique Fondamentale de Lille, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : The recent explosion in data sizes manipulated by distributed scientific applications has prompted the need to develop specialized storage systems capable to deal with specific access patterns in a scalable fashion. In this context, a large class of applications focuses on parallel array processing: small parts of huge multi-dimensional arrays are concurrently accessed by a large number of clients, both for reading and writing. A specialized storage system that deals with such an access pattern faces several challenges at the level of data/metadata management. We introduce Pyramid, an active array-oriented storage system that addresses these challenges. Experimental evaluation demonstrates substantial scalability improvements brought by Pyramid with respect to state-of-art approaches both in weak and strong scaling scenarios, with gains of 100% to 150%.
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download

https://hal.inria.fr/hal-00640900
Contributor : Viet-Trung Tran <>
Submitted on : Monday, November 14, 2011 - 2:12:28 PM
Last modification on : Thursday, March 14, 2019 - 9:14:09 AM
Long-term archiving on : Wednesday, February 15, 2012 - 2:25:22 AM

File

paper.pdf
Files produced by the author(s)

Identifiers

Citation

Viet-Trung Tran, Bogdan Nicolae, Gabriel Antoniu. Towards Scalable Array-Oriented Active Storage: the Pyramid Approach. Operating Systems Review, Association for Computing Machinery, 2012, 46 (1), pp.19-25. ⟨10.1145/2146382.2146387⟩. ⟨hal-00640900⟩

Share

Metrics

Record views

994

Files downloads

411