Eley: On the Effectiveness of Burst Buffers for Big Data Processing in HPC systems - Archive ouverte HAL Access content directly
Conference Papers Year :

Eley: On the Effectiveness of Burst Buffers for Big Data Processing in HPC systems

(1) , (2) , (2, 3)
1
2
3

Abstract

Burst Buffer is an effective solution for reducing the data transfer time and the I/O interference in HPC systems. Extending Burst Buffers (BBs) to handle Big Data applications is challenging because BBs must account for the large data inputs of Big Data applications and the performance guarantees of HPC applications – which are considered as first-class citizens in HPC systems. Existing BBs focus on only intermediate data of Big Data applications and incur a high performance degradation of both Big Data and HPC applications. We present Eley, a burst buffer solution that helps to accelerate the performance of Big Data applications while guaranteeing the performance of HPC applications. In order to improve the performance of Big Data applications, Eley employs a prefetching technique that fetches the input data of these applications to be stored close to computing nodes thus reducing the latency of reading data inputs. Moreover, Eley is equipped with a full delay operator to guarantee the performance of HPC applications – as they are running independently on a HPC system. The experimental results show the effectiveness of Eley in obtaining shorter execution time of Big Data applications (shorter map phase) while guaranteeing the performance of HPC applications.
Fichier principal
Vignette du fichier
Cluster2017-CR.pdf (114.7 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01570737 , version 1 (31-07-2017)

Identifiers

Cite

Orcun Yildiz, Amelie Chi Zhou, Shadi Ibrahim. Eley: On the Effectiveness of Burst Buffers for Big Data Processing in HPC systems. Cluster'17-2017 IEEE International Conference on Cluster Computing, Sep 2017, Honolulu, United States. ⟨10.1109/CLUSTER.2017.73⟩. ⟨hal-01570737⟩
670 View
393 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More