Bridging Data in the Clouds: An Environment-Aware System for Geographically Distributed Data Transfers - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

Bridging Data in the Clouds: An Environment-Aware System for Geographically Distributed Data Transfers

(1) , (1) , (1) , (1) , (1)
1
Radu Tudoran
  • Function : Author
  • PersonId : 914308
Luc Bougé
Gabriel Antoniu

Abstract

Today's continuously growing cloud infrastructures provide support for processing ever increasing amounts of scientific data. Cloud resources for computation and storage are spread among globally distributed datacenters. Thus, to leverage the full computation power of the clouds, global data processing across multiple sites has to be fully enabled. However, managing data across geographically distributed datacenters is not trivial as it involves high and variable latencies among sites which come at a high monetary cost. In this work, we propose a uniform data management system for scientific applications running across geographically distributed sites. Our solution is environment aware, as it monitors and models the global cloud infrastructure, and offers predictable data handling performance for transfer cost and time. In terms of efficiency, it provides the applications with the possibility to set a tradeoff between money and time and optimizes the transfer strategy accordingly. The system was validated on Microsoft's Azure cloud across the 6 EU and US datacenters. The experiments were conducted on hundreds of nodes using both synthetic benchmarks and the real life A-Brain application. The results show that our system is able to model and predict well the cloud performance and to leverage this into efficient data dissemination. Our approach reduces the monetary costs and transfer time by up to 3 times.
Fichier principal
Vignette du fichier
CCGrid2014_Camera_Ready.pdf (708.86 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00978153 , version 1 (12-04-2014)

Identifiers

  • HAL Id : hal-00978153 , version 1

Cite

Radu Tudoran, Alexandru Costan, Rui Wang, Luc Bougé, Gabriel Antoniu. Bridging Data in the Clouds: An Environment-Aware System for Geographically Distributed Data Transfers. 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2014, Chicago, United States. ⟨hal-00978153⟩
412 View
506 Download

Share

Gmail Facebook Twitter LinkedIn More