Multisite Management of Data-intensive Scientific Workflows in the Cloud - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

Multisite Management of Data-intensive Scientific Workflows in the Cloud

(1, 2)
1
2

Abstract

The current solutions for the parallel execution of scientific workflows are appropriate for static computing and storage resources in a grid environment. They have been extended to deal with more elastic resources in a cloud, but with only one site. Our analysis [1] of the current techniques of scientific workflow parallelization and scientific workflow execution has shown that there is a lot of room for improvement in the following directions: 1. Data staging: existing techniques mainly focus on the mechanism that starts scientific workflow execution after gathering all the related data in a shared-disk file system at one data center, which is time consuming. 2. Architecture: the structure of SWfMSs is generally centralized, with a master node, which is a single point of failure and performance bottleneck, managing all the optimization and scheduling processes. 3. Task scheduling and data location: most SWfMSs do not take data location into account during task scheduling, which makes it inefficient to read or write data. 4. Multisite: novel task and data scheduling approaches are required for utilizing resources in a multisite cloud. In the rest of this paper, we define more precisely the problem and introduce our approach to address it.
Fichier principal
Vignette du fichier
bda2014-actes-phd-5-pp28-30.pdf (516.58 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive
Loading...

Dates and versions

hal-01169960 , version 1 (30-06-2015)

Licence

Attribution - NonCommercial - NoDerivatives - CC BY 4.0

Identifiers

  • HAL Id : hal-01169960 , version 1

Cite

Ji Liu. Multisite Management of Data-intensive Scientific Workflows in the Cloud. BDA: Gestion de Données — Principes, Technologies et Applications, Oct 2014, Autrans, France. pp.28-30. ⟨hal-01169960⟩
1220 View
162 Download

Share

Gmail Facebook Twitter LinkedIn More