Budget-aware scheduling algorithms for scientific workflows with stochastic task weights on IaaS Cloud platforms - Archive ouverte HAL Access content directly
Journal Articles Concurrency and Computation: Practice and Experience Year : 2021

Budget-aware scheduling algorithms for scientific workflows with stochastic task weights on IaaS Cloud platforms

(1, 2) , (1, 2) , (1, 2) , (1, 3, 4)
1
2
3
4

Abstract

This paper introduces several budget-aware algorithms to deploy scientific workflows on IaaS Cloud platforms, where users can request Virtual Machines (VMs) of different types, each with specific cost and computing resources. We use a realistic application/platform model with stochastic task weights, and VMs communicating through a Cloud storage. We extend two well-known algorithms, MinMin and HEFT, and make scheduling decisions based upon machine availability and remaining budget. During the mapping process, the budget-aware algorithms make conservative assumptions to avoid exceeding the initial budget; we further improve the results with refined versions that aim at rescheduling some tasks onto faster VMs, thereby spending any budget fraction leftover by the first allocation. These refined variants are much more time-consuming than the former algorithms, so there is a trade-off to find in terms of scalability. We report an extensive set of simulations with workflows from the Pegasus benchmark suite. Most of the time, our budget-aware algorithms succeed in achieving efficient makespans while enforcing the given budget, and this despite the uncertainty in task weights.
Fichier principal
Vignette du fichier
journal.pdf (1.99 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03508925 , version 1 (03-01-2022)

Identifiers

  • HAL Id : hal-03508925 , version 1

Cite

Yves Caniou, Eddy Caron, Aurélie Kong Win Chang, Yves Robert. Budget-aware scheduling algorithms for scientific workflows with stochastic task weights on IaaS Cloud platforms. Concurrency and Computation: Practice and Experience, 2021, 33 (17), pp.1-25. ⟨hal-03508925⟩
13 View
18 Download

Share

Gmail Facebook Twitter LinkedIn More