GinFlow: A Decentralised Adaptive Workflow Execution Manager

Javier Rojas Balderrama 1 Matthieu Simonin 1 Cédric Tedeschi 1
1 MYRIADS - Design and Implementation of Autonomous Distributed Systems
IRISA-D1 - SYSTÈMES LARGE ÉCHELLE, Inria Rennes – Bretagne Atlantique
Abstract : Workflow-based computing has become a dominant paradigm to design and execute scientific applications. After the initial breakthrough of now standard workflow management sys- tems, several approaches have recently proposed to decentralise the coordination of the execution. In particular, shared space-based coordination has been shown to provide appropriate building blocks for such a decentralised execution. Uncertainty is also still a major concern in scientific workflows. The ability to adapt the workflow, change its shape and switch for alternate scenarios on-the-fly is still missing in workflow management systems. In this paper, based on the shared space model, we firstly devise a programmatic way to specify such adaptive workflows. We use a reactive, rule-based programming model to modify the workflow description by changing its asso- ciated direct acyclic graph on-the-fly without needing to stop and restart the execution from the beginning. Secondly, we present the GinFlow middleware, a resilient decentralised workflow execu- tion manager implementing these concepts. Through a set of deployments of adaptive workflows of different characteristics, we discuss the GinFlow performance and resilience and show the limited overhead of the adaptiveness mechanism, making it a promising decentralised adaptive workflow execution manager.
Document type :
Reports
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/hal-01232682
Contributor : Matthieu Simonin <>
Submitted on : Thursday, March 24, 2016 - 10:24:03 AM
Last modification on : Monday, August 5, 2019 - 9:30:06 AM

File

RR-8813.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01232682, version 2

Citation

Javier Rojas Balderrama, Matthieu Simonin, Cédric Tedeschi. GinFlow: A Decentralised Adaptive Workflow Execution Manager. [Research Report] RR-8813, Inria; Rennes 1. 2015, pp.27. ⟨hal-01232682v2⟩

Share

Metrics

Record views

446

Files downloads

634