Layer Decomposition: An Effective Structure-based Approach for Scientific Workflow Similarity - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

Layer Decomposition: An Effective Structure-based Approach for Scientific Workflow Similarity

(1) , (2, 3, 4, 5, 6) , (7) , (7) , (1)
1
2
3
4
5
6
7

Abstract

Scientific workflows have become a valuable tool for large-scale data processing and analysis. This has led to the creation of specialized online repositories to facilitate workflow sharing and reuse. Over time, these repositories have grown to sizes that call for advanced methods to support workflow discovery, in particular for effective similarity search. Here, we present a novel and intuitive workflow similarity measure that is based on layer decomposition. Layer decomposition accounts for the directed dataflow underlying scientific workflows, a property which has not been adequately considered in previous methods. We comparatively evaluate our algorithm using a gold standard for 24 query workflows from a repository of almost 1500 scientific workflows, and show that it a) delivers the best results for similarity search, b) has a much lower runtime than other, often highly complex competitors in structure-aware workflow comparison, and c) can be stacked easily with even faster, structure-agnostic approaches to further reduce runtime while retaining result quality.
Fichier principal
Vignette du fichier
starlingerEscience.pdf (748.05 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01066076 , version 1 (19-09-2014)

Identifiers

Cite

Johannes Starlinger, Sarah Cohen-Boulakia, Sanjeev Khanna, Susan Davidson, Ulf Leser. Layer Decomposition: An Effective Structure-based Approach for Scientific Workflow Similarity. International Conference on e-Science, Oct 2014, Guarujá, Brazil. pp.169-176, ⟨10.1109/eScience.2014.19⟩. ⟨hal-01066076⟩
919 View
449 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More