Linking multiple workflow provenance traces for interoperable collaborative science

Paolo Missier*, Bertram Ludäscher, Shawn Bowers, Saumen Dey, Anandarup Sarkar, Biva Shrestha, Ilkay Altintas, Manish Kumar Anand, Carole Goble

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Scientific collaboration increasingly involves data sharing between separate groups. We consider a scenario where data products of scientific workflows are published and then used by other researchers as inputs to their workflows. For proper interpretation, shared data must be complemented by descriptive metadata. We focus on provenance traces, a prime example of such metadata which describes the genesis and processing history of data products in terms of the computational workflow steps. Through the reuse of published data, virtual, implicitly collaborative experiments emerge, making it desirable to compose the independently generated traces into global ones that describe the combined executions as single, seamless experiments. We present a model for provenance sharing that realizes this holistic view by overcoming the various interoperability problems that emerge from the heterogeneity of workflow systems, data formats, and provenance models. At the heart lie (i) an abstract workflow and provenance model in which (ii) data sharing becomes itself part of the combined workflow. We then describe an implementation of our model that we developed in the context of the Data Observation Network for Earth (DataONE) project and that can "stitch together" traces from different Kepler and Taverna workflow runs. It provides a prototypical framework for seamless cross-system, collaborative provenance management and can be easily extended to include other systems. Our approach also opens the door to new ways of workflow interoperability not only through often elusive workflow standards but through shared provenance information from public repositories.

Original languageEnglish
Title of host publication2010 5th Workshop on Workflows in Support of Large-Scale Science, WORKS 2010
DOIs
Publication statusPublished - 2010
Event2010 5th Workshop on Workflows in Support of Large-Scale Science, WORKS 2010 - New Orleans, LA, United States
Duration: 14 Nov 201014 Nov 2010

Publication series

Name2010 5th Workshop on Workflows in Support of Large-Scale Science, WORKS 2010

Conference

Conference2010 5th Workshop on Workflows in Support of Large-Scale Science, WORKS 2010
Country/TerritoryUnited States
CityNew Orleans, LA
Period14/11/1014/11/10

ASJC Scopus subject areas

  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Linking multiple workflow provenance traces for interoperable collaborative science'. Together they form a unique fingerprint.

Cite this