Representing interoperable provenance descriptions for ETL workflows

André Freitas, Benedikt Kämpgen, João Gabriel Oliveira, Seán O'Riain, Edward Curry

Research output: Contribution to a Journal (Peer & Non Peer)Conference articlepeer-review

Abstract

The increasing availability of data on the Web provided by the emergence of Web 2.0 applications and, more recently by Linked Data, brought additional complexity to data management tasks, where the number of available data sources and their associated heterogeneity drastically increases. In this scenario, where data is reused and repurposed on a new scale, the pattern expressed as Extract-Transform-Load (ETL) emerges as a fundamental and recurrent process for both producers and consumers of data on the Web. In addition to ETL, provenance, the representation of source artifacts, processes and agents behind data, becomes another cornerstone element forWeb data management, playing a fundamental role in data quality assessment, data semantics and facilitating the reproducibility of data transformation processes. This paper proposes the convergence of this two Web data management concerns, introducing a principled provenance model for ETL processes in the form of a vocabulary based on the Open Provenance Model (OPM) standard and focusing on the provision of an interoperable provenance model for Web-based ETL environments. The proposed ETL provenance model is instantiated in a real-world sustainability reporting scenario.

Original languageEnglish
JournalCEUR Workshop Proceedings
Volume856
Publication statusPublished - 2012
Event3rd International Workshop on Semantic Web in Provenance Management, SWPM 2012 - Heraklion, Greece
Duration: 28 May 201228 May 2012

Keywords

  • Data transformation
  • ETL
  • Linked data
  • Provenance
  • Web

Fingerprint

Dive into the research topics of 'Representing interoperable provenance descriptions for ETL workflows'. Together they form a unique fingerprint.

Cite this