Capturing interactive data transformation operations using provenance workflows

Tope Omitola; André Freitas; Edward Curry; Séan O’Riain; Nicholas Gibbins; Nigel Shadbolt

doi:10.1007/978-3-662-46641-4_3

Capturing interactive data transformation operations using provenance workflows

Tope Omitola, André Freitas, Edward Curry, Séan O’Riain, Nicholas Gibbins, Nigel Shadbolt

Research output: Chapter in Book or Conference Publication/Proceeding › Conference Publication › peer-review

Abstract

The ready availability of data is leading to the increased opportunity of their re-use for new applications and for analyses. Most of these data are not necessarily in the format users want, are usually heterogeneous, and highly dynamic, and this necessitates data transformation efforts to re-purpose them. Interactive data transformation (IDT) tools are becoming easily available to lower these barriers to data transformation efforts. This paper describes a principled way to capture data lineage of interactive data transformation processes. We provide a formal model of IDT, its mapping to a provenance representation, and its implementation and validation on Google Refine. Provision of the data transformation process sequences allows assessment of data quality and ensures portability between IDT and other data transformation platforms. The proposed model showed a high level of coverage against a set of requirements used for evaluating systems that provide provenance management solutions.

Original language	English
Title of host publication	The Semantic Web
Subtitle of host publication	ESWC 2012 Satellite Events - Revised Selected Papers
Editors	Alexandre Passant, Barry Norton, Emanuele Della Valle, Raphael Troncy, Irini Fundulaki, Elena Simperl, Dunja Mladenic
Publisher	Springer-Verlag
Pages	29-42
Number of pages	14
ISBN (Print)	9783662466407
DOIs	https://doi.org/10.1007/978-3-662-46641-4_3
Publication status	Published - 2015
Event	Extended Semantic Web Conference, ESWC 2012 - Heraklion, Greece Duration: 27 May 2012 → 31 May 2012

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	7540
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	Extended Semantic Web Conference, ESWC 2012
Country/Territory	Greece
City	Heraklion
Period	27/05/12 → 31/05/12

Keywords

Data consumption
Data publication
Extract-Transform-Load
Interactive data transformation
Linked Data
Provenance
Public open data
Semantic Web
Workflow

Access to Document

10.1007/978-3-662-46641-4_3

Cite this

Omitola, T., Freitas, A., Curry, E., O’Riain, S., Gibbins, N., & Shadbolt, N. (2015). Capturing interactive data transformation operations using provenance workflows. In A. Passant, B. Norton, E. D. Valle, R. Troncy, I. Fundulaki, E. Simperl, & D. Mladenic (Eds.), The Semantic Web: ESWC 2012 Satellite Events - Revised Selected Papers (pp. 29-42). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7540). Springer-Verlag. https://doi.org/10.1007/978-3-662-46641-4_3

Omitola, Tope ; Freitas, André ; Curry, Edward et al. / Capturing interactive data transformation operations using provenance workflows. The Semantic Web: ESWC 2012 Satellite Events - Revised Selected Papers. editor / Alexandre Passant ; Barry Norton ; Emanuele Della Valle ; Raphael Troncy ; Irini Fundulaki ; Elena Simperl ; Dunja Mladenic. Springer-Verlag, 2015. pp. 29-42 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{5d19064ec9d34bf8b4aa7c0df787d95a,

title = "Capturing interactive data transformation operations using provenance workflows",

abstract = "The ready availability of data is leading to the increased opportunity of their re-use for new applications and for analyses. Most of these data are not necessarily in the format users want, are usually heterogeneous, and highly dynamic, and this necessitates data transformation efforts to re-purpose them. Interactive data transformation (IDT) tools are becoming easily available to lower these barriers to data transformation efforts. This paper describes a principled way to capture data lineage of interactive data transformation processes. We provide a formal model of IDT, its mapping to a provenance representation, and its implementation and validation on Google Refine. Provision of the data transformation process sequences allows assessment of data quality and ensures portability between IDT and other data transformation platforms. The proposed model showed a high level of coverage against a set of requirements used for evaluating systems that provide provenance management solutions.",

keywords = "Data consumption, Data publication, Extract-Transform-Load, Interactive data transformation, Linked Data, Provenance, Public open data, Semantic Web, Workflow",

author = "Tope Omitola and Andr{\'e} Freitas and Edward Curry and S{\'e}an O{\textquoteright}Riain and Nicholas Gibbins and Nigel Shadbolt",

note = "Publisher Copyright: {\textcopyright} Springer-Verlag Berlin Heidelberg 2015.; Extended Semantic Web Conference, ESWC 2012 ; Conference date: 27-05-2012 Through 31-05-2012",

year = "2015",

doi = "10.1007/978-3-662-46641-4_3",

language = "English",

isbn = "9783662466407",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer-Verlag",

pages = "29--42",

editor = "Alexandre Passant and Barry Norton and Valle, {Emanuele Della} and Raphael Troncy and Irini Fundulaki and Elena Simperl and Dunja Mladenic",

booktitle = "The Semantic Web",

}

Omitola, T, Freitas, A, Curry, E, O’Riain, S, Gibbins, N & Shadbolt, N 2015, Capturing interactive data transformation operations using provenance workflows. in A Passant, B Norton, ED Valle, R Troncy, I Fundulaki, E Simperl & D Mladenic (eds), The Semantic Web: ESWC 2012 Satellite Events - Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7540, Springer-Verlag, pp. 29-42, Extended Semantic Web Conference, ESWC 2012, Heraklion, Greece, 27/05/12. https://doi.org/10.1007/978-3-662-46641-4_3

Capturing interactive data transformation operations using provenance workflows. / Omitola, Tope; Freitas, André; Curry, Edward et al.
The Semantic Web: ESWC 2012 Satellite Events - Revised Selected Papers. ed. / Alexandre Passant; Barry Norton; Emanuele Della Valle; Raphael Troncy; Irini Fundulaki; Elena Simperl; Dunja Mladenic. Springer-Verlag, 2015. p. 29-42 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7540).

Research output: Chapter in Book or Conference Publication/Proceeding › Conference Publication › peer-review

TY - GEN

T1 - Capturing interactive data transformation operations using provenance workflows

AU - Omitola, Tope

AU - Freitas, André

AU - Curry, Edward

AU - O’Riain, Séan

AU - Gibbins, Nicholas

AU - Shadbolt, Nigel

N1 - Publisher Copyright: © Springer-Verlag Berlin Heidelberg 2015.

PY - 2015

Y1 - 2015

N2 - The ready availability of data is leading to the increased opportunity of their re-use for new applications and for analyses. Most of these data are not necessarily in the format users want, are usually heterogeneous, and highly dynamic, and this necessitates data transformation efforts to re-purpose them. Interactive data transformation (IDT) tools are becoming easily available to lower these barriers to data transformation efforts. This paper describes a principled way to capture data lineage of interactive data transformation processes. We provide a formal model of IDT, its mapping to a provenance representation, and its implementation and validation on Google Refine. Provision of the data transformation process sequences allows assessment of data quality and ensures portability between IDT and other data transformation platforms. The proposed model showed a high level of coverage against a set of requirements used for evaluating systems that provide provenance management solutions.

AB - The ready availability of data is leading to the increased opportunity of their re-use for new applications and for analyses. Most of these data are not necessarily in the format users want, are usually heterogeneous, and highly dynamic, and this necessitates data transformation efforts to re-purpose them. Interactive data transformation (IDT) tools are becoming easily available to lower these barriers to data transformation efforts. This paper describes a principled way to capture data lineage of interactive data transformation processes. We provide a formal model of IDT, its mapping to a provenance representation, and its implementation and validation on Google Refine. Provision of the data transformation process sequences allows assessment of data quality and ensures portability between IDT and other data transformation platforms. The proposed model showed a high level of coverage against a set of requirements used for evaluating systems that provide provenance management solutions.

KW - Data consumption

KW - Data publication

KW - Extract-Transform-Load

KW - Interactive data transformation

KW - Linked Data

KW - Provenance

KW - Public open data

KW - Semantic Web

KW - Workflow

UR - http://www.scopus.com/inward/record.url?scp=84942693607&partnerID=8YFLogxK

U2 - 10.1007/978-3-662-46641-4_3

DO - 10.1007/978-3-662-46641-4_3

M3 - Conference Publication

AN - SCOPUS:84942693607

SN - 9783662466407

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 29

EP - 42

BT - The Semantic Web

A2 - Passant, Alexandre

A2 - Norton, Barry

A2 - Valle, Emanuele Della

A2 - Troncy, Raphael

A2 - Fundulaki, Irini

A2 - Simperl, Elena

A2 - Mladenic, Dunja

PB - Springer-Verlag

T2 - Extended Semantic Web Conference, ESWC 2012

Y2 - 27 May 2012 through 31 May 2012

ER -

Omitola T, Freitas A, Curry E, O’Riain S, Gibbins N, Shadbolt N. Capturing interactive data transformation operations using provenance workflows. In Passant A, Norton B, Valle ED, Troncy R, Fundulaki I, Simperl E, Mladenic D, editors, The Semantic Web: ESWC 2012 Satellite Events - Revised Selected Papers. Springer-Verlag. 2015. p. 29-42. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-662-46641-4_3

Capturing interactive data transformation operations using provenance workflows

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this