The lifecycle of provenance metadata and its associated challenges and opportunities

Paolo Missier

DOI: https://doi.org/10.48550/arXiv.1605.01229

2016-05-04

Databases

Abstract:This chapter outlines some of the challenges and opportunities associated with adopting provenance principles and standards in a variety of disciplines, including data publication and reuse, and information sciences.

What problem does this paper attempt to address?

Representing provenance and track changes of cultural heritage metadata in RDF: a survey of existing approaches

Arcangelo Massari,Silvio Peroni,Francesca Tomasi,Ivan Heibi

2024-09-22

Abstract:In the realm of Digital Humanities, the management of cultural heritage metadata is pivotal for ensuring data trustworthiness. Provenance information - contextual metadata detailing the origin and history of data - plays a crucial role in this process. However, tracking provenance and changes in metadata using the Resource Description Framework (RDF) presents significant challenges due to the limitations of foundational Semantic Web technologies. This article offers a comprehensive review of existing models and approaches for representing provenance and tracking changes in RDF, with a specific focus on cultural heritage metadata. It examines W3C standard proposals such as RDF Reification and n-ary relations, along with various alternative systems. Through an in-depth analysis, the study identifies Named Graphs, RDF*, the Provenance Ontology (PROV-O), Dublin Core (DC), Conjectural Graphs, and the OpenCitations Data Model (OCDM) as the most effective solutions. These models are evaluated based on their compliance with RDF standards, scalability, and applicability across different domains. The findings underscore the importance of selecting the appropriate model to ensure robust and reliable management of provenance in RDF datasets, thereby contributing to the ongoing discourse on provenance representation in the Digital Humanities.

Digital Libraries
Provenance Information for Biomedical Data and Workflows: Scoping Review

Kerstin Gierend,Frank Krüger,Sascha Genehr,Francisca Hartmann,Fabian Siegel,Dagmar Waltemath,Thomas Ganslandt,Atinkut Alamirrew Zeleke

DOI: https://doi.org/10.2196/51297

2024-08-23

Abstract:Background: The record of the origin and the history of data, known as provenance, holds importance. Provenance information leads to higher interpretability of scientific results and enables reliable collaboration and data sharing. However, the lack of comprehensive evidence on provenance approaches hinders the uptake of good scientific practice in clinical research. Objective: This scoping review aims to identify approaches and criteria for provenance tracking in the biomedical domain. We reviewed the state-of-the-art frameworks, associated artifacts, and methodologies for provenance tracking. Methods: This scoping review followed the methodological framework developed by Arksey and O'Malley. We searched the PubMed and Web of Science databases for English-language articles published from 2006 to 2022. Title and abstract screening were carried out by 4 independent reviewers using the Rayyan screening tool. A majority vote was required for consent on the eligibility of papers based on the defined inclusion and exclusion criteria. Full-text reading and screening were performed independently by 2 reviewers, and information was extracted into a pretested template for the 5 research questions. Disagreements were resolved by a domain expert. The study protocol has previously been published. Results: The search resulted in a total of 764 papers. Of 624 identified, deduplicated papers, 66 (10.6%) studies fulfilled the inclusion criteria. We identified diverse provenance-tracking approaches ranging from practical provenance processing and managing to theoretical frameworks distinguishing diverse concepts and details of data and metadata models, provenance components, and notations. A substantial majority investigated underlying requirements to varying extents and validation intensities but lacked completeness in provenance coverage. Mostly, cited requirements concerned the knowledge about data integrity and reproducibility. Moreover, these revolved around robust data quality assessments, consistent policies for sensitive data protection, improved user interfaces, and automated ontology development. We found that different stakeholder groups benefit from the availability of provenance information. Thereby, we recognized that the term provenance is subjected to an evolutionary and technical process with multifaceted meanings and roles. Challenges included organizational and technical issues linked to data annotation, provenance modeling, and performance, amplified by subsequent matters such as enhanced provenance information and quality principles. Conclusions: As data volumes grow and computing power increases, the challenge of scaling provenance systems to handle data efficiently and assist complex queries intensifies, necessitating automated and scalable solutions. With rising legal and scientific demands, there is an urgent need for greater transparency in implementing provenance systems in research projects, despite the challenges of unresolved granularity and knowledge bottlenecks. We believe that our recommendations enable quality and guide the implementation of auditable and measurable provenance approaches as well as solutions in the daily tasks of biomedical scientists. International registered report identifier (irrid): RR2-10.2196/31750.
Research on Data Provenance Model for Multidisciplinary Collaboration.

Fangyu Yu,Beisi Zhou,Tun Lu,Ning Gu

DOI: https://doi.org/10.1007/978-981-13-3044-5_3

2018-01-01

Abstract:Provenance, which can be applied to assure quality, to reinforce reliability, to track fault, and to reproduce process in the end product, refers to record the lifecycle of a piece of data or thing that accounts for its generation, transformation, manipulation, and consumption, together with an explanation of how and why it got to the present place. Recently, due to its extensive applicative domains, the provenance modeling problems have brought to attention of scientific researchers significantly. In this paper, an overview of core components regarding provenance models in existing literature is presented, with a wide width from modelling methods, model comparison, and model practice, to specified issues. In addition, a collaborative model called CollabPG, was built based on the characteristics of multidisciplinary collaboration. Finally, we discussed several issues in relevance with provenance models. This paper mainly presents an overall exploration and analysis, so that potential insights could be provided for both expert and common users to select or design a provenance-based model in arbitrary applications especially multidisciplinary collaboration.
Supporting Better Insights of Data Science Pipelines with Fine-grained Provenance

Adriane Chapman,Luca Lauro,Paolo Missier,Riccardo Torlone

DOI: https://doi.org/10.1145/3644385

IF: 1.6289

2024-02-09

ACM Transactions on Database Systems

Abstract:Successful data-driven science requires complex data engineering pipelines to clean, transform, and alter data in preparation for machine learning, and robust results can only be achieved when each step in the pipeline can be justified, and its effect on the data explained. In this framework, we aim to provide data scientists with facilities to gain an in-depth understanding of how each step in the pipeline affects the data, from the raw input to training sets ready to be used for learning. Starting from an extensible set of data preparation operators commonly used within a data science setting, in this work we present a provenance management infrastructure for generating, storing, and querying very granular accounts of data transformations, at the level of individual elements within datasets whenever possible. Then, from the formal definition of a core set of data science preprocessing operators, we derive a provenance semantics embodied by a collection of templates expressed in PROV, a standard model for data provenance. Using those templates as a reference, our provenance generation algorithm generalises to any operator with observable input/output pairs. We provide a prototype implementation of an application-level provenance capture library to produce, in a semi-automatic way, complete provenance documents that account for the entire pipeline. We report on the ability of that reference implementation to capture provenance in real ML benchmark pipelines and over TCP-DI synthetic data. We finally show how the collected provenance can be used to answer a suite of provenance benchmark queries that underpin some common pipeline inspection questions, as expressed on the Data Science Stack Exchange.

computer science, information systems, software engineering
Special Issue: The First Provenance Challenge

Luc Moreau,Bertram Ludascher,Ilkay Altintas,Roger S. Barga,Shawn Bowers,Steven Callahan,George Chin,Ben Clifford,Shirley Cohen,Sarah Cohen-Boulakia,Susan Davidson,Ewa Deelman,Luciano Digiampietri,Ian Foster,Juliana Freire,James Frew,Joe Futrelle,Tara Gibson,Yolanda Gil,Carole Goble,Jennifer Golbeck,Paul Groth,David A. Holland,Sheng Jiang,Jihie Kim,David Koop,Ales Krenek,Timothy Mcphillips,Gaurang Mehta,Simon Miles,Dominic Metzger,Steve Munroe,Jim Myers,Beth Plale,Norbert Podhorszki,Varun Ratnakar,Emanuele Santos,Carlos Scheidegger,Karen Schuchardt,Margo Seltzer,Yogesh L. Simmhan,Claudio Silva,Peter Slaughter,Eric Stephan,Robert Stevens,Daniele Turi,Huy Vo,Mike Wilde,Jun Zhao,Yong Zhao

DOI: https://doi.org/10.1002/cpe.1233

2008-01-01

Abstract:The first Provenance Challenge was set up in order to provide a forum for the community to understand the capabilities of different provenance systems and the expressiveness of their provenance representations. To this end, a functional magnetic resonance imaging workflow was defined, which participants had to either simulate or run in order to produce some provenance representation, from which a set of identified queries had to be implemented and executed. Sixteen teams responded to the challenge, and submitted their inputs. In this paper, we present the challenge workflow and queries, and summarize the participants' contributions. Copyright (C) 2007 John Wiley & Sons, Ltd.
ProvAbs: model, policy, and tooling for abstracting PROV graphs

Paolo Missier,Jeremy Bryans,Carl Gamble,Vasa Curcin,Roxana Danger

DOI: https://doi.org/10.48550/arXiv.1406.1998

2014-06-09

Abstract:Provenance metadata can be valuable in data sharing settings, where it can be used to help data consumers form judgements regarding the reliability of the data produced by third parties. However, some parts of provenance may be sensitive, requiring access control, or they may need to be simplified for the intended audience. Both these issues can be addressed by a single mechanism for creating abstractions over provenance, coupled with a policy model to drive the abstraction. Such mechanism, which we refer to as abstraction by grouping, simultaneously achieves partial disclosure of provenance, and facilitates its consumption. In this paper we introduce a formal foundation for this type of abstraction, grounded in the W3C PROV model; describe the associated policy model; and briefly present its implementation, the Provabs tool for interactive experimentation with policies and abstractions.

Databases
PAV ontology: Provenance, Authoring and Versioning

Paolo Ciccarese,Stian Soiland-Reyes,Khalid Belhajjame,Alasdair J G Gray,Carole Goble,Tim Clark

DOI: https://doi.org/10.1186/2041-1480-4-37

2013-12-07

Abstract:Provenance is a critical ingredient for establishing trust of published scientific content. This is true whether we are considering a data set, a computational workflow, a peer-reviewed publication or a simple scientific claim with supportive evidence. Existing vocabularies such as DC Terms and the W3C PROV-O are domain-independent and general-purpose and they allow and encourage for extensions to cover more specific needs. We identify the specific need for identifying or distinguishing between the various roles assumed by agents manipulating digital artifacts, such as author, contributor and curator. We present the Provenance, Authoring and Versioning ontology (PAV): a lightweight ontology for capturing just enough descriptions essential for tracking the provenance, authoring and versioning of web resources. We argue that such descriptions are essential for digital scientific content. PAV distinguishes between contributors, authors and curators of content and creators of representations in addition to the provenance of originating resources that have been accessed, transformed and consumed. We explore five projects (and communities) that have adopted PAV illustrating their usage through concrete examples. Moreover, we present mappings that show how PAV extends the PROV-O ontology to support broader interoperability. The authors strived to keep PAV lightweight and compact by including only those terms that have demonstrated to be pragmatically useful in existing applications, and by recommending terms from existing ontologies when plausible. We analyze and compare PAV with related approaches, namely Provenance Vocabulary, DC Terms and BIBFRAME. We identify similarities and analyze their differences with PAV, outlining strengths and weaknesses of our proposed model. We specify SKOS mappings that align PAV with DC Terms.

Digital Libraries,Information Retrieval
SOK: Blockchain for Provenance

Asma Jodeiri Akbarfam,Hoda Maleki

2024-07-25

Abstract:Provenance, which traces data from its creation to manipulation, is crucial for ensuring data integrity, reliability, and trustworthiness. It is valuable for single-user applications, collaboration within organizations, and across organizations. Blockchain technology has become a popular choice for implementing provenance due to its distributed, transparent, and immutable nature. Numerous studies on blockchain designs are specifically dedicated to provenance, and specialize in this area. Our goal is to provide a new perspective in blockchain based provenance field by identifying the challenges faced and suggesting future research directions. In this paper, we categorize the problem statement into three main research questions to investigate key issues comprehensively and propose a new outlook on the use of blockchains. The first focuses on challenges in non-collaborative, single-source environments, the second examines implications in collaborative environments and different domains such as supply chain, scientific collaboration and digital forensic, and the last one analyzes communication and data exchange challenges between organizations using different blockchains. The interconnected nature of these research questions ensures a thorough exploration of provenance requirements, leading to more effective and secure systems. After analyzing the requirements of provenance in different environments, we provide future design considerations for provenance-based blockchains, including blockchain type, query mechanisms, provenance capture methods, and domain-specific considerations. We also discuss future work and possible extensions in this field.

Cryptography and Security,Distributed, Parallel, and Cluster Computing
Data Provenance in Healthcare: Approaches, Challenges, and Future Directions

Mansoor Ahmed,Amil Rohani Dar,Markus Helfert,Abid Khan,Jungsuk Kim

DOI: https://doi.org/10.3390/s23146495

2023-07-18

Abstract:Data provenance means recording data origins and the history of data generation and processing. In healthcare, data provenance is one of the essential processes that make it possible to track the sources and reasons behind any problem with a user's data. With the emergence of the General Data Protection Regulation (GDPR), data provenance in healthcare systems should be implemented to give users more control over data. This SLR studies the impacts of data provenance in healthcare and GDPR-compliance-based data provenance through a systematic review of peer-reviewed articles. The SLR discusses the technologies used to achieve data provenance and various methodologies to achieve data provenance. We then explore different technologies that are applied in the healthcare domain and how they achieve data provenance. In the end, we have identified key research gaps followed by future research directions.
A case study on propagating and updating provenance information using the CIDOC CRM

Christos Strubulis,Giorgos Flouris,Yannis Tzitzikas,Martin Doerr

DOI: https://doi.org/10.1007/s00799-014-0125-z

2014-08-29

International Journal on Digital Libraries

Abstract:Provenance information of digital objects maintained by digital libraries and archives is crucial for authenticity assessment, reproducibility and accountability. Such information is commonly stored on metadata placed in various Metadata Repositories (MRs) or Knowledge Bases (KBs). Nevertheless, in various settings it is prohibitive to store the provenance of each digital object due to the high storage space requirements that are needed for having complete provenance. In this paper, we introduce provenance-based inference rules as a means to complete the provenance information, to reduce the amount of provenance information that has to be stored, and to ease quality control (e.g., corrections). Roughly, we show how provenance information can be propagated by identifying a number of basic inference rules over a core conceptual model for representing provenance. The propagation of provenance concerns fundamental modelling concepts such as actors, activities, events, devices and information objects, and their associations. However, since a MR/KB is not static but changes over time due to several factors, the question that arises is how we can satisfy update requests while still supporting the aforementioned inference rules. Towards this end, we elaborate on the specification of the required add/delete operations, consider two different semantics for deletion of information, and provide the corresponding update algorithms. Finally, we report extensive comparative results for different repository policies regarding the derivation of new knowledge, in datasets containing up to one million RDF triples. The results allow us to understand the tradeoffs related to the use of inference rules on storage space and performance of queries and updates.
The First Provenance Challenge

Luc Moreau,Bertram Ludascher,Ilkay Altintas,Roger S. Barga,Shawn Bowers,Steven Callahan,George Chin Jr,Ben Cliord,Shirley Cohen,Sarah Cohen-Boulakia,Susan Davidson,Ewa Deelman,Luciano Digiampietri,Ian Foster,Juliana Freire,James Frew,Joe Futrelle,Tara Gibson,Yolanda Gil,Carole Goble,Jennifer Golbeck,Paul Groth,David A. Holland,Sheng Jiang,Jihie Kim,David Koop,Ales Krenek,Timothy McPhillips,Gaurang Mehta,Simon Miles,Dominic Metzger,Steve Munroe,Jim Myers,Beth Plale,Norbert Podhorszki,Varun Ratnakar,Emanuele Santos,Carlos Scheidegger,Karen Schuchardt,Margo Seltzer,Yogesh L. Simmhan,Claudio Silva,Peter Slaughter,Eric Stephan,Robert Stevens,Daniele Turi,Huy Vo,Mike Wilde,Jun Zhao,Yong Zhao

2007-01-01

Abstract:SUMMARY The first Provenance Challenge was a community activity aiming at understanding the expressiveness of provenance representations and capabilities of provenance systems. To this end, a Functional Magnetic Resonance Imaging workflow was defined, which participants had to either simulate or run in order to produce some provenance representation, from which a set of identified queries had to be implemented and executed. Seventeen teams responded to the challenge, and submitted their inputs. In this paper, we present the challenge workflow and queries, and summarise the participants contributions.
Towards Understanding Provenance in Industry

Matthias Galster,Jens Dietrich

DOI: https://doi.org/10.48550/arXiv.2302.06038

2023-02-13

Abstract:Context: Trustworthiness of software has become a first-class concern of users (e.g., to understand software-made decisions). Also, there is increasing demand to demonstrate regulatory compliance of software and end users want to understand how software-intensive systems make decisions that affect them. Objective: We aim to provide a step towards understanding provenance needs of the software industry to support trustworthy software. Provenance is information about entities, activities, and people involved in producing data, software, or output of software, and used to assess software quality, reliability and trustworthiness of digital products and services. Method: Based on data from in-person and questionnaire-based interviews with professionals in leadership roles we develop an ``influence map'' to analyze who drives provenance, when provenance is relevant, what is impacted by provenance and how provenance can be managed. Results: The influence map helps decision makers navigate concerns related to provenance. It can also act as a checklist for initial provenance analyses of systems. It is empirically-grounded and designed bottom-up (based on perceptions of practitioners) rather than top-down (from regulations or policies). Conclusion: We present an imperfect first step towards understanding provenance based on current perceptions and offer a preliminary view ahead.

Software Engineering
One Method for Provenance Tracking of Product Lifecycle Data in Collaborative Service Environment.

Genquan Ren,Li Zhang,Jianmin Wang,Yinbo Liu

DOI: https://doi.org/10.1109/cyberc.2011.62

2011-01-01

Abstract:It is vital to provides more necessary and accurate data for product services and knowledge discovery through provenance tracking of product lifecycle data. We propose one three-level framework of provenance tracking of product lifecycle data, which is consisting of business level, process level and data level firstly. After the models of product lifecycle data and their data provenance are given, the organization of product lifecycle data and the design of provenance annotations are explored. Then the tracking algorithms are described and one method for product lifecycle data on business level in collaborative service environment is suggested. The method is verified in one prototype system. The verification results show that it is enough to the provenance tracking of product life statuses and physical BOM in collaborative service environment.
A step forward in tracing and documenting dataset provenance

Nicholas Vincent

DOI: https://doi.org/10.1038/s42256-024-00884-w

IF: 23.8

2024-09-02

Nature Machine Intelligence

Abstract:Training data are crucial for advancements in artificial intelligence, but many questions remain regarding the provenance of training datasets, license enforcement and creator consent. Mahari et al. provide a set of tools for tracing, documenting and sharing AI training data and highlight the importance for developers to engage with metadata of datasets.

computer science, artificial intelligence, interdisciplinary applications
A Survey on Management of Data Provenance

高明,金澈清,王晓玲,田秀霞,周傲英

DOI: https://doi.org/10.3724/sp.j.1016.2010.00373

2010-01-01

Chinese Journal of Computers

Abstract:The data provenance describes about how data is generated and evolves with time going on,which has many applications,including evaluation of data quality,audit trail,replication recipes,data citation,etc.Generally,the data provenance could be recorded among multiple sources,or just within a single data source.In other words,the derivation history of data could take place either in schema level,or in instance level.This paper surveys the researches about presentation and query of data provenance both in schema level and instance level.For the schema level,the focus is on query rewriting and schema mappings,and for the instance level,the focus includes relational data provenance,XML data provenance,streaming data provenance.Moreover,the research efforts of uncertain data provenance to track the derivation of data and uncertainty are also summarized.Finally,this paper lists applications of the data provenance,discusses the main challenges,and points out some research issues in future.
Data Provenance for Sport

Andrew J. Simmons,Scott Barnett,Simon Vajda,Rajesh Vasa

DOI: https://doi.org/10.48550/arXiv.1812.05804

2018-12-14

Databases

Abstract:Data analysts often discover irregularities in their underlying dataset, which need to be traced back to the original source and corrected. Standards for representing data provenance (i.e. the origins of the data), such as the W3C PROV standard, can assist with this process, however require a mapping between abstract provenance concepts and the domain of use in order to apply them effectively. We propose a custom notation for expressing provenance of information in the sport performance analysis domain, and map our notation to concepts in the W3C PROV standard where possible. We evaluate the functionality of W3C PROV (without specialisations) and the VisTrails workflow manager (without extensions), and find that as is, neither are able to fully capture sport performance analysis workflows, notably due to limitations surrounding capture of automated and manual activities respectively. Furthermore, their notations suffer from ineffective use of visual design space, and present potential usability issues as their terminology is unlikely to match that of sport practitioners. Our findings suggest that one-size-fits-all provenance and workflow systems are a poor fit in practice, and that their notation and functionality need to be optimised for the domain of use.
Ontological Entities for Planning and Describing Cultural Heritage 3D Models Creation

Nicola Amico,Achille Felicetti

DOI: https://doi.org/10.48550/arXiv.2106.07277

2021-06-14

Digital Libraries

Abstract:In the last decades the rapid development of technologies and methodologies in the field of digitization and 3D modelling has led to an increasing proliferation of 3D technologies in the Cultural Heritage domain. Despite the great potential of 3D digital heritage, the "special effects" of 3D may often overwhelm its importance in research. Projects and consortia of scholars have tried to put order in the different fields of application of these technologies, providing guidelines and proposing workflows. The use of computer graphics as an effective methodology for CH research and communication highlighted the need of transparent provenance data to properly document digital assets and understand the degree of scientific quality and reliability of their outcomes. The building and release of provenance knowledge, consisting in the complete formal documentation of each phase of the process, is therefore of fundamental importance to ensure its repeatability and to guarantee the integration and interoperability of the generated metadata on the Semantic Web. This paper proposes a methodology for documenting the planning and creation of 3D models used in archaeology and Cultural Heritage, by means of an application profile based on the CIDOC CRM ecosystem and other international standards.
Trusted Provenance of Automated, Collaborative and Adaptive Data Processing Pipelines

Ludwig Stage,Dimka Karastoyanova

2023-10-18

Abstract:To benefit from the abundance of data and the insights it brings data processing pipelines are being used in many areas of research and development in both industry and academia. One approach to automating data processing pipelines is the workflow technology, as it also supports collaborative, trial-and-error experimentation with the pipeline architecture in different application domains. In addition to the necessary flexibility that such pipelines need to possess, in collaborative settings cross-organisational interactions are plagued by lack of trust. While capturing provenance information related to the pipeline execution and the processed data is a first step towards enabling trusted collaborations, the current solutions do not allow for provenance of the change in the processing pipelines, where the subject of change can be made on any aspect of the workflow implementing the pipeline and on the data used while the pipeline is being executed. Therefore in this work we provide a solution architecture and a proof of concept implementation of a service, called Provenance Holder, which enable provenance of collaborative, adaptive data processing pipelines in a trusted manner. We also contribute a definition of a set of properties of such a service and identify future research directions.

Cryptography and Security

The lifecycle of provenance metadata and its associated challenges and opportunities

Representing provenance and track changes of cultural heritage metadata in RDF: a survey of existing approaches

Provenance Information for Biomedical Data and Workflows: Scoping Review

Research on Data Provenance Model for Multidisciplinary Collaboration.

Supporting Better Insights of Data Science Pipelines with Fine-grained Provenance

Special Issue: The First Provenance Challenge

ProvAbs: model, policy, and tooling for abstracting PROV graphs

PAV ontology: Provenance, Authoring and Versioning

SOK: Blockchain for Provenance

Data Provenance in Healthcare: Approaches, Challenges, and Future Directions

A case study on propagating and updating provenance information using the CIDOC CRM

The First Provenance Challenge

Towards Understanding Provenance in Industry

One Method for Provenance Tracking of Product Lifecycle Data in Collaborative Service Environment.

A step forward in tracing and documenting dataset provenance

A Survey on Management of Data Provenance

Data Provenance for Sport

Ontological Entities for Planning and Describing Cultural Heritage 3D Models Creation

Trusted Provenance of Automated, Collaborative and Adaptive Data Processing Pipelines