Quality assessment of real-world data repositories across the data life cycle: A literature review
Siaw-Teng Liaw,Jason Guan Nan Guo,Sameera Ansari,Jitendra Jonnagaddala,Myron Anthony Godinho,Alder Jose Borelli,Simon de Lusignan,Daniel Capurro,Harshana Liyanage,Navreet Bhattal,Vicki Bennett,Jaclyn Chan,Michael G Kahn
DOI: https://doi.org/10.1093/jamia/ocaa340
2021-01-26
Journal of the American Medical Informatics Association
Abstract:Abstract Objective Data quality (DQ) must be consistently defined in context. The attributes, metadata, and context of longitudinal real-world data (RWD) have not been formalized for quality improvement across the data production and curation life cycle. We sought to complete a literature review on DQ assessment frameworks, indicators and tools for research, public health, service, and quality improvement across the data life cycle. Materials and Methods The review followed PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Databases from health, physical and social sciences were used: Cinahl, Embase, Scopus, ProQuest, Emcare, PsycINFO, Compendex, and Inspec. Embase was used instead of PubMed (an interface to search MEDLINE) because it includes all MeSH (Medical Subject Headings) terms used and journals in MEDLINE as well as additional unique journals and conference abstracts. A combined data life cycle and quality framework guided the search of published and gray literature for DQ frameworks, indicators, and tools. At least 2 authors independently identified articles for inclusion and extracted and categorized DQ concepts and constructs. All authors discussed findings iteratively until consensus was reached. Results The 120 included articles yielded concepts related to contextual (data source, custodian, and user) and technical (interoperability) factors across the data life cycle. Contextual DQ subcategories included relevance, usability, accessibility, timeliness, and trust. Well-tested computable DQ indicators and assessment tools were also found. Conclusions A DQ assessment framework that covers intrinsic, technical, and contextual categories across the data life cycle enables assessment and management of RWD repositories to ensure fitness for purpose. Balancing security, privacy, and FAIR principles requires trust and reciprocity, transparent governance, and organizational cultures that value good documentation.
information science & library science,computer science, information systems, interdisciplinary applications,health care sciences & services,medical informatics