Abstract:Abstract Objective Rule-based data quality assessment in health care facilities was explored through compilation, implementation, and evaluation of 63,397 data quality rules in a single-center case study to assess the ability of rules-based data quality assessment to identify data errors of importance to physicians and system owners. Methods We applied a design science framework to design, demonstrate, test, and evaluate a scalable framework with which data quality rules can be managed and used in health care facilities for data quality assessment and monitoring. Results We identified 63,397 rules partitioned into 28 logic templates. A total of 819,683 discrepancies were identified by 4.5% of the rules. Nine out of 11 participating clinical and operational leaders indicated that the rules identified data quality problems and articulated next steps that they wanted to take based on the reported information. Discussion The combined rule template and knowledge table approach makes governance and maintenance of otherwise large rule sets manageable. Identified challenges to rule-based data quality monitoring included the lack of curated and maintained knowledge sources relevant to data error detection and lack of organizational resources to support clinical and operational leaders with investigation and characterization of data errors and pursuit of corrective and preventative actions. Limitations of our study included implementation within a single center and dependence of the results on the implemented rule set. Conclusion This study demonstrates a scalable framework (up to 63,397 rules) with which data quality rules can be implemented and managed in health care facilities to identify data errors. The data quality problems identified at the implementation site were important enough to prompt action requests from clinical and operational leaders.

Rules Engine Based Data Cleansing

Cleaning Relations Using Knowledge Bases.

A data cleaning framework based on user feedback

ETC-Based Methodology on Data Processing Validation

ETL-based Solution for Integrating Data in Financial Domain

A Rule-Based Data Quality Assessment System for Electronic Health Record Data

A Data Cleaning Method for Industrial Data Flow Based on Multistage Combinational Optimization of Rule Set

Data Mining for Building Rule-based Fault Diagnosis Systems

AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmark

Discovering Dynamic Integrity Rules with a Rules-Based Tool for Data Quality Analyzing

A rule based data quality assessment architecture and application for electrical data

Automatic Weighted Matching Rectifying Rule Discovery for Data Repairing

An Open Data Cleaning Framework Based on Semantic Rules for Continuous Auditing

A framework of business rules recovery from large legacy systems

A Field-Oriented Approach To Web Form Validation For Database-Isolated Rule

Distilling Relations Using Knowledge Bases

Data Cleaning Based On Entity Resolution

Web Services Based Data Cleaning Architecture Desigh in Agriculture Data Center

Business Rules Extraction from Large Legacy Systems

Towards augmented data quality management: Automation of Data Quality Rule Definition in Data Warehouses

Pattern-Driven Data Cleaning