Abstract:BACKGROUND: The need is growing to create medical big data based on the electronic health records collected from different hospitals. Errors for sure occur and how to correct them should be explored.METHODS: Electronic health records of 9,197,817 patients and 53,081,148 visits, totaling about 500 million records for 2006-2016, were transmitted from eight hospitals into an integrated database. We randomly selected 10% of patients, accumulated the primary keys for their tabulated data, and compared the key numbers in the transmitted data with those of the raw data. Errors were identified based on statistical testing and clinical reasoning.RESULTS: Data were recorded in 1573 tables. Among these, 58 (3.7%) had different key numbers, with the maximum of 16.34/1000. Statistical differences (P < 0.05) were found in 34 (58.6%), of which 15 were caused by changes in diagnostic codes, wrong accounts, or modified orders. For the rest, the differences were related to accumulation of hospital visits over time. In the remaining 24 tables (41.4%) without significant differences, three were revised because of incorrect computer programming or wrong accounts. For the rest, the programming was correct and absolute differences were negligible. The applicability was confirmed using the data of 2,730,883 patients and 15,647,468 patient-visits transmitted during 2017-2018, in which 10 (3.5%) tables were corrected.CONCLUSION: Significant magnitude of inconsistent data does exist during the transmission of big data from diverse sources. Systematic validation is essential. Comparing the number of data tabulated using the primary keys allow us to rapidly identify and correct these scattered errors.

Analysis of Data Quality Problems in the Digital Hospital and Relevant Solutions

Unitary Management of Information in Digitalized Hospital

Medical Big Data Analysis In Hospital Information System

Data Analysis on Health Management Systems for Improving Doctor's Advice on Patients

Data mining analysis of inpatient fees in Hospital Information System

Research and Design of Quantitative Analysis System on Physical Examination Status

Research and development on data quality assessment management system

Assessing The Practice Of Data Quality Evaluation In A National Clinical Data Research Network Through A Systematic Scoping Review In The Era Of Real-World Data

Strengthen the Quality Management of Department, Help with the Quality Improvement of the Hospital

Design of Digitalization Application for Hospital's Heterogeneous Business Data in the Ai Era

Data quality in hospital information systems: Lessons learned from analyzing 30 years of patient data in a regional German hospital

Quality assurance of integrative big data for medical research within a multihospital system

On the Quality Control of the Scanning of the Paper Medical Records

A Review of Data Quality Assessment Methods for Public Health Information Systems

Data quality analysis of regional health information platform of community medical institutions in Beijing

Digital transformation of hospital quality and safety: real-time data for real-time action

Study on Quality Improvement of Inpatient Medical Service in General Hospitals

Application of Electronic Information Engineering in Hospital Management

Hospital Operational Data Center: Building and Application

Data Quality in Traditional Chinese Medicine

Ensuring Data Integrity in Electronic Health Records: A Quality Health Care Implication