Abstract:Background: Unexpected variability across healthcare datasets may indicate data quality issues and thereby affect the credibility of these data for reutilization. No gold-standard reference dataset or methods for variability assessment are usually available for these datasets. In this study, we aim to describe the process of discovering data quality implications by applying a set of methods for assessing variability between sources and over time in a large hospital database. Methods: We described and applied a set of multisource and temporal variability assessment methods in a large Portuguese hospitalization database, in which variation in condition-specific hospitalization ratios derived from clinically coded data were assessed between hospitals (sources) and over time. We identified condition-specific admissions using the Clinical Classification Software (CCS), developed by the Agency of Health Care Research and Quality. A Statistical Process Control (SPC) approach based on funnel plots of condition-specific standardized hospitalization ratios (SHR) was used to assess multisource variability, whereas temporal heat maps and Information-Geometric Temporal (IGT) plots were used to assess temporal variability by displaying temporal abrupt changes in data distributions. Results were presented for the 15 most common inpatient conditions (CCS) in Portugal. Main findings: Funnel plot assessment allowed the detection of several outlying hospitals whose SHRs were much lower or higher than expected. Adjusting SHR for hospital characteristics, beyond age and sex, considerably affected the degree of multisource variability for most diseases. Overall, probability distributions changed over time for most diseases, although heterogeneously. Abrupt temporal changes in data distributions for acute myocardial infarction and congestive heart failure coincided with the periods comprising the transition to the International Classification of Diseases, 10th revision, Clinical Modification, whereas changes in the Diagnosis-Related Groups software seem to have driven changes in data distributions for both acute myocardial infarction and liveborn admissions. The analysis of heat maps also allowed the detection of several discontinuities at hospital level over time, in some cases also coinciding with the aforementioned factors. Conclusions: This paper described the successful application of a set of reproducible, generalizable and systematic methods for variability assessment, including visualization tools that can be useful for detecting abnormal patterns in healthcare data, also addressing some limitations of common approaches. The presented method for multisource variability assessment is based on SPC, which is an advantage considering the lack of gold standard for such process. Properly controlling for hospital characteristics and differences in case-mix for estimating SHR is critical for isolating data quality-related variability among data sources. The use of IGT plots provides an advantage over common methods for temporal variability assessment due its suitability for multitype and multimodal data, which are common characteristics of healthcare data. The novelty of this work is the use of a set of methods to discover new data quality insights in healthcare data.

Statistical Behavior of Hospital Admissions for Respiratory Diseases by Probability Distribution Functions

Air pollution and respiratory diseases: ecological time series

Short-term air pollution exposure and hospital admissions for cardiorespiratory diseases in Brazil: A nationwide time-series study between 2008 and 2018

CUSUM and EWMA Control Charts for Negative Binomial Distribution

A Bimodal Exponential Regression Model for Analyzing Dengue Fever Case Rates in the Federal District of Brazil

Hospitalizations for Cardiovascular Diseases Sensitive to Primary Health Care in Parana State, Brazil: A Bayesian Spatiotemporal Model

Bayesian Modeling and Estimation of Spatial Risk for Hospitalization and Mortality from Ischemic Heart Disease in Paraná, Brazil

Forecasting hospital discharges for respiratory conditions in Costa Rica using climate and pollution data

Risk assessment of temperature and air pollutants on hospitalizations for mental and behavioral disorders in Curitiba, Brazil

Generalized Pareto distribution applied to the analysis of maximum rainfall events in Uruguaiana, RS, Brazil

A neuro-fuzzy model to predict respiratory disease hospitalizations arising from the effects of traffic-related air pollution in São Paulo

Ambient Temperature and Dengue Hospitalisation in Brazil: A 10-year period two-stage case-design time series analysis

Fall-Related Hospitalizations in Elderly People: Temporal Trend and Spatial Distribution in Brazil

An Extended Weibull Regression for Censored Data: Application for COVID-19 in Campinas, Brazil

Mapping and Territorial Risk Analysis of Hospital Admissions due to Community-Acquired Pneumonia in Children (Brazil)

Modeling the Evolution of Infectious Diseases with Functional Data Models: The Case of COVID-19 in Brazil

Drivers of respiratory health care demand in Acre state, Brazilian Amazon: a cross-sectional study

Multisource and temporal variability in Portuguese hospital administrative datasets: Data quality implications

Analysis of Probability Distributions for Modelling Extreme Rainfall Events and Detecting Climate Change: Insights from Mathematical and Statistical Methods

Asthma in the Brazilian Unified Health Care System: an epidemiological analysis from 2008 to 2021

Characterisation of the first 250,000 hospital admissions for COVID-19 in Brazil: a retrospective analysis of nationwide data