Replicating a COVID-19 study in a national England database to assess the generalisability of research with regional electronic health record data

Richard Williams,David Jenkins,Thomas Bolton,Adrian Heald,Mehrdad A Mizani,Matthew Sperrin,Niels Peek,CVD-COVID-UK/COVID-IMPACT Consortium
DOI: https://doi.org/10.1101/2024.08.06.24311538
2024-08-30
Abstract:Objectives To assess the degree to which we can replicate a study between a regional and a national database of electronic health record data in the United Kingdom. Design A replication of a retrospective cohort study. Setting Observational EHR data from primary and secondary care sources in the UK. The original study used data from a large, urbanised region (Greater Manchester Care Record, Greater Manchester, UK). This replication study used a national database covering the whole of England, UK (NHS England's Secure Data Environment service for England, accessed via the BHF Data Science Centre's CVD-COVID-UK/COVID-IMPACT Consortium). Participants Individuals with a diagnosis of T1D or T2D prior to a positive COVID-19 test result. The matched controls (3:1) were individuals who had a positive COVID-19 test result, but who did not have a diagnosis of diabetes on the date of their positive COVID-19 test result. Matching was done on age at COVID-19 diagnosis, sex and approximate date of COVID-19 test. Primary and secondary outcome measures Hospitalization within 28 days of a positive COVID-19 test. Results We found that many of the effect sizes did not show a statistically significant difference. Where effect sizes were statistically significant in the regional study, then they remained significant in the national study and the effect size was the same direction and of similar magnitude. Conclusions There is some evidence that the findings from studies in smaller regional datasets can be extrapolated to a larger, national setting. However, there were some significant differences and therefore replication studies remain an essential part of healthcare research.
What problem does this paper attempt to address?