Extending Inferences From Sample To Target Populations: On The Generalizability Of A Real-World Clinico-Genomic Database Non-Small Cell Lung Cancer Cohort

Darren S. Thomas,Simon Collin,Luis C. Berrocal-Almanza,Heide Stirnadel-Farrant,Yiduo Zhang,Ping Sun
DOI: https://doi.org/10.1101/2023.06.15.23291372
2024-02-21
Abstract:The representativeness of Real-world Data is assumed, but findings will rarely generalise to the target population when the potential outcomes under treatment are influenced by variables causative of selection into a study. We assess the extent of selection biases in a de-identified nationwide US Clinico-Genomic Database Non-Small Cell Lung Cancer cohort through each process using two referent populations: a superset of all NSCLC patients in the Flatiron Health network and the National Cancer Institute’s Surveillance, Epidemiology and End Results cancer registrations. Despite Standardised Differences suggesting differences in individual covariates between sample and referent populations, the conditional distributions of selection were alike, and indices suggest the results being generalizable (≥ 0.96 on a proportional scale of 0–1). Estimates of Real-world Overall Survival in a population weighted to be representative did not differ from naïve estimates in the unweighted cohort. We conclude with a counterfactual analysis highlighting how the Average Treatment Effect in the Sample and Population were concordant under an example having a Generalizability Index of 0.97. The Tipton Generalizability Index provides a quantitative assessment of the generalizability of findings that can be used to determine the influence of selection biases.
Epidemiology
What problem does this paper attempt to address?