Interpretable (not just posthoc-explainable) heterogeneous survivor bias-corrected treatment effects for assignment of postdischarge interventions to prevent readmissions

Hongjing Xia,Joshua C. Chang,Sarah Nowak,Sonya Mahajan,Rohit Mahajan,Ted L. Chang,Carson C. Chow
2023-08-04
Abstract:We used survival analysis to quantify the impact of postdischarge evaluation and management (E/M) services in preventing hospital readmission or death. Our approach avoids a specific pitfall of applying machine learning to this problem, which is an inflated estimate of the effect of interventions, due to survivors bias -- where the magnitude of inflation may be conditional on heterogeneous confounders in the population. This bias arises simply because in order to receive an intervention after discharge, a person must not have been readmitted in the intervening period. After deriving an expression for this phantom effect, we controlled for this and other biases within an inherently interpretable Bayesian survival framework. We identified case management services as being the most impactful for reducing readmissions overall.
Methodology,Machine Learning,Quantitative Methods
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to evaluate the impact of post - discharge interventions on preventing re - admission or death of hospitalized patients, and pays special attention to how to avoid the problem of inflated estimates of intervention effects due to survivors bias. Survivors bias means that in order to receive a certain intervention after discharge, the patient must not have been re - admitted before, which makes the occurrence of the intervention itself a strong predictor of the non - occurrence of adverse outcomes. If this bias is not controlled, it may lead to incorrect estimates of the intervention effect. ### Specific Problems and Methods 1. **Survivors Bias Control**: - The paper first defines survivors bias and illustrates through a specific example how this bias affects the estimation of intervention effects. For example, if an intervention is usually carried out one week after discharge, all patients who are re - admitted within this week will not receive this intervention, resulting in an underestimation of the re - admission rate in the intervention group. - The author derives an expression to quantify the "phantom effect" caused by survivors bias and proposes a method to control this bias. 2. **Interpretable Model**: - In addition to controlling survivors bias, the paper also emphasizes the interpretability of the model. Although traditional machine - learning methods may have high prediction accuracy, they are usually black - box models and difficult to interpret. The author develops an inherently interpretable model, which uses Bayesian multi - level modeling to piece together linear models, ensuring that each model component is interpretable. 3. **Heterogeneity of Intervention Effects**: - The author not only focuses on the overall intervention effect but also explores the heterogeneity of intervention effects in different patient groups. By controlling survivors bias and other potential confounding factors, the model can more accurately estimate the intervention effects in different patient groups. ### Methodology - **Survival Analysis**: The paper uses survival analysis methods to quantify the effects of post - discharge interventions, especially to obtain more accurate estimates by controlling survivors bias. - **Bayesian Multi - level Modeling**: The model adopts the Bayesian multi - level modeling method to piece together linear models to form a highly interpretable model. - **Dataset**: The study uses the CMS - LDS (CMS Limited Dataset) from 2008 to 2013, which contains data on inpatient and outpatient service costs of 5% of Medicare beneficiaries nationwide. ### Results - **Model Performance**: The model in the paper performs well in the classification task of predicting re - admission or death within 30 days, and its AUROC and AUPRC indicators are comparable to or better than those of traditional machine - learning models. - **Intervention Effects**: The study finds that case management services are one of the most effective interventions in reducing the re - admission rate. ### Conclusion By controlling survivors bias and constructing an interpretable model, the paper successfully evaluates the effects of post - discharge interventions and provides a valuable reference for medical decision - making.