Abstract:Abstract Background The methods with which prediction models are usually developed mean that neither the parameters nor the predictions should be interpreted causally. For many applications, this is perfectly acceptable. However, when prediction models are used to support decision making, there is often a need for predicting outcomes under hypothetical interventions. Aims We aimed to identify published methods for developing and validating prediction models that enable risk estimation of outcomes under hypothetical interventions, utilizing causal inference. We aimed to identify the main methodological approaches, their underlying assumptions, targeted estimands, and potential pitfalls and challenges with using the method. Finally, we aimed to highlight unresolved methodological challenges. Methods We systematically reviewed literature published by December 2019, considering papers in the health domain that used causal considerations to enable prediction models to be used for predictions under hypothetical interventions. We included both methodologies proposed in statistical/machine learning literature and methodologies used in applied studies. Results We identified 4919 papers through database searches and a further 115 papers through manual searches. Of these, 87 papers were retained for full-text screening, of which 13 were selected for inclusion. We found papers from both the statistical and the machine learning literature. Most of the identified methods for causal inference from observational data were based on marginal structural models and g-estimation. Conclusions There exist two broad methodological approaches for allowing prediction under hypothetical intervention into clinical prediction models: (1) enriching prediction models derived from observational studies with estimated causal effects from clinical trials and meta-analyses and (2) estimating prediction models and causal effects directly from observational data. These methods require extending to dynamic treatment regimes, and consideration of multiple interventions to operationalise a clinical decision support system. Techniques for validating ‘causal prediction models’ are still in their infancy.

Risk‐Based Decision Making: Estimands for Sequential Prediction Under Interventions

Prediction meets causal inference: the role of treatment in clinical prediction models

Prediction under interventions: evaluation of counterfactual performance using longitudinal observational data

Causal blind spots when using prediction models for treatment decisions

A scoping review of causal methods enabling predictions under hypothetical interventions

Making predictions under interventions: a case study from the PREDICT-CVD cohort in New Zealand primary care

The use of imputation in clinical decision support systems: a cardiovascular risk management pilot vignette study among clinicians

Causal Inference and Counterfactual Prediction in Machine Learning for Actionable Healthcare

Risk Prediction with Imperfect Survival Outcome Information from Electronic Health Records

Are causal effect estimations enough for optimal recommendations under multitreatment scenarios?

Stochastic Intervention for Causal Effect Estimation

Counterfactual Prediction Under Outcome Measurement Error

Leveraging Clinical Time-Series Data for Prediction: A Cautionary Tale

Translating questions to estimands in randomized clinical trials with intercurrent events

Stochastic Intervention for Causal Inference via Reinforcement Learning

Estimating Time-Varying Direct and Indirect Causal Excursion Effects with Longitudinal Binary Outcomes

Evaluation of clinical prediction models (part 1): from development to external validation

Implementation of Prediction Models in the Emergency Department from an Implementation Science Perspective-Determinants, Outcomes, and Real-World Impact: A Scoping Review

Estimating hypothetical estimands with causal inference and missing data estimators in a diabetes trial

Estimating causal effects for binary outcomes using per-decision inverse probability weighting

Using marginal structural models to adjust for treatment drop-in when developing clinical prediction models