Abstract:Background: Recent developments in causal inference and machine learning (ML) allow for the estimation of individualized treatment effects (ITEs), which reveal whether treatment effectiveness varies according to patients' observed covariates. ITEs can be used to stratify health policy decisions according to individual characteristics and potentially achieve greater population health. Little is known about the appropriateness of available ML methods for use in health technology assessment. Methods: In this scoping review, we evaluate ML methods available for estimating ITEs, aiming to help practitioners assess their suitability in health technology assessment. We present a taxonomy of ML approaches, categorized by key challenges in health technology assessment using observational data, including handling time-varying confounding and time-to event data and quantifying uncertainty. Results: We found a wide range of algorithms for simpler settings with baseline confounding and continuous or binary outcomes. Not many ML algorithms can handle time-varying or unobserved confounding, and at the time of writing, no ML algorithm was capable of estimating ITEs for time-to-event outcomes while accounting for time-varying confounding. Many of the ML algorithms that estimate ITEs in longitudinal settings do not formally quantify uncertainty around the point estimates. Limitations: This scoping review may not cover all relevant ML methods and algorithms as they are continuously evolving. Conclusions: Existing ML methods available for ITE estimation are limited in handling important challenges posed by observational data when used for cost-effectiveness analysis, such as time-to-event outcomes, time-varying and hidden confounding, or the need to estimate sampling uncertainty around the estimates. Implications: ML methods are promising but need further development before they can be used to estimate ITEs for health technology assessments. Highlights: Estimating individualized treatment effects (ITEs) using observational data and machine learning (ML) can support personalized treatment advice and help deliver more customized information on the effectiveness and cost-effectiveness of health technologies.ML methods for ITE estimation are mostly designed for handling confounding at baseline but not time-varying or unobserved confounding. The few models that account for time-varying confounding are designed for continuous or binary outcomes, not time-to-event outcomes.Not all ML methods for estimating ITEs can quantify the uncertainty of their predictions.Future work on developing ML that addresses the concerns summarized in this review is needed before these methods can be widely used in clinical and health technology assessment-like decision making.

Emulate randomized clinical trials using heterogeneous treatment effect estimation for personalized treatments: Methodology review and benchmark

Heterogeneous Treatment Effect Estimation using machine learning for Healthcare application: tutorial and benchmark

Deep Representation Learning for Individualized Treatment Effect Estimation Using Electronic Health Records.

Using Machine Learning to Individualize Treatment Effect Estimation: Challenges and Opportunities

Some methods for heterogeneous treatment effect estimation in high-dimensions

From Real‐World Patient Data to Individualized Treatment Effects Using Machine Learning: Current and Future Methods to Address Underlying Challenges

Estimating individual treatment effect: generalization bounds and algorithms

Some methods for heterogeneous treatment effect estimation in high dimensions

A comparison of methods for model selection when estimating individual treatment effects

Comparison of methods that combine multiple randomized trials to estimate heterogeneous treatment effects

Learning Personalized Treatment Decisions in Precision Medicine: Disentangling Treatment Assignment Bias in Counterfactual Outcome Prediction and Biomarker Identification

Evaluating the Effectiveness of Personalized Medicine With Software

Machine Learning Methods to Estimate Individualized Treatment Effects for Use in Health Technology Assessment

A Perspective on Individualized Treatment Effects Estimation from Time-series Health Data

Adaptively leverage multiple real-world data sources for treatment effect estimation based on similarity

Robust estimation of heterogeneous treatment effects using electronic health record data

Efficient Targeted Learning of Heterogeneous Treatment Effects for Multiple Subgroups

A Unified Survey of Treatment Effect Heterogeneity Modelling and Uplift Modelling

Estimating heterogeneity of treatment effect in psychiatric clinical trials

Targeted Estimation of Heterogeneous Treatment Effect in Observational Survival Analysis

Data-Driven Estimation of Heterogeneous Treatment Effects