Abstract:There is growing interest in using routinely collected data from health care databases to study the safety and effectiveness of therapies in "real-world" conditions, as it can provide complementary evidence to that of randomized controlled trials. Causal inference from health care databases is challenging because the data are typically noisy, high dimensional, and most importantly, observational. It requires methods that can estimate heterogeneous treatment effects while controlling for confounding in high dimensions. Bayesian additive regression trees, causal forests, causal boosting, and causal multivariate adaptive regression splines are off-the-shelf methods that have shown good performance for estimation of heterogeneous treatment effects in observational studies of continuous outcomes. However, it is not clear how these methods would perform in health care database studies where outcomes are often binary and rare and data structures are complex. In this study, we evaluate these methods in simulation studies that recapitulate key characteristics of comparative effectiveness studies. We focus on the conditional average effect of a binary treatment on a binary outcome using the conditional risk difference as an estimand. To emulate health care database studies, we propose a simulation design where real covariate and treatment assignment data are used and only outcomes are simulated based on nonparametric models of the real outcomes. We apply this design to 4 published observational studies that used records from 2 major health care databases in the United States. Our results suggest that Bayesian additive regression trees and causal boosting consistently provide low bias in conditional risk difference estimates in the context of health care database studies.

Harnessing Causal Forests for Epidemiologic Research: Key Consideration

Causal Rule Forest: Toward Interpretable and Precise Treatment Effect Estimation

Targeting relative risk heterogeneity with causal forests

Estimation and Inference of Heterogeneous Treatment Effects using Random Forests

How do applied researchers use the Causal Forest? A methodological review of a method

Estimating Treatment Effects with Causal Forests: An Application

Assessing the properties of patient-specific treatment effect estimates from causal forest algorithms under essential heterogeneity

Comparison of causal forest and regression-based approaches to evaluate treatment effect heterogeneity: an application for type 2 diabetes precision medicine

Flexible machine learning estimation of conditional average treatment effects: a blessing and a curse

Distilling interpretable causal trees from causal forests

A Machine-Learning Approach for Estimating Subgroup- and Individual-Level Treatment Effects: An Illustration Using the 65 Trial

Shrinkage Bayesian Causal Forests for Heterogeneous Treatment Effects Estimation

Causal Inference and Counterfactual Prediction in Machine Learning for Actionable Healthcare

Iterative Causal Forest: A Novel Algorithm for Subgroup Identification.

Causal Rule Ensemble: Interpretable Discovery and Inference of Heterogeneous Treatment Effects

On Heterogeneous Treatment Effects in Heterogeneous Causal Graphs

Deep Learning for Causal Inference: A Comparison of Architectures for Heterogeneous Treatment Effect Estimation

Debiased Causal Tree: Heterogeneous Treatment Effects Estimation with Unmeasured Confounding

Heterogeneous Treatment Effect Estimation using machine learning for Healthcare application: tutorial and benchmark

Comparing methods for estimation of heterogeneous treatment effects using observational data from health care databases