Abstract:There is growing interest in using routinely collected data from health care databases to study the safety and effectiveness of therapies in "real-world" conditions, as it can provide complementary evidence to that of randomized controlled trials. Causal inference from health care databases is challenging because the data are typically noisy, high dimensional, and most importantly, observational. It requires methods that can estimate heterogeneous treatment effects while controlling for confounding in high dimensions. Bayesian additive regression trees, causal forests, causal boosting, and causal multivariate adaptive regression splines are off-the-shelf methods that have shown good performance for estimation of heterogeneous treatment effects in observational studies of continuous outcomes. However, it is not clear how these methods would perform in health care database studies where outcomes are often binary and rare and data structures are complex. In this study, we evaluate these methods in simulation studies that recapitulate key characteristics of comparative effectiveness studies. We focus on the conditional average effect of a binary treatment on a binary outcome using the conditional risk difference as an estimand. To emulate health care database studies, we propose a simulation design where real covariate and treatment assignment data are used and only outcomes are simulated based on nonparametric models of the real outcomes. We apply this design to 4 published observational studies that used records from 2 major health care databases in the United States. Our results suggest that Bayesian additive regression trees and causal boosting consistently provide low bias in conditional risk difference estimates in the context of health care database studies.

Assessing the properties of patient-specific treatment effect estimates from causal forest algorithms under essential heterogeneity

Estimation and Inference of Heterogeneous Treatment Effects using Random Forests

Comparison of causal forest and regression-based approaches to evaluate treatment effect heterogeneity: an application for type 2 diabetes precision medicine

Targeting relative risk heterogeneity with causal forests

Harnessing Causal Forests for Epidemiologic Research: Key Consideration

Heterogeneous treatment effect estimation for observational data using model-based forests

On Heterogeneous Treatment Effects in Heterogeneous Causal Graphs

Shrinkage Bayesian Causal Forests for Heterogeneous Treatment Effects Estimation

Estimating Treatment Effects with Causal Forests: An Application

Comparing methods for estimation of heterogeneous treatment effects using observational data from health care databases

A Machine-Learning Approach for Estimating Subgroup- and Individual-Level Treatment Effects: An Illustration Using the 65 Trial

Causal Inference for Survival Analysis

A Bayesian Classification Trees Approach to Treatment Effect Variation with Noncompliance

Iterative Causal Forest: A Novel Algorithm for Subgroup Identification.

Flexible machine learning estimation of conditional average treatment effects: a blessing and a curse

Hybrid Censored Quantile Regression Forest to Assess the Heterogeneous Effects

Data-Driven Estimation of Heterogeneous Treatment Effects

Heterogeneous Treatment Effects in Panel Data

Accounting for Missing Covariates in Heterogeneous Treatment Estimation

A flexible approach for causal inference with multiple treatments and clustered survival outcomes

Causal Rule Forest: Toward Interpretable and Precise Treatment Effect Estimation