Abstract:Objective: Drawing causal estimates from observational data is problematic, because datasets often contain underlying bias (eg, discrimination in treatment assignment). To examine causal effects, it is important to evaluate what-if scenarios-the so-called "counterfactuals." We propose a novel deep learning architecture for propensity score matching and counterfactual prediction-the deep propensity network using a sparse autoencoder (DPN-SA)-to tackle the problems of high dimensionality, nonlinear/nonparallel treatment assignment, and residual confounding when estimating treatment effects. Materials and Methods: We used 2 randomized prospective datasets, a semisynthetic one with nonlinear/nonparallel treatment selection bias and simulated counterfactual outcomes from the Infant Health and Development Program and a real-world dataset from the LaLonde's employment training program. We compared different configurations of the DPN-SA against logistic regression and LASSO as well as deep counterfactual networks with propensity dropout (DCN-PD). Models' performances were assessed in terms of average treatment effects, mean squared error in precision on effect's heterogeneity, and average treatment effect on the treated, over multiple training/test runs. Results: The DPN-SA outperformed logistic regression and LASSO by 36%-63%, and DCN-PD by 6%-10% across all datasets. All deep learning architectures yielded average treatment effects close to the true ones with low variance. Results were also robust to noise-injection and addition of correlated variables. Code is publicly available at https://github.com/Shantanu48114860/DPN-SAz. Discussion and Conclusion: Deep sparse autoencoders are particularly suited for treatment effect estimation studies using electronic health records because they can handle high-dimensional covariate sets, large sample sizes, and complex heterogeneity in treatment assignments.

DeepMatch: Balancing Deep Covariate Representations for Causal Inference Using Adversarial Training

Counterfactual Adversarial Learning with Representation Interpolation

Adversarial Balancing-based Representation Learning for Causal Effect Inference with Observational Data

Neural Score Matching for High-Dimensional Causal Inference

Deep treatment-adaptive network for causal inference

Debiased Collaborative Filtering with Kernel-Based Causal Balancing

Deep propensity network using a sparse autoencoder for estimation of treatment effects

Adversarially Balanced Representation for Continuous Treatment Effect Estimation

Deep Learning for Causal Inference: A Comparison of Architectures for Heterogeneous Treatment Effect Estimation

Causal Inference Meets Machine Learning

End-to-End Balancing for Causal Continuous Treatment-Effect Estimation

Integrating Active Learning in Causal Inference with Interference: A Novel Approach in Online Experiments

Causality-aware counterfactual confounding adjustment for feature representations learned by deep models

Learning Continuous Treatment Policy and Bipartite Embeddings for Matching with Heterogeneous Causal Effects

Causal Reasoning in the Presence of Latent Confounders via Neural ADMG Learning

Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference

Deep-Treat: Learning Optimal Personalized Treatments From Observational Data Using Neural Networks

Demystifying Causal Features on Adversarial Examples and Causal Inoculation for Robust Network by Adversarial Instrumental Variable Regression

Causal Mediation Analysis with Hidden Confounders

Estimating Treatment Effect in the Wild via Differentiated Confounder Balancing

Matching in Selective and Balanced Representation Space for Treatment Effects Estimation