Abstract:Graph-based causal discovery methods aim to capture conditional independencies consistent with the observed data and differentiate causal relationships from indirect or induced ones. Successful construction of graphical models of data depends on the assumption of causal sufficiency: that is, that all confounding variables are measured. When this assumption is not met, learned graphical structures may become arbitrarily incorrect and effects implied by such models may be wrongly attributed, carry the wrong magnitude, or mis-represent direction of correlation. Wide application of graphical models to increasingly less curated "big data" draws renewed attention to the unobserved confounder problem. We present a novel method that aims to control for the latent space when estimating a DAG by iteratively deriving proxies for the latent space from the residuals of the inferred model. Under mild assumptions, our method improves structural inference of Gaussian graphical models and enhances identifiability of the causal effect. In addition, when the model is being used to predict outcomes, it un-confounds the coefficients on the parents of the outcomes and leads to improved predictive performance when out-of-sample regime is very different from the training data. We show that any improvement of prediction of an outcome is intrinsically capped and cannot rise beyond a certain limit as compared to the confounded model. We extend our methodology beyond GGMs to ordinal variables and nonlinear cases. Our R package provides both PCA and autoencoder implementations of the methodology, suitable for GGMs with some guarantees and for better performance in general cases but without such guarantees.

Nonlinear Directed Acyclic Graph Estimation Based on the Kernel Partial Correlation Coefficient

Skeleton Estimation of Directed Acyclic Graphs Using Partial Least Squares from Correlated Data.

Learning directed acyclic graphs based on sparsest permutations

Efficient Learning of Nonparametric Directed Acyclic Graph with Statistical Guarantee

Kernel-Based Differentiable Learning of Non-Parametric Directed Acyclic Graphical Models

A Novel Causal Discovery Method in Linear SEM with Structure Priors

Sparse Directed Acyclic Graphs Incorporating the Covariates

Kernel-Based Structural Equation Models for Topology Identification of Directed Networks

Coordinated Multi-Neighborhood Learning on a Directed Acyclic Graph

Recovering Linear Causal Models with Latent Variables via Cholesky Factorization of Covariance Matrix

Distributed Finite-Time Estimation of the Bounds on Algebraic Connectivity for Directed Graphs

Directed Acyclic Graphs With Tears

High dimensional sparse covariance estimation via directed acyclic graphs

Random Feature Approximation for Online Nonlinear Graph Topology Identification

Average Causal Effect Estimation in DAGs with Hidden Variables: Extensions of Back-Door and Front-Door Criteria

CoLiDE: Concomitant Linear DAG Estimation

Efficient Learning of Quadratic Variance Function Directed Acyclic Graphs via Topological Layers

High Dimensional Gaussian Copula Graphical Model with Fdr Control

Partial Homoscedasticity in Causal Discovery with Linear Models

Direct Estimation of Differences in Causal Graphs

Identification of Latent Variables From Graphical Model Residuals