Abstract:We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic models. Roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the causal structure of a LiNGLaH is identifiable in light of GIN conditions. Experimental results show the effectiveness of the proposed method.

Identification of Latent Variables From Graphical Model Residuals

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Graphical model selection with latent variables

Latent variable graphical model selection via convex optimization

Mixed Graphical Models for Causal Analysis of Multi-modal Variables

Causal Discovery of Linear Non-Gaussian Causal Models with Unobserved Confounding

Recovering Linear Causal Models with Latent Variables via Cholesky Factorization of Covariance Matrix

Learning Latent Variable Gaussian Graphical Models

Identification of Linear Non-Gaussian Latent Hierarchical Structure.

The Gaussian Graphical Model in Cross-Sectional and Time-Series Data

Causal Discovery under Latent Class Confounding

Identifying Weight-Variant Latent Causal Models

Learning to Recover Causal Relationship from Indefinite Data in the Presence of Latent Confounders

High-Dimensional Undirected Graphical Models for Arbitrary Mixed Data

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

Identifiable Latent Neural Causal Models

Actively Identifying Causal Effects with Latent Variables Given Only Response Variable Observable.

High-Dimensional Gaussian Graphical Regression Models with Covariates

Graphical model inference with external network data

The DeCAMFounder: Non-Linear Causal Discovery in the Presence of Hidden Variables

Graph Learning for Latent-Variable Gaussian Graphical Models under Laplacian Constraints