Abstract:We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic models. Roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the causal structure of a LiNGLaH is identifiable in light of GIN conditions. Experimental results show the effectiveness of the proposed method.

Identifiability and Consistent Estimation for Gaussian Chain Graph Models

Dynamic Chain Graph Models for Ordinal Time Series Data

Identification of Latent Variables From Graphical Model Residuals

High-dimensional Gaussian Graphical Model for Network-Linked Data.

Simultaneous Identification of Sparse Structures and Communities in Heterogeneous Graphical Models

Identifiability of a statistical model with two latent vectors: Importance of the dimensionality relation and application to graph embedding

Simultaneous Change Point Inference and Structure Recovery for High Dimensional Gaussian Graphical Models.

High-Dimensional Gaussian Graphical Regression Models with Covariates

Continuously Indexed Graphical Models

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Reversible Mcmc on Markov Equivalence Classes of Sparse Directed Acyclic Graphs

Semiblind subgraph reconstruction in Gaussian graphical models

Identifiability in Continuous Lyapunov Models

Distinguish Markov Equivalence Classes From Large-Scale Linear Non-Gaussian Data

GroupLiNGAM: Linear non-Gaussian acyclic models for sets of variables

Bayesian graph selection consistency under model misspecification

Recovering Linear Causal Models with Latent Variables via Cholesky Factorization of Covariance Matrix

Integer Programming for Learning Directed Acyclic Graphs from Non-identifiable Gaussian Models

Joint estimation of multiple high-dimensional Gaussian copula graphical models

A construction of a graphical model

Structural Learning Of Chain Graphs Via Decomposition