Abstract:We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic models. Roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the causal structure of a LiNGLaH is identifiable in light of GIN conditions. Experimental results show the effectiveness of the proposed method.

Measuring Latent Causal Structure

Identification of Linear Non-Gaussian Latent Hierarchical Structure.

Learning Measurement Models for Unobserved Variables

Learning Discrete Latent Variable Structures with Tensor Rank Conditions

Identification of Causal Structure with Latent Variables Based on Higher Order Cumulants

Local Causal Structure Learning in the Presence of Latent Variables

Causal Discovery under Latent Class Confounding

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Causal Discovery of 1-Factor Measurement Models in Linear Latent Variable Models with Arbitrary Noise Distributions.

Differentiable Causal Discovery For Latent Hierarchical Causal Models

Identifying Weight-Variant Latent Causal Models

Identification of Nonlinear Latent Hierarchical Models

Identifiable Latent Neural Causal Models

Causal Inference with Latent Variables: Recent Advances and Future Prospectives

Learning Temporally Causal Latent Processes from General Temporal Data.

Causal Discovery in Linear Models with Unobserved Variables and Measurement Error

Actively Identifying Causal Effects with Latent Variables Given Only Response Variable Observable.

Everything that can be learned about a causal structure with latent variables by observational and interventional probing schemes

A Versatile Causal Discovery Framework to Allow Causally-Related Hidden Variables

Learning causal structures using hidden compact representation

Large Dimensional Latent Factor Modeling with Missing Observations and Applications to Causal Inference