Abstract:We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic models. Roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the causal structure of a LiNGLaH is identifiable in light of GIN conditions. Experimental results show the effectiveness of the proposed method.

Redefining the Shortest Path Problem Formulation of the Linear Non-Gaussian Acyclic Model: Pairwise Likelihood Ratios, Prior Knowledge, and Path Enumeration

Causal Discovery in Linear Non-Gaussian Acyclic Model With Multiple Latent Confounders

A linear non-Gaussian acyclic model for causal discovery.

A Linear Non-Gaussian Acyclic Model for Causal Discovery

Functional Linear Non-Gaussian Acyclic Model for Causal Discovery

Learning linear acyclic causal model including Gaussian noise using ancestral relationships

Causal Discovery with Mixed Linear and Nonlinear Additive Noise Models: A Scalable Approach

Learning linear non-Gaussian networks: A new view from matrix identification.

On estimation of functional causal models : general results and application to the post-nonlinear causal model

On Estimation of Functional Causal Models: Post-Nonlinear Causal Model As an Example

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Causal Effect Identification in LiNGAM Models with Latent Confounders

On Estimation of Functional Causal Models

TSLiNGAM: DirectLiNGAM Under Heavy Tails

Local Causal Discovery with Linear non-Gaussian Cyclic Models

Combining Linear Non-Gaussian Acyclic Model with Logistic Regression Model for Estimating Causal Structure from Mixed Continuous and Discrete Data

An Entropy Based Method for Causal Discovery in Linear Acyclic Model.

Partial Homoscedasticity in Causal Discovery with Linear Models

Causal Discovery of Linear Non-Gaussian Causal Models with Unobserved Confounding

Causal Discovery with Generalized Linear Models through Peeling Algorithms

Reliable Causal Discovery with Improved Exact Search and Weaker Assumptions