Abstract:We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic models. Roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the causal structure of a LiNGLaH is identifiable in light of GIN conditions. Experimental results show the effectiveness of the proposed method.

Learning linear non-Gaussian networks: A new view from matrix identification.

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Learning linear acyclic causal model including Gaussian noise using ancestral relationships

Functional Linear Non-Gaussian Acyclic Model for Causal Discovery

Causal Discovery in Linear Non-Gaussian Acyclic Model With Multiple Latent Confounders

GroupLiNGAM: Linear non-Gaussian acyclic models for sets of variables

Causal Effect Identification in LiNGAM Models with Latent Confounders

TSLiNGAM: DirectLiNGAM Under Heavy Tails

A Linear Non-Gaussian Acyclic Model for Causal Discovery

Causal Discovery with Multi-Domain LiNGAM for Latent Factors

Discovery of non-gaussian linear causal models using ICA

A linear non-Gaussian acyclic model for causal discovery.

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Causal inference of brain connectivity from fMRI with $ψ$-Learning Incorporated Linear non-Gaussian Acyclic Model ($ψ$-LiNGAM)

Continual Learning of Nonlinear Independent Representations

Redefining the Shortest Path Problem Formulation of the Linear Non-Gaussian Acyclic Model: Pairwise Likelihood Ratios, Prior Knowledge, and Path Enumeration

Learning Latent Variable Gaussian Graphical Models

Distinguish Markov Equivalence Classes From Large-Scale Linear Non-Gaussian Data

Learning causal graphs using variable grouping according to ancestral relationship

Efficient Learning Algorithms for Gaussian Processes

Local Causal Discovery with Linear non-Gaussian Cyclic Models