Abstract:We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic models. Roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the causal structure of a LiNGLaH is identifiable in light of GIN conditions. Experimental results show the effectiveness of the proposed method.

New Methodology of Signed Digraph Modeling Based on Causal Ordering Analysis

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Precise Signed Digraph Modelling Based on Causal Dependence Identification

Spatial-Temporal Causality Modeling for Industrial Processes with a Knowledge-Data Guided Reinforcement Learning

An Entropy Based Method for Causal Discovery in Linear Acyclic Model.

A Signed Digraphs Based Method for Detecting Inherently Unsafe Factors of Chemical Process at Conceptual Design Stage

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Open Source Signed Digraph Inference Framework

Causal Modeling of Dynamical Systems

Mitigating Prior Errors in Causal Structure Learning: Towards LLM driven Prior Knowledge

Signed directed graph-based hierarchical modelling and fault propagation analysis for large-scale systems

A Local Method for Identifying Causal Relations under Markov Equivalence

Causal Discovery in Linear Models with Unobserved Variables and Measurement Error

Causal Discovery via Causal Star Graphs

Learning Causal Structures Based on Divide and Conquer

A Liang-Kleeman Causality Analysis based on Linear Inverse Modeling

Causal Discovery in Linear Structural Causal Models with Deterministic Relations

Causal Discovery in Linear Non-Gaussian Acyclic Model With Multiple Latent Confounders

Hybrid Top-Down Global Causal Discovery with Local Search for Linear and Nonlinear Additive Noise Models

Effective Causal Discovery under Identifiable Heteroscedastic Noise Model

A Genetic Algorithm for Causal Discovery Based on Structural Causal Model.