Abstract:We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic models. Roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the causal structure of a LiNGLaH is identifiable in light of GIN conditions. Experimental results show the effectiveness of the proposed method.

Reasoning About Causal Models With Infinitely Many Variables

Causal Modeling With Infinitely Many Variables

Nondeterministic Causal Models

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Causal Models with Constraints

Causal Modeling of Dynamical Systems

Beyond Structural Causal Models: Causal Constraints Models

Actual causation and the art of modeling

Causal Modeling Semantics for Counterfactuals with Disjunctive Antecedents

Discovering Cyclic Causal Models by Independent Components Analysis

Identifiability of Homoscedastic Linear Structural Equation Models using Algebraic Matroids

On Probabilistic and Causal Reasoning with Summation Operators

Extending Structural Causal Models for Autonomous Embodied Systems

Boosting Causal Additive Models

Causal Modeling in Multi-Context Systems: Distinguishing Multiple Context-Specific Causal Graphs which Account for Observational Support

Relating Graph Neural Networks to Structural Causal Models

Learning a Structural Causal Model for Intuition Reasoning in Conversation

Causal Discovery in Linear Structural Causal Models with Deterministic Relations

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Epistemic Modeling with Justifications