Abstract:We investigate the relationship between conditional independence (CI) x ⫫ y | Z and the independence of two residuals x −E( x | Z )⫫ y −E( y | Z ), where x and y are two random variables and Z is a set of random variables. We show that if x , y , and Z are generated by following linear structural equation models and all external influences follow joint Gaussian distribution, then x ⫫ y | Z if and only if x −E( x | Z )⫫ y −E( y | Z ). That is, the test of x ⫫ y | Z can be relaxed to a simpler unconditional independence test of x −E( x | Z )⫫ y −E( y | Z ). Furthermore, testing x −E( x | Z )⫫ y −E( y | Z ) can be simplified by testing x −E( x | Z )⫫ y or y −E( y | Z )⫫ x . On the other side, if all these external influences follow non-Gaussian distributions and the model satisfies structural faithfulness condition, then we have x ⫫ y | Z ⇔ x −E( x | Z )⫫ y −E( y | Z ). We apply the results above to the causal discovery problem, where the causal directions are generally determined by a set of V -structures and their consistent propagations, so CI test-based methods can return a set of Markov equivalence classes. We show that in the linear non-Gaussian context, in many cases x −E( x | Z )⫫ z or y −E( y | Z )⫫ z (∀ z ∈ Z and Z is a minimal d -separator) is satisfied when x −E( x | Z )⫫ y −E( y | Z ), which implies z causes x (or y ) if z directly connects to x (or y ). Therefore, we conclude that CIs have useful information for distinguishing Markov equivalence classes. In summary, comparing with the existing discretization-based and kernel-based CI testing methods, the proposed method provides a simpler way to measure CI, which needs only one unconditional independence test and two regression operations. When being applied to causal discovery, it can find more causal relationships, which is extensively validated by experiments.

A study of causal discovery with weak links and small samples

Sample, estimate, aggregate: A recipe for causal discovery foundation models

Causal Discovery in Linear Models with Unobserved Variables and Measurement Error

Ensembling MML Causal Discovery

Causal Discovery in Linear Structural Causal Models with Deterministic Relations

Causal Discovery for Linear Mixed Data

Confidence in Causal Discovery with Linear Causal Models

Discovering Mixtures of Structural Causal Models from Time Series Data

Causal discovery for observational sciences using supervised machine learning

Learning to Recover Causal Relationship from Indefinite Data in the Presence of Latent Confounders

SADA: A General Framework to Support Robust Causation Discovery with Theoretical Guarantee

Comparative Study of Causal Discovery Methods for Cyclic Models with Hidden Confounders

Bivariate Causal Discovery using Bayesian Model Selection

A Versatile Causal Discovery Framework to Allow Causally-Related Hidden Variables

Causality on Longitudinal Data: Stable Specification Search in Constrained Structural Equation Modeling

Measuring Conditional Independence by Independent Residuals for Causal Discovery

DCDILP: a distributed learning method for large-scale causal structure learning

Reliable Causal Discovery with Improved Exact Search and Weaker Assumptions

From Query Tools to Causal Architects: Harnessing Large Language Models for Advanced Causal Discovery from Data

LLM-initialized Differentiable Causal Discovery

LeCaSiM: Learning Causal Structure via Inverse of M-Matrices with Adjustable Coefficients