Abstract:We investigate the relationship between conditional independence (CI) x perpendicular to y vertical bar Z and the independence of two residuals x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z), where x and y are two random variables, and Z is a set of random variables. We show that if x, y and Z are generated by following linear structural equation model and all external influences follow Gaussian distributions, then x perpendicular to y vertical bar Z if and only if x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). That is, the test of x perpendicular to y vertical bar Z can be relaxed to a simpler unconditional independence test of x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). Furthermore, if all these external influences follow non-Gaussian distributions and the model satisfies structural faithfulness condition, then we have x perpendicular to y vertical bar Z double left right arrow x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z).We apply the results above to the causal discovery problem, where the causal directions are generally determined by a set of V- structures and their consistent propagations, so CI test- based methods can return a set of Markov equivalence classes. We show that in linear non- Gaussian context, x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z) perpendicular to x - E(x vertical bar Z) perpendicular to z or y - E(y vertical bar Z) perpendicular to z (for all z is an element of Z) if Z is a minimal d- separator, which implies z causes x (or y) if z directly connects to x (or y). Therefore, we conclude that CIs have useful information for distinguishing Markov equivalence classes.In summary, compared with the existing discretization-based and kernel-based CI testing methods, the proposed method provides a simpler way to measure CI, which needs only one unconditional independence test and two regression operations. When being applied to causal discovery, it can find more causal relationships, which is experimentally validated.

A Coincidence Analysis of a Causal Chain

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Causal inference using the algorithmic Markov condition

Learning Causal Structures Based on Divide and Conquer

Causal Discovery of Linear Non-Gaussian Causal Models with Unobserved Confounding

Recursively Learning Causal Structures Using Regression-based Conditional Independence Test

Algorithmic syntactic causal identification

The most likely common cause

Hierarchical Causal Analysis of Natural Languages on a Chain Event Graph

Root Cause Analysis of Outliers with Missing Structural Knowledge

Measuring Conditional Independence By Independent Residuals: Theoretical Results And Application In Causal Discovery

Iterative Causal Discovery in the Possible Presence of Latent Confounders and Selection Bias

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

A cautious approach to constraint-based causal model selection

Counterfactual Covariate Causal Discovery on Nonlinear Extremal Quantiles

Causalized Convergent Cross Mapping and Its Implementation in Causality Analysis

A Local Method for Identifying Causal Relations under Markov Equivalence

Large Language Models for Constrained-Based Causal Discovery

Robust Unified Granger Causality Analysis: a Normalized Maximum Likelihood Form

Contiguity and covariation in human causal inference

A Quantum Probability Model of Causal Reasoning