Abstract:We investigate the relationship between conditional independence (CI) x ⫫ y | Z and the independence of two residuals x −E( x | Z )⫫ y −E( y | Z ), where x and y are two random variables and Z is a set of random variables. We show that if x , y , and Z are generated by following linear structural equation models and all external influences follow joint Gaussian distribution, then x ⫫ y | Z if and only if x −E( x | Z )⫫ y −E( y | Z ). That is, the test of x ⫫ y | Z can be relaxed to a simpler unconditional independence test of x −E( x | Z )⫫ y −E( y | Z ). Furthermore, testing x −E( x | Z )⫫ y −E( y | Z ) can be simplified by testing x −E( x | Z )⫫ y or y −E( y | Z )⫫ x . On the other side, if all these external influences follow non-Gaussian distributions and the model satisfies structural faithfulness condition, then we have x ⫫ y | Z ⇔ x −E( x | Z )⫫ y −E( y | Z ). We apply the results above to the causal discovery problem, where the causal directions are generally determined by a set of V -structures and their consistent propagations, so CI test-based methods can return a set of Markov equivalence classes. We show that in the linear non-Gaussian context, in many cases x −E( x | Z )⫫ z or y −E( y | Z )⫫ z (∀ z ∈ Z and Z is a minimal d -separator) is satisfied when x −E( x | Z )⫫ y −E( y | Z ), which implies z causes x (or y ) if z directly connects to x (or y ). Therefore, we conclude that CIs have useful information for distinguishing Markov equivalence classes. In summary, comparing with the existing discretization-based and kernel-based CI testing methods, the proposed method provides a simpler way to measure CI, which needs only one unconditional independence test and two regression operations. When being applied to causal discovery, it can find more causal relationships, which is extensively validated by experiments.

An Information Integration Account for Causal Generalizations in Uncertain Causal Networks

Generalization bound for estimating causal effects from observational network data

A Situation-Modulated Minimal Change Account for Causal Inferences about Causal Networks.

Reasoning about causal relationships: Inferences on causal networks.

Generalizable Information Theoretic Causal Representation

Psychological and Normative Theories of Causal Power and the Probabilities of Causes

Generalized Score Functions for Causal Discovery

Learning Deterministic Causal Relations

Quantify the Causes of Causal Emergence: Critical Conditions of Uncertainty and Asymmetry in Causal Structure

Generalization Bounds for Causal Regression: Insights, Guarantees and Sensitivity Analysis

Inferring the size of the causal universe: features and fusion of causal attribution networks

A Method for Constructing Causal Network Based on Statistical Estimation and Eliminative Induction

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Causal GNNs: A GNN-Driven Instrumental Variable Approach for Causal Inference in Networks

Causal Structure Learning with Conditional and Unique Information Groups-Decomposition Inequalities

Measuring Conditional Independence by Independent Residuals for Causal Discovery

Reinterpreting causal discovery as the task of predicting unobserved joint statistics

Intervention and Conditioning in Causal Bayesian Networks

Applications of Common Entropy for Causal Inference

An information-theoretic framework for conditional causality analysis of brain networks