Abstract:We investigate the relationship between conditional independence (CI) x perpendicular to y vertical bar Z and the independence of two residuals x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z), where x and y are two random variables, and Z is a set of random variables. We show that if x, y and Z are generated by following linear structural equation model and all external influences follow Gaussian distributions, then x perpendicular to y vertical bar Z if and only if x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). That is, the test of x perpendicular to y vertical bar Z can be relaxed to a simpler unconditional independence test of x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). Furthermore, if all these external influences follow non-Gaussian distributions and the model satisfies structural faithfulness condition, then we have x perpendicular to y vertical bar Z double left right arrow x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z).We apply the results above to the causal discovery problem, where the causal directions are generally determined by a set of V- structures and their consistent propagations, so CI test- based methods can return a set of Markov equivalence classes. We show that in linear non- Gaussian context, x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z) perpendicular to x - E(x vertical bar Z) perpendicular to z or y - E(y vertical bar Z) perpendicular to z (for all z is an element of Z) if Z is a minimal d- separator, which implies z causes x (or y) if z directly connects to x (or y). Therefore, we conclude that CIs have useful information for distinguishing Markov equivalence classes.In summary, compared with the existing discretization-based and kernel-based CI testing methods, the proposed method provides a simpler way to measure CI, which needs only one unconditional independence test and two regression operations. When being applied to causal discovery, it can find more causal relationships, which is experimentally validated.

Testability of Instrumental Variables in Linear Non-Gaussian Acyclic Causal Models

Testability of Instrumental Variables in Additive Nonlinear, Non-Constant Effects Models

Control Function Instrumental Variable Estimation of Nonlinear Causal Effect Models

Identifiability of Sparse Causal Effects using Instrumental Variables

Valid Causal Inference with (Some) Invalid Instruments

Sensitivity Analysis of G-estimators to Invalid Instrumental Variables

Graphical tools for selecting conditional instrumental sets

Instrument Validity for Heterogeneous Causal Effects

Identifiability of Intermediate Variables on Causal Paths

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

Instrumental variables: A non-asymptotic viewpoint

Fighting Noise with Noise: Causal Inference with Many Candidate Instruments

Two Robust Tools for Inference about Causal Effects with Invalid Instruments

Instrumental Variable Model Average With Applications in Nonlinear Causal Inference

Identification and Inference with Invalid Instruments

CHARACTERISTIC FUNCTION BASED TESTING FOR CONDITIONAL INDEPENDENCE: A NONPARAMETRIC REGRESSION APPROACH

Nonparametric identification and efficient estimation of causal effects with instrumental variables

Sequential Underspecified Instrument Selection for Cause-Effect Estimation

Measuring Conditional Independence By Independent Residuals: Theoretical Results And Application In Causal Discovery

The Instrumental Variable Model with Categorical Instrument, Treatment and Outcome: Characterization, Partial Identification, and Statistical Inference

Local Causal Discovery with Linear non-Gaussian Cyclic Models