Abstract:We investigate the relationship between conditional independence (CI) x perpendicular to y vertical bar Z and the independence of two residuals x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z), where x and y are two random variables, and Z is a set of random variables. We show that if x, y and Z are generated by following linear structural equation model and all external influences follow Gaussian distributions, then x perpendicular to y vertical bar Z if and only if x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). That is, the test of x perpendicular to y vertical bar Z can be relaxed to a simpler unconditional independence test of x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). Furthermore, if all these external influences follow non-Gaussian distributions and the model satisfies structural faithfulness condition, then we have x perpendicular to y vertical bar Z double left right arrow x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z).We apply the results above to the causal discovery problem, where the causal directions are generally determined by a set of V- structures and their consistent propagations, so CI test- based methods can return a set of Markov equivalence classes. We show that in linear non- Gaussian context, x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z) perpendicular to x - E(x vertical bar Z) perpendicular to z or y - E(y vertical bar Z) perpendicular to z (for all z is an element of Z) if Z is a minimal d- separator, which implies z causes x (or y) if z directly connects to x (or y). Therefore, we conclude that CIs have useful information for distinguishing Markov equivalence classes.In summary, compared with the existing discretization-based and kernel-based CI testing methods, the proposed method provides a simpler way to measure CI, which needs only one unconditional independence test and two regression operations. When being applied to causal discovery, it can find more causal relationships, which is experimentally validated.

Generalized covariance‐based inference for models set‐identified from independence restrictions

A hypothesis test for independence of sets of variates in high dimensions

Optimization of the generalized covariance estimator in noncausal processes

Independent Component Analysis via Distance Covariance

Locally robust inference for non‐Gaussian SVAR models

Bayesian variable selection in linear regression models with instrumental variables

Heteroskedasticity-robust inference in linear regression models with many covariates

On the Identifiability of Sparse ICA without Assuming Non-Gaussianity

Inference in Semiparametric Conditional Moment Models with Partial Identification

Covariance Model with General Linear Structure and Divergent Parameters

Statistical Inference for Generalized Additive Models: Simultaneous Confidence Corridors and Variable Selection

On Gmm Inference: Partial Identification, Identification Strength, And Nonstandard Asymptotics

Inference on two component mixtures under tail restrictions

Entropic covariance models

Locally robust inference for non-Gaussian linear simultaneous equations models

Measuring Conditional Independence By Independent Residuals: Theoretical Results And Application In Causal Discovery

Model-Agnostic Covariate-Assisted Inference on Partially Identified Causal Effects

Introducing Gaussian covariance graph models in genome-wide prediction

Measuring Conditional Independence by Independent Residuals for Causal Discovery

Variational Inference for GARCH-family Models

A Regression-based Approach to Robust Estimation and Inference for Genetic Covariance