Abstract:We investigate the relationship between conditional independence (CI) x perpendicular to y vertical bar Z and the independence of two residuals x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z), where x and y are two random variables, and Z is a set of random variables. We show that if x, y and Z are generated by following linear structural equation model and all external influences follow Gaussian distributions, then x perpendicular to y vertical bar Z if and only if x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). That is, the test of x perpendicular to y vertical bar Z can be relaxed to a simpler unconditional independence test of x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z). Furthermore, if all these external influences follow non-Gaussian distributions and the model satisfies structural faithfulness condition, then we have x perpendicular to y vertical bar Z double left right arrow x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z).We apply the results above to the causal discovery problem, where the causal directions are generally determined by a set of V- structures and their consistent propagations, so CI test- based methods can return a set of Markov equivalence classes. We show that in linear non- Gaussian context, x - E(x vertical bar Z) perpendicular to y - E(y vertical bar Z) perpendicular to x - E(x vertical bar Z) perpendicular to z or y - E(y vertical bar Z) perpendicular to z (for all z is an element of Z) if Z is a minimal d- separator, which implies z causes x (or y) if z directly connects to x (or y). Therefore, we conclude that CIs have useful information for distinguishing Markov equivalence classes.In summary, compared with the existing discretization-based and kernel-based CI testing methods, the proposed method provides a simpler way to measure CI, which needs only one unconditional independence test and two regression operations. When being applied to causal discovery, it can find more causal relationships, which is experimentally validated.

On Existence Theorems for Conditional Inferential Models

Inferential models: A framework for prior-free posterior probabilistic inference

Fusing independent inferential models in a black-box manner

Large-sample theory for inferential models: a possibilistic Bernstein--von Mises theorem

Rethinking the framework constructed by counterfactual functional model

On Trivalent Logics, Compound Conditionals, and Probabilistic Deduction Theorems

Valid and efficient imprecise-probabilistic inference with partial priors, II. General framework

Inference in Semiparametric Conditional Moment Models with Partial Identification

Possibility-theoretic statistical inference offers performance and probativeness assurances

Measuring Conditional Independence By Independent Residuals: Theoretical Results And Application In Causal Discovery

Impossible inference in econometrics: Theory and applications

On the Generative Utility of Cyclic Conditionals

What can be estimated? Identifiability, estimability, causal inference and ill-posed inverse problems

A Combined Approach to the Inference of Conditional Factor Models

On Trivalent Logics, Probabilistic Weak Deduction Theorems, and a General Import-Export Principle

Diagnostics for Conditional Density Models and Bayesian Inference Algorithms

A Categorical Approach to DIBI Models

Conditional Belief, Knowledge and Probability

Data Models With Two Manifestations of Imprecision

Maximum Empirical Likelihood Estimation of Continuous-Time Models with Conditional Characteristic Functions

Probabilistic modeling of rational communication with conditionals