Abstract:Conditional independence (CI) testing is an important problem, especially in causal discovery. Most testing methods assume that all variables are fully observable and then test the CI among the observed data. Such an assumption is often untenable beyond applications dealing with, e.g., psychological analysis about the mental health status and medical diagnosing (researchers need to consider the existence of latent variables in these scenarios); and typically adopted latent CI test schemes mainly suffer from robust or efficient issues. Accordingly, this article investigates the problem of testing CI between latent variables. To this end, we offer an auxiliary regression-based CI (AReCI) test by taking the measured variable as the surrogate variable of the latent variables to conduct the regression over the latent variables under the linear causal models, in which each latent variable has some certain measured variables. Specifically, given a pair of latent variables LX and LY , and a corresponding latent variable set LO , [Formula: see text] holds if and only if [Formula: see text] and [Formula: see text] are statistically independent, where A' and A'' are the two disjoint subset of the measured variable for the corresponding latent variables, A'{LO} ∩A''{LO} = ∅ , and ω1 is a parameter vector characterized from the cross covariance between A{LX} and A'{LO} , and ω2 is a parameter vector characterized from the cross covariance between A{LY} and A''{LO} . We theoretically show that the AReCI test is capable of addressing both Gaussian and non-Gaussian data. In addition, we find that the well-known partial correlation test can be seen as a special case of the AReCI test. Finally, we devise a causal discovery method by using the AReCI test as the CI test. The experimental results on synthetic and real-world data illustrate the effectiveness of our method.

Testing Conditional Independence Between Latent Variables by Independence Residuals

Measuring Conditional Independence By Independent Residuals: Theoretical Results And Application In Causal Discovery

Measuring Conditional Independence by Independent Residuals for Causal Discovery

Causal Discovery Using Regression-Based Conditional Independence Tests

Testing Independence Between Linear Combinations for Causal Discovery

Conditional Independence Test Based on Residual Similarity

Normalizing flows for conditional independence testing

Recursively Learning Causal Structures Using Regression-based Conditional Independence Test

Conditional independence testing under misspecified inductive biases

Distinguish Markov Equivalence Classes From Large-Scale Linear Non-Gaussian Data

Evaluating Independence and Conditional Independence Measures

CHARACTERISTIC FUNCTION BASED TESTING FOR CONDITIONAL INDEPENDENCE: A NONPARAMETRIC REGRESSION APPROACH

Testing Conditional Independence in Casual Inference for Time Series Data

Causal Discovery via Conditional Independence Testing with Proxy Variables

A Conditional Independence Test in the Presence of Discretization

A Distribution Free Conditional Independence Test with Applications to Causal Discovery

Testing Conditional Independence with Data Missing at Random

Non-parametric Conditional Independence Testing for Mixed Continuous-Categorical Variables: A Novel Method and Numerical Evaluation

Conditional Diffusion Models Based Conditional Independence Testing

A Note on Testing Conditional Independence for Social Network Analysis

Model-Powered Conditional Independence Test