Abstract:Recently, many regression-based conditional independence (CI) test methods have been proposed to solve the problem of causal discovery. These methods provide alternatives to test CI of x , y given Z by first removing the information of the controlling set Z from x and y , and then testing the independence between the two residuals R x , Z and R y , Z . When the residuals are linearly uncorrelated, the independence test between them is nontrivial. With the ability to calculate inner product in high-dimensional space, kernel-based methods are usually used to achieve this goal, but they are considerably time-consuming. In this paper, we test the independence between two linear combinations under linear structural equation model. We show that the dependence between the two residuals can be captured by the difference between the similarity of R x , Z and R y , Z and that of R x , Z and R r ( R r is an independent copy of R y , Z ) in high-dimensional space. With this result, we provide a new way to test CI based on the similarity between residuals, which is called SCIT — the abbreviation of Similarity-based CI Testing. Furthermore, we develop two versions of the proposal, called Kernel-SCIT and Neural-SCIT respectively. Kernel-SCIT calculates the similarity by using kernel functions, while Neural-SCIT approximates the upper bound of the similarity by using deep neural networks. In both algorithms, random permutation tests are performed to control Type I error rate. The proposed tests are evaluated on (conditional) independence test and causal discovery with both synthetic and real datasets. Experimental results show that Kernel-SCIT is simpler yet more efficient and effective than the typical existing kernel-based methods HSIC and KCIT in the cases of small sample size, and Neural-SCIT can significantly boost the performance of CI testing when sufficient samples are available. The source code is available at https://github.com/xyw5vplus1/SCIT.

Test of Conditional Independence in Factor Models Via Hilbert–Schmidt Independence Criterion

CHARACTERISTIC FUNCTION BASED TESTING FOR CONDITIONAL INDEPENDENCE: A NONPARAMETRIC REGRESSION APPROACH

A hypothesis test for independence of sets of variates in high dimensions

Characteristic Function-Based Testing for Multifactor Continuous-Time Markov Models Via Nonparametric Regression

A Consistent Characteristic Function-Based Test for Conditional Independence

Generalized spectral testing for multivariate continuous-time models

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information

Learning Deep Kernels for Non-Parametric Independence Testing

A NONPARAMETRIC HELLINGER METRIC TEST FOR CONDITIONAL INDEPENDENCE

Simultaneous Inference For High-Dimensional Approximate Factor Model

Testing conditional independence via empirical likelihood

Testing for Independence Between Two Stationary Time Series Via the Empirical Characteristic Function

Kernel-based Tests for Joint Independence

Conditional Independence Specification Testing for Dependent Processes with Local Polynomial Quantile Regression

Conditional Independence Test Based on Residual Similarity

High-dimensional sparse single–index regression via Hilbert–Schmidt independence criterion

Model-Powered Conditional Independence Test

Conditional Independence Testing for Discrete Distributions: Beyond $χ^2$- and $G$-tests

A Conditional Independence Test in the Presence of Discretization

MORE POWERFUL HSIC-BASED INDEPENDENCE TESTS, EXTENSION TO SPACE-FILLING DESIGNS AND FUNCTIONAL DATA