Abstract:We propose a kernel-based partial permutation test for checking the equality of functional relationship between response and covariates among different groups. The main idea, which is intuitive and easy to implement, is to keep the projections of the response vector Y on leading principle components of a kernel matrix fixed and permute Y ’s projections on the remaining principle components. The proposed test allows for different choices of kernels, corresponding to different classes of functions under the null hypothesis. First, using linear or polynomial kernels, our partial permutation tests are exactly valid in finite samples for linear or polynomial regression models with Gaussian noise; similar results straightforwardly extend to kernels with finite feature spaces. Second, by allowing the kernel feature space to diverge with the sample size, the test can be large-sample valid for a wider class of functions. Third, for general kernels with possibly infinite-dimensional feature space, the partial permutation test is exactly valid when the covariates are exactly balanced across all groups, or asymptotically valid when the underlying function follows certain regularized Gaussian processes. We further suggest test statistics using likelihood ratio between two (nested) Gaussian process regression models, and propose computationally efficient algorithms utilizing the EM algorithm and Newton’s method, where the latter also involves Fisher scoring and quadratic programming and is particularly useful when EM suffers from slow convergence. Extensions to correlated and non-Gaussian noises have also been investigated theoretically or numerically. Furthermore, the test can be extended to use multiple kernels together and can thus enjoy properties from each kernel. Both simulation study and application illustrate the properties of the proposed test.

Testing a Polynomial Relationship of the Non‐parametric Component in Partially Linear Spatial Autoregressive Models

Statistical Inference on the Parametric Component in Partially Linear Spatial Autoregressive Models.

Specification Testing in Nonstationary Time Series Models

Hypothesis Testing in Partial Functional Linear Spatial Autoregressive Model

A Note on the Nonparametric Least-squares Test for Checking a Polynomial Relationship

Model Checking in Partially Linear Spatial Autoregressive Models

An Empirical Study of a Test for Polynomial Relationships in Randomly Right Censored Regression Models

Testing Linearity for Nonparametric Component of Partially Linear Models

Estimation and testing of a higher-order partially linear spatial autoregressive model

Testing Linearity of Nonparametric Component in Partially Linear Model

The Size and Power of Bootstrap Tests for Spatial Dependence in a Linear Regression Model

A parametric specification test for linear spatial autoregressive models

Approach to Testing Nonlinear Time Series Models

Statistical inference of partially linear varying coefficient spatial autoregressive models

Kernel-Based Partial Permutation Test for Detecting Heterogeneous Functional Relationship

A Bootstrap Test for Constant Coefficients in Geographically Weighted Regression Models

Checking nonparametric component for partial linear regression model with missing response

Testing the Linearity in Partially Linear Models

Diagnostic Checking for the Adequacy of Nonlinear Time Series Models

Tests for Spatial Dependence and Heterogeneity in Spatially Autoregressive Varying Coefficient Models with Application to Boston House Price Analysis

Testing for Change Points in Partially Linear Models