Abstract:We propose a framework for analyzing and comparing distributions without imposing any parametric assumptions via empirical likelihood methods. Our framework is used to study two fundamental statistical test problems: the two-sample test and the goodness-of-fit test. For the two-sample test, we need to determine whether two groups of samples are from different distributions; for the goodness-of-fit test, we examine how likely it is that a set of samples is generated from a known target distribution. Specifically, we propose empirical likelihood ratio (ELR) statistics for the two-sample test and the goodness-of-fit test, both of which are of linear time complexity and show higher power (i.e., the probability of correctly rejecting the null hypothesis) than the existing linear statistics for high-dimensional data. We prove the nonparametric Wilks' theorems for the ELR statistics, which illustrate that the limiting distributions of the proposed ELR statistics are chi-square distributions. With these limiting distributions, we can avoid bootstraps or simulations to determine the threshold for rejecting the null hypothesis, which makes the ELR statistics more efficient than the recently proposed linear statistic, finite set Stein discrepancy (FSSD). We also prove the consistency of the ELR statistics, which guarantees that the test power goes to 1 as the number of samples goes to infinity. In addition, we experimentally demonstrate and theoretically analyze that FSSD has poor performance or even fails to test for high-dimensional data. Finally, we conduct a series of experiments to evaluate the performance of our ELR statistics as compared to state-of-the-art linear statistics.

Empirical Likelihood for High Dimensional Data

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Effects of data dimension on empirical likelihood

High-dimensional empirical likelihood inference

Calibration of the Empirical Likelihood for High-Dimensional Data

Empirical Likelihood Inference for Probability Density Functions under Association

Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Empirical Euclidean Likelihood for General Estimating Equations under Association Dependence

High Dimensional Expectation-Maximization Algorithm: Statistical Optimization and Asymptotic Normality

High dimensional generalized empirical likelihood for moment restrictions with dependent data

Empirical Likelihood in Euclidean and Some Non-Euclidean Spaces

A Note on Asymptotics of Classical Likelihood Ratio Tests for High-Dimensional Normal Distributions

A Likelihood Ratio Framework for High Dimensional Semiparametric Regression

A Two-Sample Test of High Dimensional Means Based on Posterior Bayes Factor

Penalized Jackknife Empirical Likelihood in High Dimensions

Linear Kernel Tests Via Empirical Likelihood for High-Dimensional Data

Empirical Likelihood Test for Regression Coefficients in High Dimensional Partially Linear Models

Marginal Empirical Likelihood Independence Screening in Sparse Ultrahigh Dimensional Additive Models

High-dimensional analysis of variance in multivariate linear regression

Asymptotic Power of Likelihood Ratio Tests for High Dimensional Data