Abstract:We propose a framework for analyzing and comparing distributions without imposing any parametric assumptions via empirical likelihood methods. Our framework is used to study two fundamental statistical test problems: the two-sample test and the goodness-of-fit test. For the two-sample test, we need to determine whether two groups of samples are from different distributions; for the goodness-of-fit test, we examine how likely it is that a set of samples is generated from a known target distribution. Specifically, we propose empirical likelihood ratio (ELR) statistics for the two-sample test and the goodness-of-fit test, both of which are of linear time complexity and show higher power (i.e., the probability of correctly rejecting the null hypothesis) than the existing linear statistics for high-dimensional data. We prove the nonparametric Wilks' theorems for the ELR statistics, which illustrate that the limiting distributions of the proposed ELR statistics are chi-square distributions. With these limiting distributions, we can avoid bootstraps or simulations to determine the threshold for rejecting the null hypothesis, which makes the ELR statistics more efficient than the recently proposed linear statistic, finite set Stein discrepancy (FSSD). We also prove the consistency of the ELR statistics, which guarantees that the test power goes to 1 as the number of samples goes to infinity. In addition, we experimentally demonstrate and theoretically analyze that FSSD has poor performance or even fails to test for high-dimensional data. Finally, we conduct a series of experiments to evaluate the performance of our ELR statistics as compared to state-of-the-art linear statistics.

Empirical likelihood test via estimating equations

Non-parametric Tests for the Tail Equivalence Via Empirical Likelihood

On the E ffi ciency of Generalized Likelihood Ratio Tests

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Testing conditional independence via empirical likelihood

High-dimensional empirical likelihood inference

Empirical Likelihood Methods Based on Influence Functions

Linear Regression Analysis with Inequality Constraints on the Regression Parameters Via Empirical Likelihood

Empirical Likelihood for Linear Models with Missing Responses

Sieve empirical likelihood ratio tests for nonparametric functions

The Empirical Likelihood Goodness-of-fit Test for Regression Model

Empirical likelihood for the analysis of experimental designs

Empirical Likelihood Methods Based on Characteristic Functions with Applications to Lévy Processes

A Loss Function Approach to Model Specification Testing and Its Relative Efficiency

Empirical Likelihood Ratio Tests for Multivariate Regression Models

Empirical Likelihood Ratio Test for Seemingly Unrelated Regression Models

Empirical Likelihood Ratio Test for Semiparametric Varying-Coefficient Partially Linear Models

Linear Kernel Tests Via Empirical Likelihood for High-Dimensional Data

An Empirical Likelihood Goodness-Of-Fit Test for Time Series

Evaluating the Relative Merits of Competing Models Based on Empirical Likelihood Ratio Test

Powerful Two-Sample Tests Based on the Likelihood Ratio.