Abstract:We examine the extent to which sublinear-sample property testing and estimation applies to settings where samples are independently but not identically distributed. Specifically, we consider the following distributional property testing framework: Suppose there is a set of distributions over a discrete support of size $k$, $\textbf{p}_1, \textbf{p}_2,\ldots,\textbf{p}_T$, and we obtain $c$ independent draws from each distribution. Suppose the goal is to learn or test a property of the average distribution, $\textbf{p}_{\mathrm{avg}}$. This setup models a number of important practical settings where the individual distributions correspond to heterogeneous entities -- either individuals, chronologically distinct time periods, spatially separated data sources, etc. From a learning standpoint, even with $c=1$ samples from each distribution, $\Theta(k/\varepsilon^2)$ samples are necessary and sufficient to learn $\textbf{p}_{\mathrm{avg}}$ to within error $\varepsilon$ in TV distance. To test uniformity or identity -- distinguishing the case that $\textbf{p}_{\mathrm{avg}}$ is equal to some reference distribution, versus has $\ell_1$ distance at least $\varepsilon$ from the reference distribution, we show that a linear number of samples in $k$ is necessary given $c=1$ samples from each distribution. In contrast, for $c \ge 2$, we recover the usual sublinear sample testing of the i.i.d. setting: we show that $O(\sqrt{k}/\varepsilon^2 + 1/\varepsilon^4)$ samples are sufficient, matching the optimal sample complexity in the i.i.d. case in the regime where $\varepsilon \ge k^{-1/4}$. Additionally, we show that in the $c=2$ case, there is a constant $\rho > 0$ such that even in the linear regime with $\rho k$ samples, no tester that considers the multiset of samples (ignoring which samples were drawn from the same $\textbf{p}_i$) can perform uniformity testing.

Testing Lorenz Curves with Non-Simple Random Samples

Improved Nonparametric Bootstrap Tests of Lorenz Dominance

Consistency of invariance-based randomization tests

Randomization Tests for Equality in Dependence Structure

On Iterated Lorenz Curves with Applications

On the Lorenz ordering of order statistics from exponential populations and some applications

A Note to the Lorenz Curve and Gini Coefficient

A new class of nonparametric tests for second-order stochastic dominance based on the Lorenz P-P plot

Stratified incomplete local simplex tests for curvature of nonparametric multiple regression

Tests for Covariance Structures with High-Dimensional Repeated Measurements

Testing independence in high dimensions with sums of rank correlations

Towards a theory for testing statistical hypothesis: Multivariate mean with nuisance covariance matrix

Testing conditional independence via empirical likelihood

Observational Causality Testing

The Testing of Random Effect in Mixed Generalized Single Index Models

Testing For Auto-Calibration With Lorenz And Concentration Curves

Intrinsic tests for the equality of two correlated proportions

Birnbaum-Saunders parameters estimation using simple random sampling and ranked set sampling

Testing with Non-identically Distributed Samples

Testing Independence with High-Dimensional Correlated Samples

Nonparametric Testing under Randomized Sketching