Abstract:The advent of large-scale inference has spurred reexamination of conventional statistical thinking. In a Gaussian model for $n$ many $z$-scores with at most $k < \frac{n}{2}$ nonnulls, Efron suggests estimating the location and scale parameters of the null distribution. Placing no assumptions on the nonnull effects, the statistical task can be viewed as a robust estimation problem. However, the best known robust estimators fail to be consistent in the regime $k \asymp n$ which is especially relevant in large-scale inference. The failure of estimators which are minimax rate-optimal with respect to other formulations of robustness (e.g. Huber's contamination model) might suggest the impossibility of consistent estimation in this regime and, consequently, a major weakness of Efron's suggestion. A sound evaluation of Efron's model thus requires a complete understanding of consistency. We sharply characterize the regime of $k$ for which consistent estimation is possible and further establish the minimax estimation rates. It is shown consistent estimation of the location parameter is possible if and only if $\frac{n}{2} - k = \omega(\sqrt{n})$, and consistent estimation of the scale parameter is possible in the entire regime $k < \frac{n}{2}$. Faster rates than those in Huber's contamination model are achievable by exploiting the Gaussian character of the data. The minimax upper bound is obtained by considering estimators based on the empirical characteristic function. The minimax lower bound involves constructing two marginal distributions whose characteristic functions match on a wide interval containing zero. The construction notably differs from those in the literature by sharply capturing a scaling of $n-2k$ in the minimax estimation rate of the location.

Linear estimation of location and scale parameters using partial maxima

Estimating location parameters of two exponential distributions with ordered scale parameters

Some unified results on isotonic regression estimators of order restricted parameters of a general bivariate location/scale model

Minimax rates of convergence for nonparametric location-scale models

Noisy recovery from random linear observations: Sharp minimax rates under elliptical constraints

Asymptotic Theory of Least Distances Estimate in Multivariate Linear Models

Blind Minimax Estimation

The Moments of the Maximum of Normalized Partial Sums Related to Laws of the Iterated Logarithm under the Sub-Linear Expectation

Estimation of the Location and Scale Parameters of Generalized Pareto Distribution Based on Progressively Type-II Censored Order Statistics

On the maximum likelihood estimation in general log-linear models

The normal law under linear restrictions: simulation and estimation via minimax tilting

Minimaxity under half-Cauchy type priors

Investigation of finite-sample properties of robust location and scale estimators

A two-sample nonparametric test for one-sided location-scale alternative

Constrained Best Linear Unbiased Estimation

A Multiscale Perspective on Maximum Marginal Likelihood Estimation

Precise Error Analysis of Regularized M-estimators in High-dimensions

Two New Families of Local Asymptotically Minimax Lower Bounds in Parameter Estimation

Optimal estimation of the null distribution in large-scale inference

Quantile Least Squares: A Flexible Approach for Robust Estimation and Validation of Location-Scale Families

On improved estimation of the larger location parameter