Abstract:Let $Z_1,\ldots,Z_n$ be i.i.d. isotropic random vectors in $\mathbb{R}^p$, and $T \subset \mathbb{R}^p$ be a compact set. A classical line of empirical process theory characterizes the size of the suprema of the quadratic process \begin{align*} \sup_{t \in T} \bigg| \frac{1}{n}\sum_{i=1}^n \langle Z_i,t \rangle^2-\lVert t \rVert^2 \bigg|, \end{align*} via a single parameter known as the Gaussian width of $T$. This paper introduces an improved bound for the suprema of this quadratic process for standard Gaussian vectors $\{Z_i\}$ that can be exactly attained for certain choices of $T$, and is thus referred to as an exact bound. Our exact bound is expressed via a collection of (stochastic) Gaussian widths over spherical sections of $T$ that serves as a natural multi-scale analogue to the Gaussian width of $T$. Compared to the classical bounds for the quadratic process, our new bounds not only determine the optimal constants in the classical bounds that can be attained for some $T$, but also precisely capture certain subtle phase transitional behavior of the quadratic process beyond the reach of the classical bounds. To illustrate the utility of our results, we obtain tight versions of the Gaussian Dvoretzky-Milman theorem for random projection, and the Koltchinskii-Lounici theorem for covariance estimation, both with optimal constants. Moreover, our bounds recover the celebrated BBP phase transitional behavior of the top eigenvalue of the sample covariance and its generalization to the sample covariance error. The proof of our results exploits recently sharpened Gaussian comparison inequalities. The technical scope of our method of proof is further demonstrated in obtaining an exact bound for a two-sided Chevet inequality.

Quantitative limit theorems and bootstrap approximations for empirical spectral projectors

Cluster-Robust Bootstrap Inference in Quantile Regression Models

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Improved Rates of Bootstrap Approximation for the Operator Norm: A Coordinate-Free Approach

Gaussian and Bootstrap Approximations for Suprema of Empirical Processes

Nonparametric bootstrap of high-dimensional sample covariance matrices

On asymptotics of eigenvectors of large sample covariance matrix

EIGENVALUE DISTRIBUTIONS OF VARIANCE COMPONENTS ESTIMATORS IN HIGH-DIMENSIONAL RANDOM EFFECTS MODELS

Convergence Rates of Spectral Distributions of Large Sample Covariance Matrices

Linear spectral statistics of eigenvectors of anisotropic sample covariance matrices

Robust Max Statistics for High-Dimensional Inference

Gaussian Approximation for Lag-Window Estimators and the Construction of Confidence bands for the Spectral Density

Approximate nonparametric quantile regression in reproducing kernel Hilbert spaces via random projection

Exact bounds for some quadratic empirical processes with applications

Statistical properties of approximate geometric quantiles in infinite-dimensional Banach spaces

Estimation of trace functionals and spectral measures of covariance operators in Gaussian models

Möbius inversion and the bootstrap

High-dimensional sparse trigonometric approximation in the uniform norm and consequences for sampling recovery

Optimal low-rank approximations of posteriors for linear Gaussian inverse problems on Hilbert spaces

Fast Spectrum Estimation of Some Kernel Matrices

Convergence Rates of Spectral Distribution of Large Dimensional Quaternion Sample Covariance Matrix