Abstract:This paper presents new uniform Gaussian strong approximations for empirical processes indexed by classes of functions based on $d$-variate random vectors ($d\geq1$). First, a uniform Gaussian strong approximation is established for general empirical processes indexed by Lipschitz functions, encompassing and improving on all previous results in the literature. When specialized to the setting considered by Rio (1994), and certain constraints on the function class hold, our result improves the approximation rate $n^{-1/(2d)}$ to $n^{-1/\max\{d,2\}}$, up to the same $\operatorname{polylog} n$ term, where $n$ denotes the sample size. Remarkably, we establish a valid uniform Gaussian strong approximation at the optimal rate $n^{-1/2}\log n$ for $d=2$, which was previously known to be valid only for univariate ($d=1$) empirical processes via the celebrated Hungarian construction (Komlós et al., 1975). Second, a uniform Gaussian strong approximation is established for a class of multiplicative separable empirical processes indexed by Lipschitz functions, which address some outstanding problems in the literature (Chernozhukov et al., 2014, Section 3). In addition, two other uniform Gaussian strong approximation results are presented for settings where the function class takes the form of a sequence of Haar basis based on generalized quasi-uniform partitions. We demonstrate the improvements and usefulness of our new strong approximation results with several statistical applications to nonparametric density and regression estimation.

On the power of iid information for linear approximation

On the power of random information

The power of random information for numerical approximation and integration

On the power of standard information for tractability for L∞ approximation of periodic functions in the worst case setting

On the power of function values for the approximation problem in various settings

Approximation in Hilbert spaces of the Gaussian and related analytic kernels

Uniform approximation of vectors using adaptive randomized information

On the Asymptotic Approximation of Inverse Moment under Sub-Linear Expectations

Efficient Statistics: Extracting Information from IID Observations

On some information-theoretic aspects of non-linear statistical inverse problems

Infinite-Variate $L^2$-Approximation with Nested Subspace Sampling

Information-Theoretic Perspectives on Brascamp-Lieb Inequality and Its Reverse

Linear Convergence in Hilbert's Projective Metric for Computing Augustin Information and a Rényi Information Measure

On Lower Bounds for Statistical Learning Theory

Strong Approximations for Empirical Processes Indexed by Lipschitz Functions

Information inequality problem over set functions

Information Theoretic Lower Bounds for Information Theoretic Upper Bounds

Asymptotic analysis in multivariate worst case approximation with Gaussian kernels

Robust and Fast Measure of Information Via Low-Rank Representation

A GAUSSIAN VERSION OF LITTLEWOOD'S THEOREM FOR RANDOM POWER SERIES

Limitations of Information-Theoretic Generalization Bounds for Gradient Descent Methods in Stochastic Convex Optimization