Abstract:It is well known that fluctuations of marginals of high-dimensional random vectors that satisfy a certain concentration estimate called the thin shell condition are approximately Gaussian. In this article we identify a general condition on a sequence of high-dimensional random vectors under which one can identify the exponential decay rate of large deviation probabilities of the corresponding sequence of marginals. More precisely, consider the projection of an n-dimensional random vector onto a random k n -dimensional basis, k n ≤ n , drawn uniformly from the Haar measure on the Stiefel manifold of orthonormal k n -frames in R n , in three different asymptotic regimes as n → ∞ : “constant” ( k n = k ), “sublinear” ( k n → ∞ but k n / n → 0 ) and “linear” ( k n / n → λ with 0 < λ ≤ 1 ). When the sequence of random vectors satisfies a certain “asymptotic thin shell condition”, we establish large deviation principles for the corresponding sequence of random projections in the constant regime, and for the sequence of empirical measures of the coordinates of the random projections in the sublinear and linear regimes. We also establish large deviation principles for scaled ℓ q norms of the random projections in all three regimes. Moreover, we show that the asymptotic thin shell condition holds for various sequences of random vectors of interest, including the uniform measure on suitably scaled ℓ p n balls, for p ∈ [ 1 , ∞ ) , and generalized Orlicz balls defined via a superquadratic function, as well as a class of Gibbs measures with superquadratic interaction potential. Along the way, we obtain logarithmic asymptotics of volumes of high-dimensional Orlicz balls, which may be of independent interest. We also show that the decay rate of large deviation probabilities of Euclidean norms of multi-dimensional projections of ℓ p n balls, when p ∈ [ 1 , 2 ) , exhibits an unexpected phase transition in the sublinear regime, thus disproving an earlier conjecture due to Alonso-Gutiérrez et al. Random projections of high-dimensional random vectors are of interest in a range of fields including asymptotic convex geometry and high-dimensional statistics.

Set Estimation from Projected Multidimensional Random Variables with Application to a Discrete-Time Skorokhod Problem

Achieving High Convergence Rates by Quasi-Monte Carlo and Importance Sampling for Unbounded Integrands

On a Calculable Skorokhod's Integral Based Projection Estimator of the Drift Function in Fractional SDE

Limit results for distributed estimation of invariant subspaces in multiple networks inference and PCA

Conditional Optimization of Algorithms for Estimating Distributions of Solutions to Stochastic Differential Equations

On Inhomogeneous Infinite Products of Stochastic Matrices and Applications

Potential Hessian Ascent: The Sherrington-Kirkpatrick Model

An asymptotic thin shell condition and large deviations for random multidimensional projections

Estimating the Convex Hull of the Image of a Set with Smooth Boundary: Error Bounds and Applications

High-dimensional stochastic optimization with the generalized Dantzig estimator

Large information plus noise random matrix models and consistent subspace estimation in large sensor networks

Covering Constants for Metric Projection Operator with Applications to Stochastic Fixed-Point Problems

On Inhomogeneous Infinite Products of Stochastic Matrices and Their Applications

On a computable Skorokhod's integral‐based estimator of the drift parameter in fractional SDE

Inference on estimators defined by mathematical programming

Level set and density estimation on manifolds

Breaking the Curse for Uniform Approximation in Hilbert Spaces via Monte Carlo Methods

Uniqueness for the Skorokhod problem in an orthant: critical cases

Consistent Estimation for PCA and Sparse Regression with Oblivious Outliers

Quenched large deviation principles for random projections of $\ell_p^n$ balls