Abstract:It is well known that fluctuations of marginals of high-dimensional random vectors that satisfy a certain concentration estimate called the thin shell condition are approximately Gaussian. In this article we identify a general condition on a sequence of high-dimensional random vectors under which one can identify the exponential decay rate of large deviation probabilities of the corresponding sequence of marginals. More precisely, consider the projection of an n-dimensional random vector onto a random k n -dimensional basis, k n ≤ n , drawn uniformly from the Haar measure on the Stiefel manifold of orthonormal k n -frames in R n , in three different asymptotic regimes as n → ∞ : “constant” ( k n = k ), “sublinear” ( k n → ∞ but k n / n → 0 ) and “linear” ( k n / n → λ with 0 < λ ≤ 1 ). When the sequence of random vectors satisfies a certain “asymptotic thin shell condition”, we establish large deviation principles for the corresponding sequence of random projections in the constant regime, and for the sequence of empirical measures of the coordinates of the random projections in the sublinear and linear regimes. We also establish large deviation principles for scaled ℓ q norms of the random projections in all three regimes. Moreover, we show that the asymptotic thin shell condition holds for various sequences of random vectors of interest, including the uniform measure on suitably scaled ℓ p n balls, for p ∈ [ 1 , ∞ ) , and generalized Orlicz balls defined via a superquadratic function, as well as a class of Gibbs measures with superquadratic interaction potential. Along the way, we obtain logarithmic asymptotics of volumes of high-dimensional Orlicz balls, which may be of independent interest. We also show that the decay rate of large deviation probabilities of Euclidean norms of multi-dimensional projections of ℓ p n balls, when p ∈ [ 1 , 2 ) , exhibits an unexpected phase transition in the sublinear regime, thus disproving an earlier conjecture due to Alonso-Gutiérrez et al. Random projections of high-dimensional random vectors are of interest in a range of fields including asymptotic convex geometry and high-dimensional statistics.

Random Quadratic Forms with Dependence: Applications to Restricted Isometry and Beyond

Joint CLT for Several Random Sesquilinear Forms with Applications to Large-Dimensional Spiked Population Models

M-Dependence Approximation for Dependent Random Variables

Randomization Moduli of Continuity for ℓ2-Norm Squared Ornstein-Uhlenbeck Processes

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

Central Limit Theorems for Weighted Quadratic Forms of Dependent Processes with Applications in Specification Testing

Asymptotics for A Class of Dependent Random Variables

The Limiting Theorems of Random Quadratic Forms and Their Application

On the Independence of Linear and Quadratic Forms in Normal Variates

Rosenthal’s Inequalities for Independent and Negatively Dependent Random Variables under Sub-Linear Expectations with Applications

On Degrees of Freedom of Projection Estimators with Applications to Multivariate Shape Restricted Regression

On the almost sure invariance principle for dependent Bernoulli random variables

Random weighted projections, random quadratic forms and random eigenvectors

Regularity of laws via Dirichlet forms: application to quadratic forms in independent and identically distributed random variables

Regularity of laws via Dirichlet forms -- Application to quadratic forms in independent and identically distributed random variables

Nonsense associations in Markov random fields with pairwise dependence

Uniform Risk Bounds for Learning with Dependent Data Sequences

Dependency-dependent Bounds for Sums of Dependent Random Variables

Inference in Randomized Least Squares and PCA via Normality of Quadratic Forms

Negative dependence in the balls and bins experiment with applications to order statistics

An asymptotic thin shell condition and large deviations for random multidimensional projections