Abstract:In this paper, we present a new framework to obtain tail inequalities for sums of random matrices. Compared with existing works, our tail inequalities have the following characteristics: 1) high feasibility--they can be used to study the tail behavior of various matrix functions, e.g., arbitrary matrix norms, the absolute value of the sum of the sum of the $j$ largest singular values (resp. eigenvalues) of complex matrices (resp. Hermitian matrices); and 2) independence of matrix dimension --- they do not have the matrix-dimension term as a product factor, and thus are suitable to the scenario of high-dimensional or infinite-dimensional random matrices. The price we pay to obtain these advantages is that the convergence rate of the resulting inequalities will become slow when the number of summand random matrices is large. We also develop the tail inequalities for matrix random series and matrix martingale difference sequence. We also demonstrate usefulness of our tail bounds in several fields. In compressed sensing, we employ the resulted tail inequalities to achieve a proof of the restricted isometry property when the measurement matrix is the sum of random matrices without any assumption on the distributions of matrix entries. In probability theory, we derive a new upper bound to the supreme of stochastic processes. In machine learning, we prove new expectation bounds of sums of random matrices matrix and obtain matrix approximation schemes via random sampling. In quantum information, we show a new analysis relating to the fractional cover number of quantum hypergraphs. In theoretical computer science, we obtain randomness-efficient samplers using matrix expander graphs that can be efficiently implemented in time without dependence on matrix dimensions.

The discrepancy in min-max statistics between two random matrices with finite third moments

Deviation Inequalities on the Spectral Norm of Random Matrices with Dependent Entries

On Increments of Sums of Random-Variables Without Moment Hypotheses

Strong Approximation for Ρ-Mixing Sequences

Concentration and moment inequalities for heavy-tailed random matrices

Asymptotic Approximation of Inverse Moments of Nonnegative Random Variables

On Dimension-free Tail Inequalities for Sums of Random Matrices and Applications.

Maximal inequalities and a law of the iterated logarithm for negatively associated random fields

Deriving Matrix Concentration Inequalities from Kernel Couplings

A concentration inequality and a local law for the sum of two random matrices

Central limit theorems for high dimensional dependent data

Extremal random matrices with independent entries and matrix superconcentration inequalities

Anti-Concentration Inequalities for the Difference of Maxima of Gaussian Random Vectors

Concentration Inequalities for Sums of Markov Dependent Random Matrices

A Matrix Version of Chernoff Inequality

Constructive approaches to concentration inequalities with independent random variables

Bounding probability of small deviation on sum of independent random variables: Combination of moment approach and Berry-Esseen theorem

New Bounds for the Extreme and the Star Discrepancy of Double-Infinite Matrices

A Concentration Inequality for Maximum Mean Discrepancy (MMD)-based Statistics and Its Application in Generative Models

Yurinskii's Coupling for Martingales

Outliers for deformed inhomogeneous random matrices