Abstract:In this paper, we present a new framework to obtain tail inequalities for sums of random matrices. Compared with existing works, our tail inequalities have the following characteristics: 1) high feasibility--they can be used to study the tail behavior of various matrix functions, e.g., arbitrary matrix norms, the absolute value of the sum of the sum of the $j$ largest singular values (resp. eigenvalues) of complex matrices (resp. Hermitian matrices); and 2) independence of matrix dimension --- they do not have the matrix-dimension term as a product factor, and thus are suitable to the scenario of high-dimensional or infinite-dimensional random matrices. The price we pay to obtain these advantages is that the convergence rate of the resulting inequalities will become slow when the number of summand random matrices is large. We also develop the tail inequalities for matrix random series and matrix martingale difference sequence. We also demonstrate usefulness of our tail bounds in several fields. In compressed sensing, we employ the resulted tail inequalities to achieve a proof of the restricted isometry property when the measurement matrix is the sum of random matrices without any assumption on the distributions of matrix entries. In probability theory, we derive a new upper bound to the supreme of stochastic processes. In machine learning, we prove new expectation bounds of sums of random matrices matrix and obtain matrix approximation schemes via random sampling. In quantum information, we show a new analysis relating to the fractional cover number of quantum hypergraphs. In theoretical computer science, we obtain randomness-efficient samplers using matrix expander graphs that can be efficiently implemented in time without dependence on matrix dimensions.

Tail Bounds on the Spectral Norm of Sub-Exponential Random Matrices

Deviation Inequalities on the Spectral Norm of Random Matrices with Dependent Entries

Gaussian Tail for Empirical Distributions of MST on Random Graphs

Optimized Tail Bounds for Random Matrix Series

Deviation Inequalities for the Spectral Norm of Structured Random Matrices

On Dimension-free Tail Inequalities for Sums of Random Matrices and Applications.

Extremal random matrices with independent entries and matrix superconcentration inequalities

Matrix Infinitely Divisible Series: Tail Inequalities and Their Applications

A Note on the Convergence Rate of the Spectral Distributions of Large Random Matrices

Extremal bounds for Gaussian trace estimation

On asymptotics of eigenvectors of large sample covariance matrix

Exponential and Double Exponential Tails for Maximum of Two-Dimensional Discrete Gaussian Free Field

On Asymptotically Tight Tail Bounds for Sums of Geometric and Exponential Random Variables

General tail bounds for random tensors summation: Majorization approach

On limit theorem for the eigenvalues of product of two random matrices

Tail bounds for sums of geometric and exponential variables

Quantitative estimates of the spectral norm of random matrices with independent columns

Universality of extremal eigenvalues of large random matrices

Cantelli's bounds for generalized tail inequalities in Euclidean spaces

Deviation bounds for the norm of a random vector under exponential moment conditions with applications

LSV-Based Tail Inequalities for Sums of Random Matrices