Abstract:In this paper, we present a new framework to obtain tail inequalities for sums of random matrices. Compared with existing works, our tail inequalities have the following characteristics: 1) high feasibility--they can be used to study the tail behavior of various matrix functions, e.g., arbitrary matrix norms, the absolute value of the sum of the sum of the $j$ largest singular values (resp. eigenvalues) of complex matrices (resp. Hermitian matrices); and 2) independence of matrix dimension --- they do not have the matrix-dimension term as a product factor, and thus are suitable to the scenario of high-dimensional or infinite-dimensional random matrices. The price we pay to obtain these advantages is that the convergence rate of the resulting inequalities will become slow when the number of summand random matrices is large. We also develop the tail inequalities for matrix random series and matrix martingale difference sequence. We also demonstrate usefulness of our tail bounds in several fields. In compressed sensing, we employ the resulted tail inequalities to achieve a proof of the restricted isometry property when the measurement matrix is the sum of random matrices without any assumption on the distributions of matrix entries. In probability theory, we derive a new upper bound to the supreme of stochastic processes. In machine learning, we prove new expectation bounds of sums of random matrices matrix and obtain matrix approximation schemes via random sampling. In quantum information, we show a new analysis relating to the fractional cover number of quantum hypergraphs. In theoretical computer science, we obtain randomness-efficient samplers using matrix expander graphs that can be efficiently implemented in time without dependence on matrix dimensions.

LSV-Based Tail Inequalities for Sums of Random Matrices

On Dimension-free Tail Inequalities for Sums of Random Matrices and Applications.

Deviation Inequalities on the Spectral Norm of Random Matrices with Dependent Entries

Approximation of the Tail Probability of Randomly Weighted Sums and Applications

Joint CLT for Several Random Sesquilinear Forms with Applications to Large-Dimensional Spiked Population Models

Matrix Infinitely Divisible Series: Tail Inequalities and Their Applications

Optimized Tail Bounds for Random Matrix Series

Random Tensor Inequalities and Tail bounds for Bivariate Random Tensor Means, Part II

General tail bounds for random tensors summation: Majorization approach

LIL and the Approximation of Rectangular Sums of B-valued Random Variables when Extreme Terms Are Excluded

Probability Inequalities for Sums of Independent Unbounded Random Variables

T product Tensors Part II: Tail Bounds for Sums of Random T product Tensors

Tail bounds for Multivariate Random Tensor Means

Tail Bounds for Functions of Weighted Tensor Sums Derived from Random Walks on Riemannian Manifolds

Random Tensor Inequalities and Tail bounds for Bivariate Random Tensor Means, Part I

Tail Bounds on the Spectral Norm of Sub-Exponential Random Matrices

The smallest singular value of inhomogenous random rectangular matrices

Positive Semidefinite Supermartingales and Randomized Matrix Concentration Inequalities

Maximal inequalities and a law of the iterated logarithm for negatively associated random fields

Rosenthal’s Inequalities for Independent and Negatively Dependent Random Variables under Sub-Linear Expectations with Applications

A note on the invariance principle of the product of sums of random variables