Abstract:In this paper, we present a new framework to obtain tail inequalities for sums of random matrices. Compared with existing works, our tail inequalities have the following characteristics: 1) high feasibility--they can be used to study the tail behavior of various matrix functions, e.g., arbitrary matrix norms, the absolute value of the sum of the sum of the $j$ largest singular values (resp. eigenvalues) of complex matrices (resp. Hermitian matrices); and 2) independence of matrix dimension --- they do not have the matrix-dimension term as a product factor, and thus are suitable to the scenario of high-dimensional or infinite-dimensional random matrices. The price we pay to obtain these advantages is that the convergence rate of the resulting inequalities will become slow when the number of summand random matrices is large. We also develop the tail inequalities for matrix random series and matrix martingale difference sequence. We also demonstrate usefulness of our tail bounds in several fields. In compressed sensing, we employ the resulted tail inequalities to achieve a proof of the restricted isometry property when the measurement matrix is the sum of random matrices without any assumption on the distributions of matrix entries. In probability theory, we derive a new upper bound to the supreme of stochastic processes. In machine learning, we prove new expectation bounds of sums of random matrices matrix and obtain matrix approximation schemes via random sampling. In quantum information, we show a new analysis relating to the fractional cover number of quantum hypergraphs. In theoretical computer science, we obtain randomness-efficient samplers using matrix expander graphs that can be efficiently implemented in time without dependence on matrix dimensions.

A comparison inequality for sums of independent random variables

Approximation of the Tail Probability of Randomly Weighted Sums and Applications

ON THE FLUCTUATION IN THE RANDOM ASSIGNMENT PROBLEM

On Increments of Sums of Independent Non-Identically Distributed Random-Variables

On Increments of Sums of Random-Variables Without Moment Hypotheses

Probability Inequalities for Sums of Independent Unbounded Random Variables

An Inequality for the Sum of Independent Bounded Random Variables

The Convergence of the Sums of Independent Random Variables under the Sub-Linear Expectations

Some Inequalities of Linear Combinations of Independent Random Variables. I.

On Dimension-free Tail Inequalities for Sums of Random Matrices and Applications.

On the almost sure invariance principle for dependent Bernoulli random variables

Strong Approximation Theorems for Sums of Random Variables when Extreme Terms Are Excluded

LIL and the Approximation of Rectangular Sums of B-valued Random Variables when Extreme Terms Are Excluded

A Note on Multivariate Stochastic Comparisons of Bernoulli Random Variables

Limit Theorems for Dependent Bernoulli Variables with Statistical Inference

Matrix Infinitely Divisible Series: Tail Inequalities and Their Applications

Rosenthal’s Inequalities for Independent and Negatively Dependent Random Variables under Sub-Linear Expectations with Applications

A note on the invariance principle of the product of sums of random variables

Some inequalities of birandom variable

Entropy Inequalities and Gaussian Comparisons

A Limit Result for Self-Normalized Random Sums