Abstract:In this paper we study the concentration properties for the eigenvalues of kernel matrices, which are central objects in a wide range of kernel methods and, more recently, in network analysis. We present a set of concentration inequalities tailored for each individual eigenvalue of the kernel matrix with respect to its known asymptotic limit. The inequalities presented here are of relative type, meaning that they scale with the eigenvalue in consideration, which results in convergence rates that vary across the spectrum. The rates we obtain here are faster than the typical $Ø(\frac{1}{\sqrt n})$ and are often exponential, depending on regularity assumptions of Sobolev type. One key feature of our results is that they apply to non positive kernels, which is fundamental in the context of network analysis. We show how our results are well suited for the study of dot product kernels, which are related to random geometric graphs on the sphere, via the graphon formalism. We illustrate our results by applying them to a variety of dot product kernels on the sphere and to the one dimensional Gaussian kernel.

Bounds for the Relative and Absolute Spectral Variations of Matrices

Deviation Inequalities on the Spectral Norm of Random Matrices with Dependent Entries

Simple Relative Deviation Bounds for Covariance and Gram Matrices

Bounds for the spectral radius of nonnegative matrices

Spectral Radius and Infinity Norm of Matrices

A matrix realization of spectral bounds

Relative residual bounds for eigenvalues in gaps of the essential spectrum

Bounds for Spectral Radii of Iterative Matrices

New Inequalities on Eigenvalues of the Hadamard Product and the Fan Product of Matrices

A New Upper Bound for Moduli of Eigenvalues of Iterative Matrices

A bound on the joint spectral radius using the diagonals

New Bounds for the Extreme and the Star Discrepancy of Double-Infinite Matrices

Two-sided Bounds for the Spectral Radius of Nonnegative Irreducible Matrices

Relative concentration bounds for the spectrum of kernel matrices

Bounds for Modules of Eigenvalues of Iterative Matrices

Upper bounds for the spectral radius of matrices having the Perron–Frobenius property

Estimates of the spectral condition number

Spectral bounds for certain special type of rational matrices

Some New Bounds for the Hadamard Product and the Fan Product of Matrices

Bounds on norms of compound matrices and on products of eigenvalues

Numerical bounds on the Crouzeix ratio for a class of matrices