Abstract:For a large Hermitian matrix $A\in \mathbb{C}^{N\times N}$, it is often the case that the only affordable operation is matrix-vector multiplication. In such case, randomized method is a powerful way to estimate the spectral density (or density of states) of $A$. However, randomized methods developed so far for estimating spectral densities only extract information from different random vectors independently, and the accuracy is therefore inherently limited to $\mathcal{O}(1/\sqrt{N_{v}})$ where $N_{v}$ is the number of random vectors. In this paper we demonstrate that the "$\mathcal{O}(1/\sqrt{N_{v}})$ barrier" can be overcome by taking advantage of the correlated information of random vectors when properly filtered by polynomials of $A$. Our method uses the fact that the estimation of the spectral density essentially requires the computation of the trace of a series of matrix functions that are numerically low rank. By repeatedly applying $A$ to the same set of random vectors and taking different linear combination of the results, we can sweep through the entire spectrum of $A$ by building such low rank decomposition at different parts of the spectrum. Under some assumptions, we demonstrate that a robust and efficient implementation of such spectrum sweeping method can compute the spectral density accurately with $\mathcal{O}(N^2)$ computational cost and $\mathcal{O}(N)$ memory cost. Numerical results indicate that the new method can significantly outperform existing randomized methods in terms of accuracy. As an application, we demonstrate a way to accurately compute a trace of a smooth matrix function, by carefully balancing the smoothness of the integrand and the regularized density of states using a deconvolution procedure.

Spectral statistics of interpolating random circulant matrix

Fluctuations of Eigenvalues for Generalized Patterned Gaussian Random Matrices

The spectrum of coupled random matrices

On the empirical spectral distribution for certain models related to sample covariance matrices with different correlations

A Note on the Convergence Rate of the Spectral Distributions of Large Random Matrices

Random non-Abelian G-circulant matrices. Spectrum of random convolution operators on large finite groups

Average Spectral Density of Multiparametric Gaussian Ensembles of Complex Matrices

The Spectral Boundary of Block Structured Random Matrices

Spectral crossover in non-hermitian spin chains: comparison with random matrix theory

Randomized estimation of spectral densities of large matrices made accurate

Spectral fluctuations of multiparametric complex matrix ensembles: evidence of a single parameter dependence

On asymptotics of eigenvectors of large sample covariance matrix

Fluctuations of eigenvalues of patterned random matrices

Spectrum of random centrosymmetric matrices; CLT and Circular law

Supersymmetry in Spaces of Constant Curvature

Bulk Spectra of Truncated Sample Covariance Matrices

Kernel Interpolation of High Dimensional Scattered Data

Fluctuation Around the Circular Law for Random Matrices with Real Entries

Universality for the global spectrum of random inner-product kernel matrices in the polynomial regime