Abstract:For a large Hermitian matrix $A\in \mathbb{C}^{N\times N}$, it is often the case that the only affordable operation is matrix-vector multiplication. In such case, randomized method is a powerful way to estimate the spectral density (or density of states) of $A$. However, randomized methods developed so far for estimating spectral densities only extract information from different random vectors independently, and the accuracy is therefore inherently limited to $\mathcal{O}(1/\sqrt{N_{v}})$ where $N_{v}$ is the number of random vectors. In this paper we demonstrate that the "$\mathcal{O}(1/\sqrt{N_{v}})$ barrier" can be overcome by taking advantage of the correlated information of random vectors when properly filtered by polynomials of $A$. Our method uses the fact that the estimation of the spectral density essentially requires the computation of the trace of a series of matrix functions that are numerically low rank. By repeatedly applying $A$ to the same set of random vectors and taking different linear combination of the results, we can sweep through the entire spectrum of $A$ by building such low rank decomposition at different parts of the spectrum. Under some assumptions, we demonstrate that a robust and efficient implementation of such spectrum sweeping method can compute the spectral density accurately with $\mathcal{O}(N^2)$ computational cost and $\mathcal{O}(N)$ memory cost. Numerical results indicate that the new method can significantly outperform existing randomized methods in terms of accuracy. As an application, we demonstrate a way to accurately compute a trace of a smooth matrix function, by carefully balancing the smoothness of the integrand and the regularized density of states using a deconvolution procedure.

Uniformly Distributed Seeds For Randomized Trace Estimator On O(N-2)-Operation Log-Det Approximation In Gaussian Process Regression

On randomized trace estimates for indefinite matrices with an application to determinants

Contraction rates for conjugate gradient and Lanczos approximate posteriors in Gaussian process regression

Large-scale Log-determinant Computation through Stochastic Chebyshev Expansions

Additive estimates of the permanent using Gaussian fields

Suboptimal subspace construction for log-determinant approximation

Simulating Gaussian vectors via randomized dimension reduction and PCA

Randomized Approximation of the Gram Matrix: Exact Computation and Probabilistic Bounds

Assessing stochastic algorithms for large scale nonlinear least squares problems using extremal probabilities of linear combinations of gamma random variables

Precise Error Analysis of Regularized M-estimators in High-dimensions

Linear cost and exponentially convergent approximation of Gaussian Matérn processes

Random Multipliers Numerically Stabilize Gaussian and Block Gaussian Elimination: Proofs and an Extension to Low-rank Approximation

Randomized GCUR decompositions

Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regression

Norm and Trace Estimation with Random Rank-one Vectors

On The Variance of Schatten $p$-Norm Estimation with Gaussian Sketching Matrices

Randomized estimation of spectral densities of large matrices made accurate

Scalable Physics-based Maximum Likelihood Estimation using Hierarchical Matrices

Fast Approximate Determinants Using Rational Functions

Asymptotic Covariance Estimation by Gaussian Random Perturbation

Permutation and Grouping Methods for Sharpening Gaussian Process Approximations