Abstract:We present a new sublinear time algorithm for approximating the spectral density (eigenvalue distribution) of an $n\times n$ normalized graph adjacency or Laplacian matrix. The algorithm recovers the spectrum up to $\epsilon$ accuracy in the Wasserstein-1 distance in $O(n\cdot \text{poly}(1/\epsilon))$ time given sample access to the graph. This result compliments recent work by David Cohen-Steiner, Weihao Kong, Christian Sohler, and Gregory Valiant (2018), which obtains a solution with runtime independent of $n$, but exponential in $1/\epsilon$. We conjecture that the trade-off between dimension dependence and accuracy is inherent. Our method is simple and works well experimentally. It is based on a Chebyshev polynomial moment matching method that employees randomized estimators for the matrix trace. We prove that, for any Hermitian $A$, this moment matching method returns an $\epsilon$ approximation to the spectral density using just $O({1}/{\epsilon})$ matrix-vector products with $A$. By leveraging stability properties of the Chebyshev polynomial three-term recurrence, we then prove that the method is amenable to the use of coarse approximate matrix-vector products. Our sublinear time algorithm follows from combining this result with a novel sampling algorithm for approximating matrix-vector products with a normalized graph adjacency matrix. Of independent interest, we show a similar result for the widely used \emph{kernel polynomial method} (KPM), proving that this practical algorithm nearly matches the theoretical guarantees of our moment matching method. Our analysis uses tools from Jackson's seminal work on approximation with positive polynomial kernels.

Network Analysis via Partial Spectral Factorization and Gauss Quadrature

A quantum graph FFT with applications to partial differential equations on networks

Fast computation of spectral densities for generalized eigenvalue problems

Just SLaQ When You Approximate: Accurate Spectral Distances for Web-Scale Graphs

Sublinear Time Spectral Density Estimation

A Unified Approach to Scalable Spectral Sparsification of Directed Graphs

Stratified Stochastic Variational Inference for High-Dimensional Network Factor Model

Spectral Graph Matching and Regularized Quadratic Relaxations I Algorithm and Gaussian Analysis

Randomized matrix-free quadrature: unified and uniform bounds for stochastic Lanczos quadrature and the kernel polynomial method

Monotonicity, bounds and extrapolation of Block-Gauss and Gauss-Radau quadrature for computing $B^T ϕ(A) B$

Spectral Graph Matching and Regularized Quadratic Relaxations I: The Gaussian Model

Spectral tripartitioning of networks

Comprehensive spectral approach for community structure analysis on complex networks

Efficient Quantum Algorithms for Analyzing Large Sparse Electrical Networks

An algebraic multiscale method for spatial network models

Graph Sparsification by Approximate Matrix Multiplication

Comparing Graph Spectra of Adjacency and Laplacian Matrices

Unified approach for spectral properties of weighted adjacency matrices for graphs with degree-based edge-weights

On varimax asymptotics in network models and spectral methods for dimensionality reduction

On Spectral Portraits of Incidence Matrices of Nearest Neighbor Graphs

Learning Graphs from Linear Measurements: Fundamental Trade-offs and Applications