Abstract:We extend the result on the top eigenvalue of the i.i.d.\ matrix with fixed perturbations by Tao to random perturbations. In particular, we consider a setup that $\mathbf{M}=\mathbf{W}+\lambda\mathbf{u}\mathbf{u}^*$ with $\mathbf{W}$ drawn from a Ginibre Orthogonal Ensemble and the perturbation $\mathbf{u}$ drawn uniformly from $\mathcal{S}^{d-1}$. We provide several asymptotic properties about the eigenvalues and the top eigenvector of the random matrix, which can not be obtained trivially from the deterministic perturbation case. We also apply our results to extend the work of Max Simchowitz, which provides an optimal lower bound for approximating the eigenspace of a symmetric matrix. We present a \textit{query complexity} lower bound for approximating the eigenvector of any asymmetric but diagonalizable matrix $\mathbf{M}$ corresponding to the largest eigenvalue. We show that for every $\operatorname{gap}\in (0,1/2]$ and large enough dimension $d$, there exists a random matrix $\mathbf{M}$ with $\operatorname{gap}(\mathbf{M})=\Omega(\operatorname{gap})$, such that if a matrix-vector query product algorithm can identity a vector $\hat{\mathbf{v}}$ which satisfies $\left\|\hat{\mathbf{v}}-\mathbf{v}_1(\mathbf{M}) \right\|_2^2\le \operatorname{const}\times \operatorname{gap}$, it needs at least $\mathcal{O}\left(\frac{\log d}{\operatorname{gap}}\right)$ queries of matrix-vector products. In the inverse polynomial accuracy regime where $\epsilon \ge \frac{1}{\operatorname{poly}(d)}$, the complexity matches the upper bounds $\mathcal{O}\left(\frac{\log(d/\epsilon)}{\operatorname{gap}}\right)$, which can be obtained via the power method. As far as we know, it is the first lower bound for computing the eigenvector of an asymmetric matrix, which is far more complicated than in the symmetric case.

Sharp error bounds for Ritz vectors and approximate singular vectors

Rayleigh-Ritz majorization error bounds with applications to FEM

On the Convergence of Ritz Pairs and Refined Ritz Vectors for Quadratic Eigenvalue Problems

How Sharp Are Error Bounds? –Lower Bounds on Quadrature Worst-Case Errors for Analytic Functions–

An Analysis of the Rayleigh-Ritz Method for Approximating Eigenspaces

On the Rayleigh-Ritz variational method

Matrices with Gaussian Noise: Optimal Estimates for Singular Subspace Perturbation

Convergence of Q-Ritz Pairs, Refined Q-Ritz Vectors and Q-Rayleigh-ritz Method for Quadratic Eigenvalue Problems

How sharp are error bounds? --lower bounds on quadrature worst-case errors for analytic functions

The Convergence of Harmonic Ritz Values, Harmonic Ritz Vectors, and Refined Harmonic Ritz Vectors

Sharp upper global a posteriori error estimates for nonlinear elliptic variational problems

Matrix perturbation analysis of methods for extracting singular values from approximate singular subspaces

Angle-free cluster robust Ritz value bounds for restarted block eigensolvers

Efficient Bounds and Estimates for Canonical Angles in Randomized Subspace Approximations

An Analogue of the Results of Saad and Stewart for Harmonic Ritz Vectors

Entrywise error bounds for low-rank approximations of kernel matrices

Some Theoretical Comparisons of Refined Ritz Vectors and Ritz Vectors

Some Sharp bounds for the generalized Davis-Wielandt radius

On Eigenvector Approximation of Diagonalizable Random Matrices with Random Perturbations: Properties and Applications

Rayleigh-Ritz Approximation For The Linear Response Eigenvalue Problem