Abstract:We extend the result on the top eigenvalue of the i.i.d.\ matrix with fixed perturbations by Tao to random perturbations. In particular, we consider a setup that $\mathbf{M}=\mathbf{W}+\lambda\mathbf{u}\mathbf{u}^*$ with $\mathbf{W}$ drawn from a Ginibre Orthogonal Ensemble and the perturbation $\mathbf{u}$ drawn uniformly from $\mathcal{S}^{d-1}$. We provide several asymptotic properties about the eigenvalues and the top eigenvector of the random matrix, which can not be obtained trivially from the deterministic perturbation case. We also apply our results to extend the work of Max Simchowitz, which provides an optimal lower bound for approximating the eigenspace of a symmetric matrix. We present a \textit{query complexity} lower bound for approximating the eigenvector of any asymmetric but diagonalizable matrix $\mathbf{M}$ corresponding to the largest eigenvalue. We show that for every $\operatorname{gap}\in (0,1/2]$ and large enough dimension $d$, there exists a random matrix $\mathbf{M}$ with $\operatorname{gap}(\mathbf{M})=\Omega(\operatorname{gap})$, such that if a matrix-vector query product algorithm can identity a vector $\hat{\mathbf{v}}$ which satisfies $\left\|\hat{\mathbf{v}}-\mathbf{v}_1(\mathbf{M}) \right\|_2^2\le \operatorname{const}\times \operatorname{gap}$, it needs at least $\mathcal{O}\left(\frac{\log d}{\operatorname{gap}}\right)$ queries of matrix-vector products. In the inverse polynomial accuracy regime where $\epsilon \ge \frac{1}{\operatorname{poly}(d)}$, the complexity matches the upper bounds $\mathcal{O}\left(\frac{\log(d/\epsilon)}{\operatorname{gap}}\right)$, which can be obtained via the power method. As far as we know, it is the first lower bound for computing the eigenvector of an asymmetric matrix, which is far more complicated than in the symmetric case.

Probabilistic perturbation bounds of matrix decompositions

A stochastic perturbation analysis of the QR decomposition and its applications

New matrix perturbation bounds via combinatorial expansion I: Perturbation of eigenspaces

On Eigenvector Approximation of Diagonalizable Random Matrices with Random Perturbations: Properties and Applications

Singular Subspace Perturbation Bounds via Rectangular Random Matrix Diffusions

Perturbation expansions and error bounds for the truncated singular value decomposition

New rigorous perturbation bounds for the LU and QR factorizations

Relative Perturbation Bounds for Eigenpairs of Diagonalizable Matrices

Some Remarks on the Perturbation of Polar Decompositions for Rectangular Matrices

Outliers and bounded rank perturbation for non-Hermitian random band matrices

Rank-one Perturbation Bounds for Singular Values of Arbitrary Matrices

Componentwise perturbation analysis for the generalized Schurdecomposition

Matrices with Gaussian Noise: Optimal Estimates for Singular Subspace Perturbation

Matrix perturbation analysis of methods for extracting singular values from approximate singular subspaces

Perturbation and Inverse Problems of Stochastic Matrices

Multiplicative perturbation bounds for spectral and singular value decompositions

Relative perturbation bounds for the eigenvalues of diagonalizable and singular matrices – Application of perturbation theory for simple invariant subspaces

Asymptotic Perturbation Bounds for Probabilistic Model Checking with Empirically Determined Probability Parameters

A Schatten-$q$ Low-rank Matrix Perturbation Analysis via Perturbation Projection Error Bound

Perturbation Analysis for Subspace Decomposition with Applications in Subspace-Based Algorithms

Entrywise relative perturbation bounds for exponentials of essentially non-negative matrices