Abstract:Let $A\in\mathbb C^{n\times n}$ and let $\mathcal X\subset \mathbb C^n$ be an $A$-invariant subspace with $\dim \mathcal X=d\geq 1$, corresponding to exterior eigenvalues of $A$. Given an initial subspace $\mathcal V\subset \mathbb C^n$ with $\dim \mathcal V=r\geq d$, we search for expansions of $\mathcal V$ of the form $\mathcal V+A(\mathcal W_0)$, where $\mathcal W_0\subset \mathcal V$ is such that $\dim \mathcal W_0\leq d$ and such that the expanded subspace is closer to $\mathcal X$ than the initial $\mathcal V$. We show that there exist (theoretical) optimal choices of such $\mathcal W_0$, in the sense that $\theta_i(\mathcal X,\mathcal V+A(\mathcal W_0))\leq \theta_i(\mathcal V+A(\mathcal W))$ for every $\mathcal W\subset \mathcal V$ with $\dim \mathcal W\leq d$, where $\theta_i(\mathcal X,\mathcal T)$ denotes the $i$-th principal angle between $\mathcal X$ and $\mathcal T$, for $1\leq i\leq d\leq \dim \mathcal T$. We relate these optimal expansions to block Krylov subspaces generated by $A$ and $\mathcal V$. We also show that the corresponding iterative sequence of subspaces constructed in this way approximate $\mathcal X$ arbitrarily well, when $A$ is Hermitian and $\mathcal X$ is simple. We further introduce computable versions of this construction and compute several numerical examples that show the performance of the computable algorithms and test our convergence analysis.
What problem does this paper attempt to address?
### Problems the paper attempts to solve
This paper aims to solve the approximation problems of eigenvalues and eigenvectors of large complex matrices \( A \in \mathbb{C}^{n \times n} \). Specifically, given an initial search subspace \( V \subset \mathbb{C}^n \), the authors explore how to more accurately approximate the invariant subspace \( X \) corresponding to the exterior eigenvalues by expanding this subspace.
#### Specific description of the problem
1. **Objective**: For a \( d \)-dimensional \( A \)-invariant subspace \( X \subset \mathbb{C}^n \), find a method to expand the initial subspace \( V \) so that the expanded subspace is closer to \( X \).
2. **Method**: Consider the expanded subspaces of the form \( V + A(W_0) \), where \( W_0 \subset V \) and \( \dim W_0 \leq d \), so that the expanded subspace is closer to \( X \) than the initial subspace \( V \).
3. **Optimization condition**: Look for the optimal \( W_0 \) such that for all subspaces \( W \subset V \) with \( \dim W \leq d \), we have:
\[
\theta_i(X, V + A(W_0)) \leq \theta_i(V + A(W))
\]
where \( \theta_i(X, T) \) represents the \( i \)-th principal angle between subspaces \( X \) and \( T \).
#### Key contributions
1. **Theoretical results**: Prove the existence of the optimal \( W_0 \), and these optimal expansions are related to block Krylov subspaces.
2. **Iterative algorithm**: Propose an iterative algorithm with a computable version based on the projection method to gradually expand the search subspace, and test the performance of these algorithms.
3. **Numerical experiments**: Verify the effectiveness of the proposed computable algorithms through multiple numerical examples and analyze their convergence.
#### Application scenarios
- **Hermitian matrices**: When \( A \) is a Hermitian matrix, this method can efficiently approximate the exterior eigenvalues and their corresponding eigenvectors.
- **Large - scale matrices**: For large - scale matrices, directly calculating eigenvalues and eigenvectors can be very time - consuming or impractical, so this method provides an effective approximation means.
In conclusion, this paper mainly solves the problem of how to efficiently approximate the eigenvalues and eigenvectors of large complex matrices by iteratively expanding the search subspace in numerical linear algebra.