On convergence of the generalized Lanczos trust-region method for trust-region subproblems

Bo Feng,Gang Wu

2023-06-26

Abstract:The generalized Lanczos trust-region (GLTR) method is one of the most popular approaches for solving large-scale trust-region subproblem (TRS). Recently, Jia and Wang [Z. Jia and F. Wang, \emph{SIAM J. Optim., 31 (2021), pp. 887--914}] considered the convergence of this method and established some {\it a prior} error bounds on the residual, the solution and the Largrange multiplier. In this paper, we revisit the convergence of the GLTR method and try to improve these bounds. First, we establish a sharper upper bound on the residual. Second, we give a new bound on the distance between the approximation and the exact solution, and show that the convergence of the approximation has nothing to do with the associated spectral separation. Third, we present some non-asymptotic bounds for the convergence of the Largrange multiplier, and define a factor that plays an important role on the convergence of the Largrange multiplier. Numerical experiments demonstrate the effectiveness of our theoretical results.

Numerical Analysis

What problem does this paper attempt to address?

The paper is primarily dedicated to the convergence analysis and improvement of large-scale Trust-Region Subproblems (TRS). Specifically, it focuses on the convergence properties of the Generalized Lanczos Trust-Region method (GLTR) when solving large-scale TRS and attempts to improve some error bounds given in previous studies.

The main contributions of the paper are as follows:

1. **Upper Bound of Residuals**: The paper establishes a sharper upper bound for the residual \(\|(A + \lambda_k I)x_k + g\|\), which is smaller by a factor of \(O(\kappa^{1/2})\) compared to previous works, where \(\kappa\) is the spectral condition number of the matrix \(A + \lambda_{\text{opt}} I\).

2. **Upper Bound of Approximate Solutions**: For the approximate solution \(x_k\), the paper provides a new upper bound for \(\sin \angle(x_{\text{opt}}, x_k)\) and proves that the convergence of \(x_k\) is independent of the spectral separation sep(\(\lambda_{\text{opt}}, C_k\)). This makes the newly proposed upper bound more effective in practice.

3. **Non-Asymptotic Upper Bound of Lagrange Multipliers**: For the error \(\lambda_{\text{opt}} - \lambda_k\) of the Lagrange multipliers \(\lambda_k\), previous upper bounds were asymptotic, meaning they only held when \(k\) was sufficiently large. This paper proposes a non-asymptotic upper bound applicable for all \(k \geq 1\) and defines a factor \(s(\lambda_{\text{opt}})\) that plays an important role in the convergence process of \(\lambda_k\).

4. **Convergence Analysis of Cubic Regularization Variants**: The paper also revisits the convergence of Krylov subspace methods used to solve cubic regularization variants of TRS and significantly improves previous results on the convergence of the multiplier \(\mu_{\text{opt}}\).

In summary, this paper provides more precise theoretical support for solving large-scale Trust-Region Subproblems by improving the convergence analysis of the Generalized Lanczos Trust-Region method.