Abstract:Solving the trust-region subproblem (TRS) plays a key role in numerical optimization and many other applications. Based on a fundamental result that the solution of TRS of size n is mathematically equivalent to finding the rightmost eigenpair of a certain matrix pair of size 2n, eigenvalue-based methods are promising due to their simplicity. For n large, the implicitly restarted Arnoldi (IRA) and refined Arnoldi (IRRA) algorithms are well suited for this eigenproblem. For a reasonable comparison of overall efficiency of the algorithms for solving TRS directly and eigenvaluebased algorithms, a vital premise is that the two kinds of algorithms must compute the approximate solutions of TRS with (almost) the same accuracy, but such premise has been ignored in the literature. To this end, we establish close relationships between the two kinds of residual norms, so that, given a stopping tolerance for IRA and IRRA, we are able to determine a reliable one that GLTR should use so as to ensure that GLTR and IRA, IRRA deliver the converged approximate solutions with similar accuracy. We also make a convergence analysis on the residual norms by the Generalized Lanczos Trust-Region (GLTR) algorithm for solving TRS directly, the Arnoldi method and the refined Arnoldi method for the equivalent eigenproblem. A number of numerical experiments are reported to illustrate that IRA and IRRA are competitive with GLTR and IRRA outperforms IRA.

AN ADAPTIVE TRUST-REGION METHOD FOR GENERALIZED EIGENVALUES OF SYMMETRIC TENSORS

An adaptive simple model trust region algorithm based on new weak secant equations

The Convergence of the Generalized Lanczos Trust-Region Method for the Trust-Region Subproblem

A Robust Hessian-based Trust Region Algorithm for Spherical Conformal Parameterizations

Adaptive Algorithms for Generalized Eigenvalue Decomposition with A Nonquadratic Criterion

An Improved Non-Monotonic Adaptive Trust Region Algorithm for Unconstrained Optimization

A simple and practical adaptive trust-region method

Beyond Nonconvexity: A Universal Trust-Region Method with New Analyses

Sub‐sampled adaptive trust region method on Riemannian manifolds

Convergence and worst-case complexity of adaptive Riemannian trust-region methods for optimization on manifolds

Trust-Region Eigenvalue Filtering for Projected Newton

Error Bounds of Lanczos Approach for Trust-Region Subproblem

Fast convergence of trust-regions for non-isolated minima via analysis of CG on indefinite matrices

A TRUST-REGION METHOD FOR NONSMOOTH NONCONVEX OPTIMIZATION

An efficient trust region algorithm with bounded iteration sequence for unconstrained optimization and its application in support vector machine

Hölderian Error Bounds and Kurdyka-Łojasiewicz Inequality for the Trust Region Subproblem

Generalized Eigenvalue for Even Order Tensors Via Einstein Product and Its Applications in Multilinear Control Systems.

Normalized Newton method to solve generalized tensor eigenvalue problems

On convergence of the generalized Lanczos trust-region method for trust-region subproblems

Weighted Non-Linear Criterion-Based Adaptive Generalised Eigendecomposition

A Comparison of Eigenvalue-Based Algorithms and the Generalized Lanczos Trust-Region Algorithm for Solving the Trust-Region Subproblem