Abstract:We propose a novel trust region method for solving a class of nonsmooth, nonconvex composite-type optimization problems. The approach embeds inexact semismooth Newton steps for finding zeros of a normal map-based stationarity measure for the problem in a trust region framework. Based on a new merit function and acceptance mechanism, global convergence and transition to fast local q-superlinear convergence are established under standard conditions. In addition, we verify that the proposed trust region globalization is compatible with the Kurdyka-Łojasiewicz inequality yielding finer convergence results. We further derive new normal map-based representations of the associated second-order optimality conditions that have direct connections to the local assumptions required for fast convergence. Finally, we study the behavior of our algorithm when the Hessian matrix of the smooth part of the objective function is approximated by BFGS updates. We successfully link the KL theory, properties of the BFGS approximations, and a Dennis-Mor{é}-type condition to show superlinear convergence of the quasi-Newton version of our method. Numerical experiments on sparse logistic regression, image compression, and a constrained log-determinant problem illustrate the efficiency of the proposed algorithm.

Convergence and worst-case complexity of adaptive Riemannian trust-region methods for optimization on manifolds

Riemannian Trust Region Methods for Minimization

A Trust Region-Type Method for Solving Monotone Variational Inequality

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Riemannian Trust Region Methods for SC$^1$ Minimization

A TRUST-REGION METHOD FOR NONSMOOTH NONCONVEX OPTIMIZATION

Globally Convergent Composite-Step Trust-Region Framework for Model-Based Real-Time Optimization

On Convergence Properties of the Modified Trust Region Method under Hölderian Error Bound Condition

Sub‐sampled adaptive trust region method on Riemannian manifolds

A nonmonotone adaptive trust region method for unconstrained optimization based on conic model

The Convergence of the Generalized Lanczos Trust-Region Method for the Trust-Region Subproblem

An Improved Non-Monotonic Adaptive Trust Region Algorithm for Unconstrained Optimization

Nonsmooth nonconvex optimization on Riemannian manifolds via bundle trust region algorithm

Riemannian Adaptive Regularized Newton Methods with Hölder Continuous Hessians

A New Trust Region Method With Adaptive Radius For Unconstrained Optimization

Beyond Nonconvexity: A Universal Trust-Region Method with New Analyses

Local convergence analysis of an inexact trust-region method for nonsmooth optimization

A New Modified Nonmonotone Adaptive Trust Region Method for Unconstrained Optimization

A Riemannian Subspace BFGS Trust Region Method

A trust region-type normal map-based semismooth Newton method for nonsmooth nonconvex composite optimization