Abstract:We propose a novel trust region method for solving a class of nonsmooth, nonconvex composite-type optimization problems. The approach embeds inexact semismooth Newton steps for finding zeros of a normal map-based stationarity measure for the problem in a trust region framework. Based on a new merit function and acceptance mechanism, global convergence and transition to fast local q-superlinear convergence are established under standard conditions. In addition, we verify that the proposed trust region globalization is compatible with the Kurdyka-Łojasiewicz inequality yielding finer convergence results. We further derive new normal map-based representations of the associated second-order optimality conditions that have direct connections to the local assumptions required for fast convergence. Finally, we study the behavior of our algorithm when the Hessian matrix of the smooth part of the objective function is approximated by BFGS updates. We successfully link the KL theory, properties of the BFGS approximations, and a Dennis-Mor{é}-type condition to show superlinear convergence of the quasi-Newton version of our method. Numerical experiments on sparse logistic regression, image compression, and a constrained log-determinant problem illustrate the efficiency of the proposed algorithm.

Shape-changing trust-region methods using multipoint symmetric secant matrices

An adaptive simple model trust region algorithm based on new weak secant equations

A Trust Region Method for Optimization Problem with Singular Solutions

An improved nonmonotone adaptive trust region method

Trust-Region Algorithms for Training Responses: Machine Learning Methods Using Indefinite Hessian Approximations

A trust region-type normal map-based semismooth Newton method for nonsmooth nonconvex composite optimization

A New Simple Model Trust-Region Method with Generalized Barzilai-Borwein Parameter for Large-Scale Optimization

A conic regularized Barzilai–Borwein trust region method for large scale unconstrained optimization

Nonmonotone Adaptive Trust Region Method Based on Simple Conic Model for Unconstrained Optimization

An $LDL^T$ Trust-Region Quasi-Newton Method

A TRUST-REGION METHOD FOR NONSMOOTH NONCONVEX OPTIMIZATION

Non-monotone Nonlinear Conjugate Gradient Method Based on the Trust Region Technique

A Matrix-Free Trust-Region SQP Method for Equality Constrained Optimization

Efficient Multi-Stage Conjugate Gradient for Trust Region Step

A Trust Region Method with Regularized Barzilai-Borwein Step-Size for Large-Scale Unconstrained Optimization

A nonmonotone adaptive trust region method for unconstrained optimization based on conic model

Active-Set Projected Trust-Region Algorithm for Box-Constrained Nonsmooth Equations

Adaptive Conic Trust-Region Method for Nonlinear Least Squares Problems

A Quasi-Newton-Trust Region Method for Equality Constrained Optimization and Its Convergence Properties

A Robust Hessian-based Trust Region Algorithm for Spherical Conformal Parameterizations

A Nonmonotone Trust Region Method Based on Simple Quadratic Models