Abstract:We propose a novel trust region method for solving a class of nonsmooth, nonconvex composite-type optimization problems. The approach embeds inexact semismooth Newton steps for finding zeros of a normal map-based stationarity measure for the problem in a trust region framework. Based on a new merit function and acceptance mechanism, global convergence and transition to fast local q-superlinear convergence are established under standard conditions. In addition, we verify that the proposed trust region globalization is compatible with the Kurdyka-Łojasiewicz inequality yielding finer convergence results. We further derive new normal map-based representations of the associated second-order optimality conditions that have direct connections to the local assumptions required for fast convergence. Finally, we study the behavior of our algorithm when the Hessian matrix of the smooth part of the objective function is approximated by BFGS updates. We successfully link the KL theory, properties of the BFGS approximations, and a Dennis-Mor{é}-type condition to show superlinear convergence of the quasi-Newton version of our method. Numerical experiments on sparse logistic regression, image compression, and a constrained log-determinant problem illustrate the efficiency of the proposed algorithm.

A new nonmonotone trust-region method of conic model for solving unconstrained optimization

A nonmonotone adaptive trust region method for unconstrained optimization based on conic model

A Trust Region-Type Method for Solving Monotone Variational Inequality

A nonmonotone trust region method for unconstrained optimization

A TRUST-REGION METHOD FOR NONSMOOTH NONCONVEX OPTIMIZATION

Effective nonmonotone trust region method based on a simple cubic model for unconstrained optimization problems

The convergence of conjugate gradient method with nonmonotone line search

Globally Convergent Composite-Step Trust-Region Framework for Model-Based Real-Time Optimization

An adaptive simple model trust region algorithm based on new weak secant equations

A trust region-type normal map-based semismooth Newton method for nonsmooth nonconvex composite optimization

An Improved Non-Monotonic Adaptive Trust Region Algorithm for Unconstrained Optimization

Beyond Nonconvexity: A Universal Trust-Region Method with New Analyses

Trust-region method for box-constrained semismooth equations and its applications to complementary problems

A Second-Order Cone Based Approach for Solving the Trust Region Subproblem and Its Variants

Convergence and worst-case complexity of adaptive Riemannian trust-region methods for optimization on manifolds

A modified nonmonotone trust region line search method

An affine scaling interior trust-region method combining with nonmonotone line search filter technique for linear inequality constrained minimization

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A new trust region algorithm for nonsmooth convex minimization

Riemannian Trust Region Methods for Minimization

An efficient trust region algorithm with bounded iteration sequence for unconstrained optimization and its application in support vector machine