Abstract:We propose a coderivative-based generalized regularized Newton method with positive definite regularization term (GRNM-PD) to solve optimization problems. In GRNM-PD, a general positive definite symmetric matrix is used to regularize the generalized Hessian, in contrast to the recently proposed GRNM, which uses the identity matrix. Our approach features global convergence and fast local convergence rate even for problems with nonisolated solutions. To this end, we introduce the p -order semismooth property which plays the same role in our analysis as Lipschitz continuity of the Hessian does in the case. Imposing only the metric q -subregularity of the gradient at a solution, we establish global convergence of the proposed algorithm as well as its local convergence rate, which can be superlinear, quadratic, or even higher than quadratic, depending on an algorithmic parameter and the regularity parameters p and q . Specifically, choosing to be one, we achieve quadratic local convergence rate under metric subregularity and the strong semismooth property. The algorithm is applied to a class of nonsmooth convex composite minimization problems through the machinery of forward–backward envelope. The greater flexibility in the choice of regularization matrices leads to notable improvement in practical performance. Numerical experiments on box-constrained quadratic programming problems demonstrate the efficiency of our algorithm.

Coderivative-Based Newton Methods with Wolfe Linesearch for Nonsmooth Optimization

The convergence of conjugate gradient method with nonmonotone line search

Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization

Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

Generalized Newton Method with Positive Definite Regularization for Nonsmooth Optimization Problems with Nonisolated Solutions

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

Extended Newton Methods for Multiobjective Optimization: Majorizing Function Technique and Convergence Analysis

A Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization.

A globally convergent proximal Newton-type method in nonsmooth convex optimization

Nonlinearly preconditioned semismooth Newton algorithms for nonlinear nonsmooth systems

Continuation Newton methods with deflation techniques for global optimization problems

A trust region-type normal map-based semismooth Newton method for nonsmooth nonconvex composite optimization

Inexact Proximal Cubic Regularized Newton Methods for Convex Optimization

A Modified Nonlinear Conjugate Gradient Algorithm for Large-Scale Nonsmooth Convex Optimization

iNALM: An inexact Newton Augmented Lagrangian Method for Zero-One Composite Optimization

A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization

A Line Search Multigrid Method for Large-Scale Nonlinear Optimization

On the local convergence of the semismooth Newton method for composite optimization

Newton Type Methods for Solving Nonsmooth Equations