Abstract:We propose a coderivative-based generalized regularized Newton method with positive definite regularization term (GRNM-PD) to solve optimization problems. In GRNM-PD, a general positive definite symmetric matrix is used to regularize the generalized Hessian, in contrast to the recently proposed GRNM, which uses the identity matrix. Our approach features global convergence and fast local convergence rate even for problems with nonisolated solutions. To this end, we introduce the p -order semismooth property which plays the same role in our analysis as Lipschitz continuity of the Hessian does in the case. Imposing only the metric q -subregularity of the gradient at a solution, we establish global convergence of the proposed algorithm as well as its local convergence rate, which can be superlinear, quadratic, or even higher than quadratic, depending on an algorithmic parameter and the regularity parameters p and q . Specifically, choosing to be one, we achieve quadratic local convergence rate under metric subregularity and the strong semismooth property. The algorithm is applied to a class of nonsmooth convex composite minimization problems through the machinery of forward–backward envelope. The greater flexibility in the choice of regularization matrices leads to notable improvement in practical performance. Numerical experiments on box-constrained quadratic programming problems demonstrate the efficiency of our algorithm.

An effective inertial-relaxed CGPM for nonlinear monotone equations

The convergence of conjugate gradient method with nonmonotone line search

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

An efficient inertial subspace minimization CG algorithm with convergence rate analysis for constrained nonlinear monotone equations

An inertial hybrid DFPM-based algorithm for constrained nonlinear equations with applications

Generalized Newton Method with Positive Definite Regularization for Nonsmooth Optimization Problems with Nonisolated Solutions

An Inertial-type CG Projection Method with Restart for Pseudo-monotone Costs with Application to Traffic Assignment

An inertia projection method for nonlinear pseudo-monotone equations with convex constraints

An Improved Inertial Projection Method for Solving Convex Constrained Monotone Nonlinear Equations with Applications

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

An Efficient Three-Term Conjugate Gradient Method for Nonlinear Monotone Equations with Convex Constraints

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A Projection Method for Solving Monotone Nonlinear Equations with Application

A Generalized Adaptive Levenberg–Marquardt Method for Solving Nonlinear Ill-Posed Problems

An Adaptive Family of Projection Methods for Constrained Monotone Nonlinear Equations with Applications

A Gauss–Seidel Type Inertial Proximal Alternating Linearized Minimization for a Class of Nonconvex Optimization Problems

A Modified Perry's Conjugate Gradient Method-Based Derivative-Free Method for Solving Large-Scale Nonlinear Monotone Equations

Accelerated inertial subgradient extragradient algorithms with non-monotonic step sizes for equilibrium problems and fixed point problems

A modified inertial three-term conjugate gradient method for nonsmooth convex optimization and its application

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations