Abstract:We propose a coderivative-based generalized regularized Newton method with positive definite regularization term (GRNM-PD) to solve optimization problems. In GRNM-PD, a general positive definite symmetric matrix is used to regularize the generalized Hessian, in contrast to the recently proposed GRNM, which uses the identity matrix. Our approach features global convergence and fast local convergence rate even for problems with nonisolated solutions. To this end, we introduce the p -order semismooth property which plays the same role in our analysis as Lipschitz continuity of the Hessian does in the case. Imposing only the metric q -subregularity of the gradient at a solution, we establish global convergence of the proposed algorithm as well as its local convergence rate, which can be superlinear, quadratic, or even higher than quadratic, depending on an algorithmic parameter and the regularity parameters p and q . Specifically, choosing to be one, we achieve quadratic local convergence rate under metric subregularity and the strong semismooth property. The algorithm is applied to a class of nonsmooth convex composite minimization problems through the machinery of forward–backward envelope. The greater flexibility in the choice of regularization matrices leads to notable improvement in practical performance. Numerical experiments on box-constrained quadratic programming problems demonstrate the efficiency of our algorithm.

Covengence Analysis of a Generalized Levenberg-Marquardt Method for Possibly Non-Smooth Inverse Problems

Levenberg-Marquardt method with general convex penalty for nonlinear inverse problems

A Generalized Adaptive Levenberg–Marquardt Method for Solving Nonlinear Ill-Posed Problems

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

REGINN-IT Method with General Convex Penalty Terms for Nonlinear Inverse Problems

A Fast Two-Point Gradient Method for Solving Non-Smooth Nonlinear Ill-Posed Problems

Two-point Landweber-type Method with Convex Penalty Terms for Nonsmooth Nonlinear Inverse Problems

Analysis of a Generalized Regularized Gauss–Newton Method under Heuristic Rule in Banach Spaces

An Accelerated Kaczmarz Type Method for Nonlinear Inverse Problems in Banach Spaces with Uniformly Convex Penalty

A Proximal Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Riemannian Linearized Proximal Algorithms for Nonnegative Inverse Eigenvalue Problem.

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Error estimates for simplified Levenberg–Marquardt method for nonlinear ill-posed operator equations in Hilbert Spaces

Bouligand-Newton type methods for non-smooth ill-posed problems

Fast Subspace Optimization Method for Nonlinear Inverse Problems in Banach Spaces with Uniformly Convex Penalty Terms

An asymptotical regularization with convex constraints for inverse problems

Generalized Newton Method with Positive Definite Regularization for Nonsmooth Optimization Problems with Nonisolated Solutions

A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization

Convex and Non-convex Optimization Under Generalized Smoothness