Abstract:We propose a coderivative-based generalized regularized Newton method with positive definite regularization term (GRNM-PD) to solve optimization problems. In GRNM-PD, a general positive definite symmetric matrix is used to regularize the generalized Hessian, in contrast to the recently proposed GRNM, which uses the identity matrix. Our approach features global convergence and fast local convergence rate even for problems with nonisolated solutions. To this end, we introduce the p -order semismooth property which plays the same role in our analysis as Lipschitz continuity of the Hessian does in the case. Imposing only the metric q -subregularity of the gradient at a solution, we establish global convergence of the proposed algorithm as well as its local convergence rate, which can be superlinear, quadratic, or even higher than quadratic, depending on an algorithmic parameter and the regularity parameters p and q . Specifically, choosing to be one, we achieve quadratic local convergence rate under metric subregularity and the strong semismooth property. The algorithm is applied to a class of nonsmooth convex composite minimization problems through the machinery of forward–backward envelope. The greater flexibility in the choice of regularization matrices leads to notable improvement in practical performance. Numerical experiments on box-constrained quadratic programming problems demonstrate the efficiency of our algorithm.

Analysis of a Heuristic Rule for the IRGNM in Banach Spaces with Convex Regularization Terms

Analysis of a Generalized Regularized Gauss–Newton Method under Heuristic Rule in Banach Spaces

Hanke-Raus heuristic rule for iteratively regularized stochastic gradient descent

Heuristic Rule for Inexact Newton-Landweber Iteration with Convex Penalty Terms of Nonlinear: Ill-Posed Problems

Convergence and adaptive discretization of the IRGNM Tikhonov and the IRGNM Ivanov method under a tangential cone condition in Banach space

REGINN-IT Method with General Convex Penalty Terms for Nonlinear Inverse Problems

Generalized Inexact Newton Regularization for Nonlinear Ill-Posed Problems in Banach Spaces

A convergence analysis of the iteratively regularized Gauss-Newton method under Lipschitz condition

A Proximal Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems

Heuristic parameter-choice rules for convex variational regularization based on error estimates

Inexact Newton Regularization in Banach Spaces Based on Two-Point Gradient Method with Uniformly Convex Penalty Terms

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Generalized Newton Method with Positive Definite Regularization for Nonsmooth Optimization Problems with Nonisolated Solutions

On a Dynamic Variant of the Iteratively Regularized Gauss-Newton Method with Sequential Data.

A Stochastic Iteratively Regularized Gauss-Newton Method

A Fast Data-Driven Iteratively Regularized Method with Convex Penalty for Solving Ill-Posed Problems

On the Convergence of A Data-Driven Regularized Stochastic Gradient Descent for Nonlinear Ill-Posed Problems

A hybrid inexact regularized Newton and negative curvature method

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Regularization of linear inverse problems with irregular noise using embedding operators

Stochastic Gradient Descent Method with Convex Penalty for Ill-Posed Problems in Banach Spaces