Abstract:We propose a coderivative-based generalized regularized Newton method with positive definite regularization term (GRNM-PD) to solve optimization problems. In GRNM-PD, a general positive definite symmetric matrix is used to regularize the generalized Hessian, in contrast to the recently proposed GRNM, which uses the identity matrix. Our approach features global convergence and fast local convergence rate even for problems with nonisolated solutions. To this end, we introduce the p -order semismooth property which plays the same role in our analysis as Lipschitz continuity of the Hessian does in the case. Imposing only the metric q -subregularity of the gradient at a solution, we establish global convergence of the proposed algorithm as well as its local convergence rate, which can be superlinear, quadratic, or even higher than quadratic, depending on an algorithmic parameter and the regularity parameters p and q . Specifically, choosing to be one, we achieve quadratic local convergence rate under metric subregularity and the strong semismooth property. The algorithm is applied to a class of nonsmooth convex composite minimization problems through the machinery of forward–backward envelope. The greater flexibility in the choice of regularization matrices leads to notable improvement in practical performance. Numerical experiments on box-constrained quadratic programming problems demonstrate the efficiency of our algorithm.

Bouligand-Newton type methods for non-smooth ill-posed problems

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

Local Convergence of Inexact Methods under the Hölder Condition

Newton-type Methods for Inverse Singular Value Problems with Multiple Singular Values

On the order optimality of the regularization via inexact Newton iterations

Kantorovich-Type Convergence Criterion for Inexact Newton Methods

Stochastic Data-Driven Bouligand Landweber Method for Solving Non-smooth Inverse Problems

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

An asymptotical regularization with convex constraints for inverse problems

Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

A novel two-point Landweber-type method for Regularization of non-smooth inverse problems in Banach spaces

A Globalized Inexact Semismooth Newton Method for Nonsmooth Fixed-point Equations involving Variational Inequalities

A convergence analysis of the iteratively regularized Gauss-Newton method under Lipschitz condition

A quadratically convergent semismooth Newton method for nonlinear semidefinite programming without generalized Jacobian regularity

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

On inertial Levenberg-Marquardt type methods for solving nonlinear ill-posed operator equations

First Order Methods beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problems

An Inexact Newton-type Method for Inverse Singular Value Problems

A hybrid inexact regularized Newton and negative curvature method

A structured L-BFGS method and its application to inverse problems

Generalized Newton Method with Positive Definite Regularization for Nonsmooth Optimization Problems with Nonisolated Solutions