Abstract:For constrained equations with nonisolated solutions and a certain family of Newton-type methods, it was previously shown that if the equation mapping is 2-regular at a given solution with respect to a direction which is interior feasible and which is in the null space of the Jacobian, then there is an associated large (not asymptotically thin) domain of starting points from which the iterates are well defined and converge to the specific solution in question. Under these assumptions, the constrained local Lipschitzian error bound does not hold, unlike the common settings of convergence and rate of convergence analyses. In this work, we complement those previous results by considering the case when the equation mapping is 2-regular with respect to a direction in the null space of the Jacobian which is in the tangent cone to the set, but need not be interior feasible. Under some further conditions, we still show linear convergence of order 1/2 from a large domain around the solution (despite degeneracy, and despite that there may exist other solutions nearby). Our results apply to constrained variants of the Gauss–Newton and Levenberg–Marquardt methods, and to the LP-Newton method. An illustration for a smooth constrained reformulation of the nonlinear complementarity problem is also provided.

Analysis Local Convergence of Gauss-Newton Method

Convergence and Uniqueness Properties of Gauss-Newton's Method

The convergence of conjugate gradient method with nonmonotone line search

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

Convergence Analysis of the Gauss–Newton-Type Method for Lipschitz-Like Mappings

On Local Behavior of Newton-Type Methods Near Critical Solutions of Constrained Equations

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

Local Convergence of Inexact Methods under the Hölder Condition

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Majorizing Functions and Convergence of the Gauss-Newton Method for Convex Composite Optimization

Accelerated Newton-Gpss Methods for Systems of Nonlinear Equations

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

On the Local Convergence of a Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization

Local Convergence of Newton's Method on the Heisenberg Group.

Approximate Newton Methods and Their Local Convergence.

A Local Nearly Linearly Convergent First-Order Method for Nonsmooth Functions with Quadratic Growth

Convergence Analysis of an Adaptively Regularized Natural Gradient Method

Convergence Properties of Nonlinear Conjugate Gradient Methods.

A Modified Nonlinear Conjugate Gradient Algorithm for Large-Scale Nonsmooth Convex Optimization