Newton-Kantorovich-Vietoris method

Alexander Gasnikov

DOI: https://doi.org/10.48550/arXiv.1710.07200

2017-10-12

Functional Analysis

Abstract:In this short work we consider nonlinear equation in Banach space $x = A(x)$. We combine classical Newton method with Vietoris method to propose new more general method. Under rather general conditions about the noise we investigate local convergence of the method.

What problem does this paper attempt to address?

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

XH Wang

DOI: https://doi.org/10.1090/s0025-5718-99-00999-0

IF: 2.118

1999-01-01

Mathematics of Computation

Abstract:Under the hypothesis that the derivative satisfies some kind of weak Lipschitz condition, a proper condition which makes Newton's method converge, and an exact estimate for the radius of the ball of the inverse function theorem are given in a Banach space. Also, the relevant results on premises of Kantorovich and Smale types are improved in this paper.
A Quasi-Newton method for solving generalized equations by using a Kantorovich approach

V. S. Amaral,P. S. M. Santos,G. N. Silva,S. S. Souza

DOI: https://doi.org/10.1007/s40314-024-02608-7

2024-03-03

Computational and Applied Mathematics

Abstract:Inspired by the work of Dontchev (Lectures in Applied Mathematics, vol. 32, 1996) and Rokne (Numer. Math., 18, 401–412, 1971), we study the solvability of generalized equations in Banach spaces using a Kantorovich-like technique. In particular, we extend in part the results of Dontchev and Rokne, by assuming a kind of Hölder condition. Numerical examples are provided to justify the theoretical results.

mathematics, applied
Kantorovich's type theorems for systems of equations with constant rank derivatives

Nuchun Hu,Weiping Shen,Chong Li

DOI: https://doi.org/10.1016/j.cam.2007.07.006

IF: 2.872

2008-01-01

Journal of Computational and Applied Mathematics

Abstract:The famous Newton-Kantorovich hypothesis has been used for a long time as a sufficient condition for the convergence of Newton's method to a solution of an equation. Here we present a ''Kantorovich type'' convergence analysis for the Gauss-Newton's method which improves the result in [W.M. Hauszler, A Kantorovich-type convergence analysis for the Gauss-Newton-method, Numer. Math. 48 (1986) 119-125.] and extends the main theorem in [I.K. Argyros, On the Newton-Kantorovich hypothesis for solving equations, J. Comput. Appl. Math. 169 (2004) 315-332]. Furthermore, the radius of convergence ball is also obtained.
A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

Xinghua Wang,Chong Li,Ming-Jun Lai

DOI: https://doi.org/10.1023/A:1021986506085

IF: 1.856

2002-01-01

BIT Numerical Mathematics

Abstract:The paper is concerned with the convergence problem of Newton type methods for finding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators redefined by different Lipschitz conditions and an “universal constant” is introduced so that unified convergence determination of these methods is established for the defined families.
Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

Bechir Dali,Mohammed Guediri,Chong Li,Weiping Shen

2023-01-01

Journal of nonlinear and convex analysis

Abstract:In this paper, we study the convergence of Newton's method for solving the equation f (x) = 0 where f is a mapping from the two step nilpotent Lie group to its Lie algebra. By introducing the L average Lipschitz condition on Lie groups and using the majorizing function technique, a convergence criterion of Newton's method to find zeros of f is established. Some applications to special cases including the classical Lipschitz condition, ?-condition as well as analytic mappings are provided, and so the well-known Kantorovich theorem and the Smale a-theory are extended to the two step nilpotent Lie group. In particular, by developing the approximate singular point for f, the Smale point estimate theory is also extended to the two step nilpotent Lie group.
Newton-type Methods for Inverse Singular Value Problems with Multiple Singular Values

Wei-ping Shen,Chong Li,Xiao-qing Jin,Jen-chih Yao

DOI: https://doi.org/10.1016/j.apnum.2016.06.008

IF: 2.994

2016-01-01

Applied Numerical Mathematics

Abstract:We consider the convergence problem of some Newton-type methods for solving the inverse singular value problem with multiple and positive singular values. Under the nonsingularity assumption of the relative generalized Jacobian matrices at the solution c⁎, a convergence analysis for the multiple and positive case is provided and the superlinear or quadratical convergence properties are proved. Moreover, numerical experiments are given in the last section and comparisons are made.
Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Xiubin Xu,Chong Li

2007-01-01

Journal of Computational Mathematics

Abstract:The convergence properties of Newton's method for systems of equations with constant rank derivatives are studied under the hypothesis that the derivatives satisfy some weak Lipschitz conditions. The unified convergence results, which include Kantorovich type theorems and Smale's point estimate theorems as special cases, are obtained.
Kantorovich-Type Convergence Criterion for Inexact Newton Methods

Weiping Shen,Chong Li

DOI: https://doi.org/10.1016/j.apnum.2008.11.002

IF: 2.994

2009-01-01

Applied Numerical Mathematics

Abstract:Assuming that the first derivative of an operator satisfies the Lipschitz condition, a Kantorovich-type convergence criterion for inexact Newton methods is established, which includes the well-known Kantorovich's theorem as a special case. Comparisons and a numerical example are presented to illustrate that our results obtained in the present paper improve and extend some recent results in [X.P. Guo, On semilocal convergence of inexact Newton methods, J. Comput. Math. 25 (2007) 231–242; W.P. Shen, C. Li, Convergence criterion of inexact methods for operators with Hölder continuous derivatives, Taiwan. J. Math. 12 (2008) 1865–1882].
Newton method under weak Lipschitz continuous derivative in Banach spaces

Zhengda Huang

DOI: https://doi.org/10.1016/S0096-3003(02)00215-1

IF: 4.397

2003-01-01

Applied Mathematics and Computation

Abstract:In the present paper, a relax Kantorovich-type condition to guarantee the convergence of Newton method with order 2 in Banach space is obtained, which takes the well-known Kantorovich and Smale conditions as its special cases. The relations between the new condition and the old ones are also studied.
Extensions of the Newton-Kantorovich Theorem to Variational Inequality Problems

Zhengyu Wang

2009-01-01

Abstract:The Newton-Kantorovich theorem is extended to validate the convergence of the NewtonJosephy method for solving variational inequality problem. All the convergence conditions can be tested in digital computer. Moreover, the validation delivers automatically the existence domain of the solution and the error estimate. The ideas are illustrated by numerical results.
An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Xinghua Wang,Chong Li

2007-01-01

Abstract:The paper is concerned with the convergence problem of Newton's type methods for nding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators are de ned by di erent Lipschitz conditions and an \universal constant" is introduced so that an uni ed convergence determination of these methods is established for the de ned families.
Newton's Method for Sections on Riemannian Manifolds: Generalized Covariant Α-Theory

Chong Li,Jinhua Wang

DOI: https://doi.org/10.1016/j.jco.2007.12.003

IF: 1.333

2007-01-01

Journal of Complexity

Abstract:One kind of the L-average Lipschitz condition is introduced to covariant derivatives of sections on Riemannian manifolds. A convergence criterion of Newton's method and the radii of the uniqueness balls of the singular points for sections on Riemannian manifolds, which is independent of the curvatures, are established under the assumption that the covariant derivatives of the sections satisfy this kind of the L-average Lipschitz condition. Some applications to special cases including Kantorovich's condition and the γ-condition as well as Smale's α-theory are provided. In particular, the result due to Ferreira and Svaiter [Kantorovich's Theorem on Newton's method in Riemannian manifolds, J. Complexity 18 (2002) 304–329] is extended while the results due to Dedieu Priouret, Malajovich [Newton's method on Riemannian manifolds: covariant alpha theory, IMA J. Numer. Anal. 23 (2003) 395–419] are improved significantly. Moreover, the corresponding results due to Alvarez, Bolter, Munier [A unifying local convergence result for Newton's method in Riemannian manifolds, Found. Comput. Math. to appear] for vector fields and mappings on Riemannian manifolds are also extended.
Convergence of Newton'S Method and Uniqueness of the Solution of Equations in Banach Spaces Ii

Xing Hua Wang,Chong Li

DOI: https://doi.org/10.1007/s10114-002-0238-y

2003-01-01

Acta Mathematica Sinica English Series

Abstract:Some results on convergence of Newton's method in Banach spaces are established under the assumption that the derivative of the operators satisfies the radius or center Lipschitz condition with a weak L average.
On Nonlinear Coapproximation in Banach Spaces

Chong Li,Renxing Ni,G.A. Watson

DOI: https://doi.org/10.1023/A:1015588514891

2001-01-01

Approximation Theory and Its Applications

Abstract:The problem of nonlinear coapproximation in Banach spaces is considered, and characterization results and strong coapproximation results are presented.
Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

C Li,XH Wang

2000-01-01

Progress in Natural Science

Abstract:The local quadratic convergence of the Gauss-Newton method for convex composite optimizations is established for any convex function with a minima set. This work extends Burke and Ferris' results when this minima set is a set of weak sharp minima for the convex function.
A Bregman-Kaczmarz method for nonlinear systems of equations

Robert Gower,Dirk A. Lorenz,Maximilian Winkler

DOI: https://doi.org/10.1007/s10589-023-00541-9

2024-02-23

Abstract:We propose a new randomized method for solving systems of nonlinear equations, which can find sparse solutions or solutions under certain simple constraints. The scheme only takes gradients of component functions and uses Bregman projections onto the solution space of a Newton equation. In the special case of euclidean projections, the method is known as nonlinear Kaczmarz method. Furthermore, if the component functions are nonnegative, we are in the setting of optimization under the interpolation assumption and the method reduces to SGD with the recently proposed stochastic Polyak step size. For general Bregman projections, our method is a stochastic mirror descent with a novel adaptive step size. We prove that in the convex setting each iteration of our method results in a smaller Bregman distance to exact solutions as compared to the standard Polyak step. Our generalization to Bregman projections comes with the price that a convex one-dimensional optimization problem needs to be solved in each iteration. This can typically be done with globalized Newton iterations. Convergence is proved in two classical settings of nonlinearity: for convex nonnegative functions and locally for functions which fulfill the tangential cone condition. Finally, we show examples in which the proposed method outperforms similar methods with the same memory requirements.

Optimization and Control,Numerical Analysis
Projected Newton Method for noise constrained Tikhonov regularization

Jeffrey Cornelis,Nick Schenkels,Wim Vanroose

DOI: https://doi.org/10.1088/1361-6420/ab7d2b

2020-04-30

Abstract:Tikhonov regularization is a popular approach to obtain a meaningful solution for ill-conditioned linear least squares problems. A relatively simple way of choosing a good regularization parameter is given by Morozov's discrepancy principle. However, most approaches require the solution of the Tikhonov problem for many different values of the regularization parameter, which is computationally demanding for large scale problems. We propose a new and efficient algorithm which simultaneously solves the Tikhonov problem and finds the corresponding regularization parameter such that the discrepancy principle is satisfied. We achieve this by formulating the problem as a nonlinear system of equations and solving this system using a line search method. We obtain a good search direction by projecting the problem onto a low dimensional Krylov subspace and computing the Newton direction for the projected problem. This projected Newton direction, which is significantly less computationally expensive to calculate than the true Newton direction, is then combined with a backtracking line search to obtain a globally convergent algorithm, which we refer to as the Projected Newton method. We prove convergence of the algorithm and illustrate the improved performance over current state-of-the-art solvers with some numerical experiments.

Numerical Analysis
On the Approximate Solution of Weakly Nonlinear Boundary-Value Problems by the Newton–Kantorovich Method

A. A. Boichuk,S. M. Chuiko

DOI: https://doi.org/10.1007/s10958-022-05748-5

2022-02-01

Journal of Mathematical Sciences

Abstract:We establish necessary and sufficient conditions of solvability of the nonlinear boundary-value problem in the critical case. By using the Newton–Kantorovich method, we propose a new iterative scheme for the construction of solutions of the weakly nonlinear boundary-value problem for a system of ordinary differential equations in the critical case.
Generalized Inexact Newton Regularization for Nonlinear Ill-Posed Problems in Banach Spaces

Ruixue Gu,Hongsun Fu,Bo Han

DOI: https://doi.org/10.1088/1361-6420/ac601c

IF: 2.408

2022-01-01

Inverse Problems

Abstract:In this paper, we generalize inexact Newton regularization methods to solve nonlinear inverse problems from a reflexive Banach space to a Banach space. The image space is not necessarily reflexive so that the method can be used to deal with various types of noise such as the Gaussian noise and the impulsive noise. The method consists of an outer Newton iteration and an inner scheme which provides increments by applying the regularization technique to the local linearized equations. Under some assumptions, in particular, the reflexivity of the image space is not required, we present a novel convergence analysis of the inexact Newton regularization method with inner scheme defined by Landweber iteration. Furthermore, by employing a two-point gradient method as inner regularization scheme to accelerate the convergence, we propose an accelerated version of inexact Newton–Landweber method and present the detailed convergence analysis. The numerical simulations are provided to demonstrate the effectiveness of the proposed methods in handling different kinds of noise and the fast convergence of the accelerated method.
A superlinearly convergent Newton-like algorithm for variational inequality problems with inequality constraints

Liping Zhang,Yanlian Lai

DOI: https://doi.org/10.1007/s001860000052

2000-01-01

Mathematical Methods of Operations Research

Abstract:. In this paper, a Newton-like method for variational inequality problems is considered. One feature of the algorithm is that only the solution of linear systems of equations is required at each iteration and that the strict complementarity assumption is never invoked. Another is that under mild assumptions, the sequence produced by the Newton-like method Q-superlinearly converges to the solution of the VIP. Furthermore, a simpler version of this method is studied and it is shown that it is also superlinearly convergent.

Newton-Kantorovich-Vietoris method

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

A Quasi-Newton method for solving generalized equations by using a Kantorovich approach

Kantorovich's type theorems for systems of equations with constant rank derivatives

A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

Newton-type Methods for Inverse Singular Value Problems with Multiple Singular Values

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Kantorovich-Type Convergence Criterion for Inexact Newton Methods

Newton method under weak Lipschitz continuous derivative in Banach spaces

Extensions of the Newton-Kantorovich Theorem to Variational Inequality Problems

An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Newton's Method for Sections on Riemannian Manifolds: Generalized Covariant Α-Theory

Convergence of Newton'S Method and Uniqueness of the Solution of Equations in Banach Spaces Ii

On Nonlinear Coapproximation in Banach Spaces

Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

A Bregman-Kaczmarz method for nonlinear systems of equations

Projected Newton Method for noise constrained Tikhonov regularization

On the Approximate Solution of Weakly Nonlinear Boundary-Value Problems by the Newton–Kantorovich Method

Generalized Inexact Newton Regularization for Nonlinear Ill-Posed Problems in Banach Spaces

A superlinearly convergent Newton-like algorithm for variational inequality problems with inequality constraints