Two Conditions Concerning Newton'S Method

Min Wu

DOI: https://doi.org/10.1016/j.amc.2007.04.035

IF: 4.397

2007-01-01

Applied Mathematics and Computation

Abstract:In this note, we compare two conditions concerning Newton's method, and find out that even under some weaker condition one has the convergence of the Newton's method and a better error bound than the relative strong condition.

What problem does this paper attempt to address?

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

XH Wang

DOI: https://doi.org/10.1090/s0025-5718-99-00999-0

IF: 2.118

1999-01-01

Mathematics of Computation

Abstract:Under the hypothesis that the derivative satisfies some kind of weak Lipschitz condition, a proper condition which makes Newton's method converge, and an exact estimate for the radius of the ball of the inverse function theorem are given in a Banach space. Also, the relevant results on premises of Kantorovich and Smale types are improved in this paper.
A Convergence Theorem for the Newton-Like Methods under Some Kind of Weak Lipschitz Conditions

Min Wu

DOI: https://doi.org/10.1016/j.jmaa.2007.07.073

IF: 1.417

2008-01-01

Journal of Mathematical Analysis and Applications

Abstract:We provide sufficient conditions for the convergence of the Newton-like methods in the assumption that the derivative satisfies some kind of weak Lipschitz conditions. Consequently, some important convergence theorems follow from our main result in this paper.
Newton's Method for Underdetermined Systems of Equations under the Γ-Condition

Jin-Su He,Jin-Hua Wang,Chong Li

DOI: https://doi.org/10.1080/01630560701348509

2007-01-01

Numerical Functional Analysis and Optimization

Abstract:The convergence criterion of Newton's method for underdetermined system of equations under the gamma-condition is established and the radius of the convergence ball is obtained. Applications to analytic operator are provided and some results due to Shub and Smale (SIAM J. Numer. Anal. 1996, 33: 128 - 148) are extended and improved.
Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Xiubin Xu,Chong Li

DOI: https://doi.org/10.1016/j.jmaa.2008.04.009

IF: 1.417

2008-01-01

Journal of Mathematical Analysis and Applications

Abstract:The present paper is concerned with the convergence problem of Newton's method to solve singular systems of equations with constant rank derivatives. Under the hypothesis that the derivatives satisfy a type of weak Lipschitz condition, a convergence criterion based on the information around the initial point is established for Newton's method for singular systems of equations with constant rank derivatives. Applications to two special and important cases: the classical Lipschitz condition and the Smale's assumption, are provided; the latter, in particular, extends and improves the corresponding result due to Dedieu and Kim in [J.P. Dedieu, M. Kim, Newton's method for analytic systems of equations with constant rank derivatives, J. Complexity 18 (2002) 187–209].
Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Xiubin Xu,Chong Li

2007-01-01

Journal of Computational Mathematics

Abstract:The convergence properties of Newton's method for systems of equations with constant rank derivatives are studied under the hypothesis that the derivatives satisfy some weak Lipschitz conditions. The unified convergence results, which include Kantorovich type theorems and Smale's point estimate theorems as special cases, are obtained.
Newton-like method with some remarks

Xinyuan Wu

DOI: https://doi.org/10.1016/j.amc.2006.10.003

IF: 4.397

2007-01-01

Applied Mathematics and Computation

Abstract:This paper presents the new convergence analysis for the Newton-like method proposed by [Xinyuan Wu, A new continuation Newton-like method and its deformation, Appl. Math. Comput. 112 (2000) 75–78.] Compared with the original version of the convergence analysis, the restriction imposed on f″(x) is removed thoroughly. In order to guarantee the quadratic convergence of the Newton-like method, it is suffices to suppose that f′(x∗)≠0 and f′(x) is local Lipschitz near x∗, where x∗ is a solution of nonlinear equation f(x)=0. Moreover, some comments are given with examples for the Newton-like method, in comparison with Newton’s method. It can be concluded that the new algorithm is more feasible, effective than Newton’s method. In particularly, when it happens that, the derivative of the function f(x) at an iterate is singular or almost singular, the Newton-like method is vast superior to the classical Newton method. The numerical results of the paper strongly support the conclusion.
A New Semi-Local Convergence Theorem for the Inexact Newton Methods

Min Wu

DOI: https://doi.org/10.1016/j.amc.2007.10.057

IF: 4.397

2008-01-01

Applied Mathematics and Computation

Abstract:We present a new semi-local convergence theorem for the inexact Newton methods in the assumption that the derivative satisfies some kind of weak Lipschitz conditions. As special cases of our main result we re-obtain some well-known convergence theorems for Newton methods.
Newton method under weak Lipschitz continuous derivative in Banach spaces

Zhengda Huang

DOI: https://doi.org/10.1016/S0096-3003(02)00215-1

IF: 4.397

2003-01-01

Applied Mathematics and Computation

Abstract:In the present paper, a relax Kantorovich-type condition to guarantee the convergence of Newton method with order 2 in Banach space is obtained, which takes the well-known Kantorovich and Smale conditions as its special cases. The relations between the new condition and the old ones are also studied.
Note on the Improvement of Newton’s Method for System of Nonlinear Equations

Xinyuan Wu

DOI: https://doi.org/10.1016/j.amc.2006.12.035

IF: 4.397

2006-01-01

Applied Mathematics and Computation

Abstract:In this note, we are concerned with the further study for a significant improvement on Newton’s iterative method proposed by Wu [Xinyuan Wu, A new continuation Newton-like method and its deformation, Appl. Math. Comput. 112 (2000) 75–78]. We present a natural extension and development of the improvement on Newton’s method for system of nonlinear equation. The convergence is presented and the numerical results are given to show the efficiency of the extended method for system of nonlinear equations.
Convergence of Newton'S Method and Uniqueness of the Solution of Equations in Banach Spaces Ii

Xing Hua Wang,Chong Li

DOI: https://doi.org/10.1007/s10114-002-0238-y

2003-01-01

Acta Mathematica Sinica English Series

Abstract:Some results on convergence of Newton's method in Banach spaces are established under the assumption that the derivative of the operators satisfies the radius or center Lipschitz condition with a weak L average.
A semi-local convergence theorem for a robust revised Newton's method

Zhengyu Wang,Xinyuan Wu

DOI: https://doi.org/10.1016/j.camwa.2009.05.022

IF: 3.218

2009-01-01

Computers & Mathematics with Applications

Abstract:It is well known that Newton's iteration will abort due to the overflow if the derivative of the function at an iterate is singular or almost singular. In this paper, we study a robust revised Newton's method for solving nonlinear equations, which can be carried out with a starting point with a degenerate derivative at an iterative step. It is proved that the method is convergent under the conditions of the Newton-Kantorovich theorem, which implies a larger convergence domain of the method. We also show that our method inherits the fast convergence of Newton's method. Numerical experiments are performed to show the robustness of the proposed method in comparison with the standard Newton's method.
Local Convergence of Inexact Methods under the Hölder Condition

Chong Li,Weiping Shen

DOI: https://doi.org/10.1016/j.cam.2007.12.001

IF: 2.872

2008-01-01

Journal of Computational and Applied Mathematics

Abstract:We Study the convergence properties for some inexact Newton-like methods including the inexact Newton methods for solving nonlinear operator equations on Banach spaces. A new type of residual control is presented. Under the assumption that the derivative of the operator satisfies the Holder condition, the radius of convergence ball of the inexact Newton-like methods with the new type of residual control is estimated, and a linear and/or superlinear convergence property is proved, which extends the corresponding result of [B. Morini, Convergence behaviour of inexact Newton methods, Math. Comput. 68 (1999) 1605-1613]. As an application, we show that the inexact Newton-like method presented in [R.H. Chan, H.L. Chang, S.F. Xu, The inexact Newton-like method for inverse eigenvalue problem, BIT Numer. Math. 43 (2003) 7-20] for solving inverse eigenvalue problems can be regarded equivalently as one of the inexact Newton-like methods considered in this paper. A numerical example is provided to illustrate the convergence performance of the algorithm. (c) 2007 Elsevier B.V. All rights reserved.
On Newton's method under Hölder continuous derivative

Huang Zhengda

DOI: https://doi.org/10.1016/S0022-247X(02)00060-4

IF: 1.417

2002-01-01

Journal of Mathematical Analysis and Applications

Abstract:A Mysovskii-type theorem for Newton's method under (k,p)-Hölder continuous derivative is considered in this paper. For the application studied by others, the new condition is weaker than ones in the literature. Also we prove that the optimal convergent order is p+1 for 0<p<1.
Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

Chong Li,Nuchun Hu,Jinhua Wang

DOI: https://doi.org/10.1016/j.jco.2010.02.001

IF: 1.333

2010-01-01

Journal of Complexity

Abstract:The notions of Lipschitz conditions with L average are introduced to the study of convergence analysis of Gauss–Newton’s method for singular systems of equations. Unified convergence criteria ensuring the convergence of Gauss–Newton’s method for one kind of singular systems of equations with constant rank derivatives are established and unified estimates of radii of convergence balls are also obtained. Applications to some special cases such as the Kantorovich type conditions, γ-conditions and the Smale point estimate theory are provided and some important known results are extended and/or improved.
Kantorovich-Type Convergence Criterion for Inexact Newton Methods

Weiping Shen,Chong Li

DOI: https://doi.org/10.1016/j.apnum.2008.11.002

IF: 2.994

2009-01-01

Applied Numerical Mathematics

Abstract:Assuming that the first derivative of an operator satisfies the Lipschitz condition, a Kantorovich-type convergence criterion for inexact Newton methods is established, which includes the well-known Kantorovich's theorem as a special case. Comparisons and a numerical example are presented to illustrate that our results obtained in the present paper improve and extend some recent results in [X.P. Guo, On semilocal convergence of inexact Newton methods, J. Comput. Math. 25 (2007) 231–242; W.P. Shen, C. Li, Convergence criterion of inexact methods for operators with Hölder continuous derivatives, Taiwan. J. Math. 12 (2008) 1865–1882].
Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

Bechir Dali,Mohammed Guediri,Chong Li,Weiping Shen

2023-01-01

Journal of nonlinear and convex analysis

Abstract:In this paper, we study the convergence of Newton's method for solving the equation f (x) = 0 where f is a mapping from the two step nilpotent Lie group to its Lie algebra. By introducing the L average Lipschitz condition on Lie groups and using the majorizing function technique, a convergence criterion of Newton's method to find zeros of f is established. Some applications to special cases including the classical Lipschitz condition, ?-condition as well as analytic mappings are provided, and so the well-known Kantorovich theorem and the Smale a-theory are extended to the two step nilpotent Lie group. In particular, by developing the approximate singular point for f, the Smale point estimate theory is also extended to the two step nilpotent Lie group.
Smale's α-theory for inexact Newton methods under the γ-condition

Weiping Shen,Chong Li

DOI: https://doi.org/10.1016/j.jmaa.2010.01.056

IF: 1.417

2010-01-01

Journal of Mathematical Analysis and Applications

Abstract:The present paper is concerned with the convergence problem of inexact Newton methods. Assuming that the nonlinear operator satisfies the γ-condition, a convergence criterion for inexact Newton methods is established which includes Smale's type convergence criterion. The concept of an approximate zero for inexact Newton methods is proposed in this paper and the criterion for judging an initial point being an approximate zero is established. Consequently, Smale's α-theory is generalized to inexact Newton methods. Furthermore, a numerical example is presented to illustrate the applicability of our main results.
A Weak Condition for Secant Method to Solve Systems of Nonlinear Equations

Ke-wei Liang,Dan-fu Han,Hong Zhang,Cheng-yan Zhu

DOI: https://doi.org/10.1007/s11766-009-1975-9

2009-01-01

Abstract:In this paper, a new weak condition for the convergence of secant method to solve the systems of nonlinear equations is proposed. A convergence ball with the center x 0 is replaced by that with x 1, the first approximation generated by the secant method with the initial data x −1 and x 0. Under the bounded conditions of the divided difference, a convergence theorem is obtained and two examples to illustrate the weakness of convergence conditions are provided. Moreover, the secant method is applied to a system of nonlinear equations to demonstrate the viability and effectiveness of the results in the paper.
Newton's Method for Sections on Riemannian Manifolds: Generalized Covariant Α-Theory

Chong Li,Jinhua Wang

DOI: https://doi.org/10.1016/j.jco.2007.12.003

IF: 1.333

2007-01-01

Journal of Complexity

Abstract:One kind of the L-average Lipschitz condition is introduced to covariant derivatives of sections on Riemannian manifolds. A convergence criterion of Newton's method and the radii of the uniqueness balls of the singular points for sections on Riemannian manifolds, which is independent of the curvatures, are established under the assumption that the covariant derivatives of the sections satisfy this kind of the L-average Lipschitz condition. Some applications to special cases including Kantorovich's condition and the γ-condition as well as Smale's α-theory are provided. In particular, the result due to Ferreira and Svaiter [Kantorovich's Theorem on Newton's method in Riemannian manifolds, J. Complexity 18 (2002) 304–329] is extended while the results due to Dedieu Priouret, Malajovich [Newton's method on Riemannian manifolds: covariant alpha theory, IMA J. Numer. Anal. 23 (2003) 395–419] are improved significantly. Moreover, the corresponding results due to Alvarez, Bolter, Munier [A unifying local convergence result for Newton's method in Riemannian manifolds, Found. Comput. Math. to appear] for vector fields and mappings on Riemannian manifolds are also extended.
A Note on Inexact Condition for Cubic Regularized Newton's Method

Zhe Wang,Yi Zhou,Yingbin Liang,Guanghui Lan

DOI: https://doi.org/10.48550/arXiv.1808.07384

2018-08-22

Optimization and Control

Abstract:This note considers the inexact cubic-regularized Newton's method (CR), which has been shown in \cite{Cartis2011a} to achieve the same order-level convergence rate to a secondary stationary point as the exact CR \citep{Nesterov2006}. However, the inexactness condition in \cite{Cartis2011a} is not implementable due to its dependence on future iterates variable. This note fixes such an issue by proving the same convergence rate for nonconvex optimization under an inexact adaptive condition that depends on only the current iterate. Our proof controls the sufficient decrease of the function value over the total iterations rather than each iteration as used in the previous studies, which can be of independent interest in other contexts.

Two Conditions Concerning Newton'S Method

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

A Convergence Theorem for the Newton-Like Methods under Some Kind of Weak Lipschitz Conditions

Newton's Method for Underdetermined Systems of Equations under the Γ-Condition

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Newton-like method with some remarks

A New Semi-Local Convergence Theorem for the Inexact Newton Methods

Newton method under weak Lipschitz continuous derivative in Banach spaces

Note on the Improvement of Newton’s Method for System of Nonlinear Equations

Convergence of Newton'S Method and Uniqueness of the Solution of Equations in Banach Spaces Ii

A semi-local convergence theorem for a robust revised Newton's method

Local Convergence of Inexact Methods under the Hölder Condition

On Newton's method under Hölder continuous derivative

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

Kantorovich-Type Convergence Criterion for Inexact Newton Methods

Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

Smale's α-theory for inexact Newton methods under the γ-condition

A Weak Condition for Secant Method to Solve Systems of Nonlinear Equations

Newton's Method for Sections on Riemannian Manifolds: Generalized Covariant Α-Theory

A Note on Inexact Condition for Cubic Regularized Newton's Method