The Modified Newton Method in Banach Spaces and its Convergence

Jiang Qingsong,Wang Wei,Zhang Lixin

DOI: https://doi.org/10.3969/j.issn.1009-0568.2009.01.012

2009-01-01

Abstract:A modified Newton mehod in Banach spaces and its property of convergence are given,which have perspective use.

What problem does this paper attempt to address?

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

XH Wang

DOI: https://doi.org/10.1090/s0025-5718-99-00999-0

IF: 2.118

1999-01-01

Mathematics of Computation

Abstract:Under the hypothesis that the derivative satisfies some kind of weak Lipschitz condition, a proper condition which makes Newton's method converge, and an exact estimate for the radius of the ball of the inverse function theorem are given in a Banach space. Also, the relevant results on premises of Kantorovich and Smale types are improved in this paper.
A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

Xinghua Wang,Chong Li,Ming-Jun Lai

DOI: https://doi.org/10.1023/A:1021986506085

IF: 1.856

2002-01-01

BIT Numerical Mathematics

Abstract:The paper is concerned with the convergence problem of Newton type methods for finding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators redefined by different Lipschitz conditions and an “universal constant” is introduced so that unified convergence determination of these methods is established for the defined families.
An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Xinghua Wang,Chong Li

2007-01-01

Abstract:The paper is concerned with the convergence problem of Newton's type methods for nding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators are de ned by di erent Lipschitz conditions and an \universal constant" is introduced so that an uni ed convergence determination of these methods is established for the de ned families.
Convergence of Newton'S Method and Uniqueness of the Solution of Equations in Banach Spaces Ii

Xing Hua Wang,Chong Li

DOI: https://doi.org/10.1007/s10114-002-0238-y

2003-01-01

Acta Mathematica Sinica English Series

Abstract:Some results on convergence of Newton's method in Banach spaces are established under the assumption that the derivative of the operators satisfies the radius or center Lipschitz condition with a weak L average.
Subspace Truncated-Newton Algorithm for Large-Scale Bound Constrained Optimization

梁昔明,钱积新

DOI: https://doi.org/10.3321/j.issn:1008-9497.2002.05.004

2002-01-01

Abstract:A subspace truncated-Newton algorithm for large-scale bound constrained optimization is proposed. The algorithm uses truncated-Newton method to update the variables with indices outside of the active set while the active variables are updated by the projected gradient method. The global convergence of the method is proved and the numerical comparisons with the performance of subspace limited memory quasi-Newton algorithm on a set of large-scale problems are also made.
Local Convergence of Inexact Methods under the Hölder Condition

Chong Li,Weiping Shen

DOI: https://doi.org/10.1016/j.cam.2007.12.001

IF: 2.872

2008-01-01

Journal of Computational and Applied Mathematics

Abstract:We Study the convergence properties for some inexact Newton-like methods including the inexact Newton methods for solving nonlinear operator equations on Banach spaces. A new type of residual control is presented. Under the assumption that the derivative of the operator satisfies the Holder condition, the radius of convergence ball of the inexact Newton-like methods with the new type of residual control is estimated, and a linear and/or superlinear convergence property is proved, which extends the corresponding result of [B. Morini, Convergence behaviour of inexact Newton methods, Math. Comput. 68 (1999) 1605-1613]. As an application, we show that the inexact Newton-like method presented in [R.H. Chan, H.L. Chang, S.F. Xu, The inexact Newton-like method for inverse eigenvalue problem, BIT Numer. Math. 43 (2003) 7-20] for solving inverse eigenvalue problems can be regarded equivalently as one of the inexact Newton-like methods considered in this paper. A numerical example is provided to illustrate the convergence performance of the algorithm. (c) 2007 Elsevier B.V. All rights reserved.
ON THE CONVERGENCE OF A MODIFIED CHEBYSHEV-LIKE'S METHOD FOR SOLVING NONLINEAR EQUATIONS

Lin Zheng,Ke Zhang,Liang Chen

DOI: https://doi.org/10.11650/tjm.19.2015.3856

2015-01-01

Taiwanese Journal of Mathematics

Abstract:In this paper, we introduce a modified Chebyshev-like's method with order four and study the semilocal convergence of the method by using majorizing functions for solving nonlinear equations in Banach spaces. We prove an existence-uniqueness theorem and give a priori error bounds which demonstrates the R-order of the method. Moveover, the local convergence of this method is also analyzed. Finally, numerical application on nonlinear integral equations is given to show our approach.
Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

Chong Li,Nuchun Hu,Jinhua Wang

DOI: https://doi.org/10.1016/j.jco.2010.02.001

IF: 1.333

2010-01-01

Journal of Complexity

Abstract:The notions of Lipschitz conditions with L average are introduced to the study of convergence analysis of Gauss–Newton’s method for singular systems of equations. Unified convergence criteria ensuring the convergence of Gauss–Newton’s method for one kind of singular systems of equations with constant rank derivatives are established and unified estimates of radii of convergence balls are also obtained. Applications to some special cases such as the Kantorovich type conditions, γ-conditions and the Smale point estimate theory are provided and some important known results are extended and/or improved.
Majorizing Functions and Convergence of the Gauss-Newton Method for Convex Composite Optimization

Chong Li,K. F. Ng

DOI: https://doi.org/10.1137/06065622x

IF: 2.763

2007-01-01

SIAM Journal on Optimization

Abstract:We introduce a notion of quasi regularity for points with respect to the inclusion F( x). C, where F is a nonlinear Frechet differentiable function from R-v to R-m. When C is the set of minimum points of a convex real- valued function h on Rm and F ' satisfies the L- average Lipschitz condition of Wang, we use the majorizing function technique to establish the semilocal linear/ quadratic convergence of sequences generated by the Gauss - Newton method ( with quasiregular initial points) for the convex composite function h. F. Results are new even when the initial point is regular and F ' is Lipschitz.
Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Xiubin Xu,Chong Li

2007-01-01

Journal of Computational Mathematics

Abstract:The convergence properties of Newton's method for systems of equations with constant rank derivatives are studied under the hypothesis that the derivatives satisfy some weak Lipschitz conditions. The unified convergence results, which include Kantorovich type theorems and Smale's point estimate theorems as special cases, are obtained.
Modified Conjugate Gradient Method with Global Convergence Property

Lihua Jiang

2005-01-01

Abstract:Conjugate gradient method is an efficient method in solving problems with unconstrained optimization , which is especially efficient in dealing large dimension. In light of the conjugate character of conjugate gradient method and the fact that the strength or weakness of an algorithm is more or less determined by the step size and the search direction of the algorithm, a modified conjugate gradient method is proposed in this paper. Some important lemmas and global convergence theorem for the new method are given and proved as follows. The numerical results suggest that the method is convergent and efficient in resolving the given test problems.
Extended Newton Methods for Multiobjective Optimization: Majorizing Function Technique and Convergence Analysis

Jinhua Wang,Yaohua Hu,Carisa Kwok Wai Yu,Chong Li,Xiaoqi Yang

DOI: https://doi.org/10.1137/18m1191737

IF: 2.763

2019-01-01

SIAM Journal on Optimization

Abstract:We consider the extended Newton method for approaching a Pareto optimum of a multiobjective optimization problem, establish quadratic convergence criteria, and estimate a radius of convergence ball under the assumption that the Hessians of objective functions satisfy an L-average Lipschitz condition. These convergence theorems significantly improve the corresponding ones in [J. Fliege, L. M. G. Drummond, and B. F. Svaiter, SIAM J. Optim., 20 (2009), pp. 602-626]. As applications of the obtained results, convergence theorems under the classical Lipschitz condition or the gamma-condition are presented for multiobjective optimization, and the global quadratic convergence results of the extended Newton method with Armijo/Goldstein/Wolfe line-search schemes are also provided.
On a Modified Numerov's Method for Inverse Sturm-Liouville Problems

Qin Gao,Quanting Zhao,Minhong Chen

DOI: https://doi.org/10.1080/00207160.2017.1290435

2017-01-01

Abstract:In this paper, we discuss the convergence of modified Numerov's method in Q. Gao, X.L. Cheng and Z.D. Huang [Modified Numerov's method for inverse Sturm-Liouville problems, J. Comput. Appl. Math. 253 (2013), pp. 181-199] for computing symmetric potentials from finite Dirichlet eigenvalues. A sufficient condition for convergence of the estimate to the true potential is given and the rate of convergence is investigated. The proof relies on the asymptotics of eigenvalues of the Sturm-Liouville operator and the errors in the finite difference eigenvalues obtained by Numerov's approach. Some numerical experiments are presented to confirm the theoretically predicted convergence properties.
Convergence of the Newton Method and Uniqueness of Zeros of Vector Fields on Riemannian Manifolds

Chong Li,Jinhua Wang

DOI: https://doi.org/10.1360/04ys0147

2005-01-01

Science in China Series A Mathematics

Abstract:The estimates of the radii of convergence balls of the Newton method and uniqueness balls of zeroes of vector fields on the Riemannian manifolds are given under the assumption that the covariant derivatives of the vector fields satisfy some kind of general Lipschitz conditions. Some classical results such as the Kantorovich’s type theorem and the Smale’s ?-theory are extended.
Convergence and Uniqueness Properties of Gauss-Newton's Method

C Li,WH Zhang,XQ Jin

DOI: https://doi.org/10.1016/s0898-1221(04)90086-7

IF: 3.218

2004-01-01

Computers & Mathematics with Applications

Abstract:The generalized radius and center Lipschitz conditions with L average are introduced to investigate the convergence of Gauss-Newton's method for finding the nonlinear least squares solution of nonlinear equations. The radii of the convergence ball of Gauss-Newton's method and the uniqueness ball of the solution are estimated. Some applications are given.
A Modified HS Conjugate Gradient Method and Its Global Convergence

ZHANG Yuan-yuan,ZHANG Jun-rong,XIE Bing-lei

DOI: https://doi.org/10.3969/j.issn.1000-5471.2012.08.011

2012-01-01

Abstract:A modification has been made to HS conjugate gradient method;the sufficient descent property of search direction is guaranteed,which has also been established under the condition of inexact line search condition and assumption that the objective function is nonconvex;under mild conditions,the global convergence property has been proved with the strong Wolfe line search;the numerical testing shows that the numerical effect of algorithm is well.
Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Xiubin Xu,Chong Li

DOI: https://doi.org/10.1016/j.jmaa.2008.04.009

IF: 1.417

2008-01-01

Journal of Mathematical Analysis and Applications

Abstract:The present paper is concerned with the convergence problem of Newton's method to solve singular systems of equations with constant rank derivatives. Under the hypothesis that the derivatives satisfy a type of weak Lipschitz condition, a convergence criterion based on the information around the initial point is established for Newton's method for singular systems of equations with constant rank derivatives. Applications to two special and important cases: the classical Lipschitz condition and the Smale's assumption, are provided; the latter, in particular, extends and improves the corresponding result due to Dedieu and Kim in [J.P. Dedieu, M. Kim, Newton's method for analytic systems of equations with constant rank derivatives, J. Complexity 18 (2002) 187–209].
Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

Bechir Dali,Mohammed Guediri,Chong Li,Weiping Shen

2023-01-01

Journal of nonlinear and convex analysis

Abstract:In this paper, we study the convergence of Newton's method for solving the equation f (x) = 0 where f is a mapping from the two step nilpotent Lie group to its Lie algebra. By introducing the L average Lipschitz condition on Lie groups and using the majorizing function technique, a convergence criterion of Newton's method to find zeros of f is established. Some applications to special cases including the classical Lipschitz condition, ?-condition as well as analytic mappings are provided, and so the well-known Kantorovich theorem and the Smale a-theory are extended to the two step nilpotent Lie group. In particular, by developing the approximate singular point for f, the Smale point estimate theory is also extended to the two step nilpotent Lie group.
Convergence Analysis of Newton-Like Methods for Inverse Eigenvalue Problems with Multiple Eigenvalues

Weiping Shen,Chong Li,Jen-Chih Yao

DOI: https://doi.org/10.1137/15m1049063

IF: 3.039

2016-01-01

SIAM Journal on Numerical Analysis

Abstract:We provide in the present paper a corrected proof for the classical quadratical convergence theorem (i.e., Theorem 3.3 in Friedland, Nocedal, and Overton [SIAM T. Numer. Anal., 24 (1987), pp. 634-667]) of the Newton-like method for solving inverse eigenvalue problems with possible multiple eigenvalues. Moreover, as a by-product, our approach developed here can be extended to establish a similar convergence result for an inexact version of the Newton-like method with possible multiple eigenvalues, which is an extension of the corresponding inexact Newton-like method for the distinct case in Chan, Chung, and Xu [BIT Numer. Math., 43 (2003), pp. 7-20].
Modified projection method and strong convergence theorem for solving variational inequality problems with non-Lipschitz operators

Xie, Zhongbing,Wu, Huanqin

DOI: https://doi.org/10.1007/s11075-024-01851-7

IF: 2.37

2024-06-01

Numerical Algorithms

Abstract:In this paper, we introduce a modified projection method and give a strong convergence theorem for solving variational inequality problems in real Hilbert spaces. Under mild assumptions, there exists a novel line-search rule that makes the proposed algorithm suitable for non-Lipschitz continuous and pseudo-monotone operators. Compared with other known algorithms in numerical experiments, it is shown that our algorithm has better numerical performance.

mathematics, applied

The Modified Newton Method in Banach Spaces and its Convergence

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Convergence of Newton'S Method and Uniqueness of the Solution of Equations in Banach Spaces Ii

Subspace Truncated-Newton Algorithm for Large-Scale Bound Constrained Optimization

Local Convergence of Inexact Methods under the Hölder Condition

ON THE CONVERGENCE OF A MODIFIED CHEBYSHEV-LIKE'S METHOD FOR SOLVING NONLINEAR EQUATIONS

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

Majorizing Functions and Convergence of the Gauss-Newton Method for Convex Composite Optimization

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Modified Conjugate Gradient Method with Global Convergence Property

Extended Newton Methods for Multiobjective Optimization: Majorizing Function Technique and Convergence Analysis

On a Modified Numerov's Method for Inverse Sturm-Liouville Problems

Convergence of the Newton Method and Uniqueness of Zeros of Vector Fields on Riemannian Manifolds

Convergence and Uniqueness Properties of Gauss-Newton's Method

A Modified HS Conjugate Gradient Method and Its Global Convergence

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

Convergence Analysis of Newton-Like Methods for Inverse Eigenvalue Problems with Multiple Eigenvalues

Modified projection method and strong convergence theorem for solving variational inequality problems with non-Lipschitz operators