Newton-type methods for inverse singular value problems with multiple singular values

ShenWei-ping,LiChong,JinXiao-qing,YaoJen-chih

IF: 2.994

2016-01-01

Applied Numerical Mathematics

Abstract:We consider the convergence problem of some Newton-type methods for solving the inverse singular value problem with multiple and positive singular values. Under the nonsingularity assumption of the...

What problem does this paper attempt to address?

Newton-type Methods for Inverse Singular Value Problems with Multiple Singular Values

Wei-ping Shen,Chong Li,Xiao-qing Jin,Jen-chih Yao

DOI: https://doi.org/10.1016/j.apnum.2016.06.008

IF: 2.994

2016-01-01

Applied Numerical Mathematics

Abstract:We consider the convergence problem of some Newton-type methods for solving the inverse singular value problem with multiple and positive singular values. Under the nonsingularity assumption of the relative generalized Jacobian matrices at the solution c⁎, a convergence analysis for the multiple and positive case is provided and the superlinear or quadratical convergence properties are proved. Moreover, numerical experiments are given in the last section and comparisons are made.
Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Jinhua Wang,Chong Li,Weiping Shen

DOI: https://doi.org/10.1088/1361-6420/aba2bd

IF: 2.408

2020-01-01

Inverse Problems

Abstract:We study the issue of numerically solving inverse singular value problems (ISVPs). Motivated by the Newton-type method introduced in [3] for solving ISVPs with distinct and positive singular values, we propose an extended Newton-type method working for ISVPs with multiple and/or zero singular values. Because of the absence of some important and crucial properties, the approach/technique used in the case of distinct and positive singular values no longer works for the case of multiple and/or zero singular values, and we develop a new approach/technique to treat the case of multiple and/or zero singular values. Under the standard nonsingularity assumption of the relative generalized Jacobian matrix at a solution, the quadratic convergence result is established for the extended Newton-type method, and numerical experiments are provided to illustrate the convergence performance of the extended method. Our extended method and convergence result in the present paper improve and extend significantly the corresponding ones in [1,3,25] for the special cases of distinct and positive singular values and/or of square matrices.
Convergence of the Newton-type methods for the square inverse singular value problems with multiple and zero singular values

Weiping Shen,Yaohua Hu,Chong Li,Jen-Chih Yao

DOI: https://doi.org/10.1016/j.apnum.2019.03.011

IF: 2.994

2019-01-01

Applied Numerical Mathematics

Abstract:In this paper, we study the convergence of the Newton-type methods for solving the square inverse singular value problem with possible multiple and zero singular values. Comparing with other known results, positivity assumption of the given singular values is removed. Under the nonsingularity assumption in terms of the (relative) generalized Jacobian matrices, quadratic/superlinear convergence properties (in the root-convergence sense) are proved. Moreover, numerical experiments are given to demonstrate our theoretic results.
An Inexact Newton-type Method for Inverse Singular Value Problems

Zheng-Jian Bai,Shufang Xu

DOI: https://doi.org/10.1016/j.laa.2008.03.008

IF: 1.307

2008-01-01

Linear Algebra and its Applications

Abstract:In this paper, an inexact Newton-type approach is proposed for solving inverse singular value problems. We show that the method converges superlinearly. This method can reduce significantly the oversolving problem of the Newton-type method and improve the efficiency. Numerical experiments is also presented to illustrate our results.
An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Jinhua Wang,Weiping Shen,Chong Li,Xiaoqing Jin

DOI: https://doi.org/10.1016/j.cam.2023.115261

IF: 2.872

2023-01-01

Journal of Computational and Applied Mathematics

Abstract:In this paper, we propose an extended Ulm-like method for solving the inverse singular value problem (ISVP for short) with multiple and/or zero singular values. Compared with the Ulm-like method, the proposed method reduces the amount of calculations and is well-defined even when multiple and/or zero singular values appear. Under the nonsingularity assumption for the relative generalized Jacobian at a solution and by using a new technique, a convergence analysis is provided and the quadratic convergence is proved. Our results in the present paper improve and extend significantly the corresponding ones of Vong et al. (2011) and Shen et al. (2018) for the ISVP with distinct and positive singular values and/or with square matrices. In particular, we solve the interesting problem raised in Vong et al. (2011): whether the Ulm-like method and its convergence result can be extended to the cases of multiple singular values and of zero singular values. Numerical results reveal that the extended Ulm-like method is an efficient algorithm for the ISVPs even when multiple and/or zero singular values appear.
Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

XH Wang

DOI: https://doi.org/10.1090/s0025-5718-99-00999-0

IF: 2.118

1999-01-01

Mathematics of Computation

Abstract:Under the hypothesis that the derivative satisfies some kind of weak Lipschitz condition, a proper condition which makes Newton's method converge, and an exact estimate for the radius of the ball of the inverse function theorem are given in a Banach space. Also, the relevant results on premises of Kantorovich and Smale types are improved in this paper.
An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

W. P. Shen,C. Li,X. Q. Jin

DOI: https://doi.org/10.1088/0266-5611/31/8/085007

IF: 2.408

2015-01-01

Inverse Problems

Abstract:We consider the convergence problem of an inexact Cayley transform method for solving inverse eigenvalue problems with multiple eigenvalues. Under the nonsingularity assumption of the relative generalized Jacobian matrix at the solution c * ?> , a convergence analysis covering both the distinct and multiple eigenvalues cases is provided and the superlinear convergence is proved. Moreover, numerical experiments are given in the last section and comparisons with the Cayley transform method are made.
Convergence of a Ulm-like Method for Square Inverse Singular Value Problems with Multiple and Zero Singular Values.

Weiping Shen,Yaohua Hu,Chong Li,Jen-Chih Yao

DOI: https://doi.org/10.1007/s11075-017-0442-6

IF: 2.37

2017-01-01

Numerical Algorithms

Abstract:An interesting problem was raised in Vong et al. (SIAM J. Matrix Anal. Appl. 32:412–429, 2011): whether the Ulm-like method and its convergence result can be extended to the cases of multiple and zero singular values. In this paper, we study the convergence of a Ulm-like method for solving the square inverse singular value problem with multiple and zero singular values. Under the nonsingularity assumption in terms of the relative generalized Jacobian matrices, a convergence analysis for the multiple and zero case is provided and the quadratical convergence property is proved. Moreover, numerical experiments are given in the last section to demonstrate our theoretic results.
Convergence Analysis of Newton-Like Methods for Inverse Eigenvalue Problems with Multiple Eigenvalues

Weiping Shen,Chong Li,Jen-Chih Yao

DOI: https://doi.org/10.1137/15m1049063

IF: 3.039

2016-01-01

SIAM Journal on Numerical Analysis

Abstract:We provide in the present paper a corrected proof for the classical quadratical convergence theorem (i.e., Theorem 3.3 in Friedland, Nocedal, and Overton [SIAM T. Numer. Anal., 24 (1987), pp. 634-667]) of the Newton-like method for solving inverse eigenvalue problems with possible multiple eigenvalues. Moreover, as a by-product, our approach developed here can be extended to establish a similar convergence result for an inexact version of the Newton-like method with possible multiple eigenvalues, which is an extension of the corresponding inexact Newton-like method for the distinct case in Chan, Chung, and Xu [BIT Numer. Math., 43 (2003), pp. 7-20].
An Ulm-like Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

Weiping Shen,Chong Li,Xiaoqing Jin

DOI: https://doi.org/10.4208/nmtma.2016.y15030

2016-01-01

Numerical Mathematics

Abstract:We study the convergence of an Ulm-like Cayley transform method for solving inverse eigenvalue problems which avoids solving approximate Jacobian equations. Under the nonsingularity assumption of the relative generalized Jacobian matrices at the solution, a convergence analysis covering both the distinct and multiple eigenvalues cases is provided and the quadratical convergence is proved. Moreover, numerical experiments are given in the last section to illustrate our results.
A SENSITIVITY ANALYSIS OF INVERSE SINGULAR VALUE PROBLEMS

Wei-Ping Shen,Sy-Ming Guu,Chong Li

2016-01-01

Journal of nonlinear and convex analysis

Abstract:We consider the sensitivity of the inverse singular value problems. Under the assumptions that the given singular values are distinct and the Jacobian matrix at the solution c* is nonsingular, a perturbation theorem is established where the existence of solutions to the perturbed problem is proved and the estimation is presented. Moreover, numerical experiments are given in the last section to illustrate our theoretical result.
Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Xiubin Xu,Chong Li

DOI: https://doi.org/10.1016/j.jmaa.2008.04.009

IF: 1.417

2008-01-01

Journal of Mathematical Analysis and Applications

Abstract:The present paper is concerned with the convergence problem of Newton's method to solve singular systems of equations with constant rank derivatives. Under the hypothesis that the derivatives satisfy a type of weak Lipschitz condition, a convergence criterion based on the information around the initial point is established for Newton's method for singular systems of equations with constant rank derivatives. Applications to two special and important cases: the classical Lipschitz condition and the Smale's assumption, are provided; the latter, in particular, extends and improves the corresponding result due to Dedieu and Kim in [J.P. Dedieu, M. Kim, Newton's method for analytic systems of equations with constant rank derivatives, J. Complexity 18 (2002) 187–209].
An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Xinghua Wang,Chong Li

2007-01-01

Abstract:The paper is concerned with the convergence problem of Newton's type methods for nding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators are de ned by di erent Lipschitz conditions and an \universal constant" is introduced so that an uni ed convergence determination of these methods is established for the de ned families.
On the Local Convergence of an Iterative Approach for Inverse Singular Value Problems

Zheng-Jian Bai,Benedetta Morini,Shu-fang Xu

DOI: https://doi.org/10.1016/j.cam.2005.06.050

IF: 2.872

2006-01-01

Journal of Computational and Applied Mathematics

Abstract:The purpose of this paper is to provide the convergence theory for the iterative approach given by M.T. Chu [Numerical methods for inverse singular value problems, SIAM J. Numer. Anal. 29 (1992), pp. 885–903] in the context of solving inverse singular value problems. We provide a detailed convergence analysis and show that the ultimate rate of convergence is quadratic in the root sense. Numerical results which confirm our theory are presented. It is still an open issue to prove that the method is Q-quadratic convergent as claimed by M.T. Chu.
Riemannian Linearized Proximal Algorithms for Nonnegative Inverse Eigenvalue Problem.

Sangho Kum,Chong Li,Jinhua Wang,Jen-Chih Yao,Linglingzhi Zhu

DOI: https://doi.org/10.1007/s11075-023-01556-3

IF: 2.37

2023-01-01

Numerical Algorithms

Abstract:We study the issue of numerically solving the nonnegative inverse eigenvalue problem (NIEP). At first, we reformulate the NIEP as a convex composite optimization problem on Riemannian manifolds. Then we develop a scheme of the Riemannian linearized proximal algorithm (R-LPA) to solve the NIEP. Under some mild conditions, the local and global convergence results of the R-LPA for the NIEP are established, respectively. Moreover, numerical experiments are presented. Compared with the Riemannian Newton-CG method in Z. Zhao et al. ( Numer. Math. 140:827–855, 2018 ), this R-LPA owns better numerical performances for large scale problems and sparse matrix cases, which is due to the smaller dimension of the Riemannian manifold derived from the problem formulation of the NIEP as a convex composite optimization problem.
A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

Xinghua Wang,Chong Li,Ming-Jun Lai

DOI: https://doi.org/10.1023/A:1021986506085

IF: 1.856

2002-01-01

BIT Numerical Mathematics

Abstract:The paper is concerned with the convergence problem of Newton type methods for finding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators redefined by different Lipschitz conditions and an “universal constant” is introduced so that unified convergence determination of these methods is established for the defined families.
A Ulm-like Method for Inverse Eigenvalue Problems

W. P. Shen,C. Li,X. Q. Jin

DOI: https://doi.org/10.1016/j.apnum.2010.11.001

IF: 2.994

2011-01-01

Applied Numerical Mathematics

Abstract:We propose a Ulm-like method for solving inverse eigenvalue problems, which avoids solving approximate Jacobian equations comparing with other known methods. A convergence analysis of this method is provided and the R-quadratic convergence property is proved under the assumption of the distinction of given eigenvalues. Numerical experiments as well as the comparison with the inexact Newton-like method are given in the last section.
Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

Bechir Dali,Mohammed Guediri,Chong Li,Weiping Shen

2023-01-01

Journal of nonlinear and convex analysis

Abstract:In this paper, we study the convergence of Newton's method for solving the equation f (x) = 0 where f is a mapping from the two step nilpotent Lie group to its Lie algebra. By introducing the L average Lipschitz condition on Lie groups and using the majorizing function technique, a convergence criterion of Newton's method to find zeros of f is established. Some applications to special cases including the classical Lipschitz condition, ?-condition as well as analytic mappings are provided, and so the well-known Kantorovich theorem and the Smale a-theory are extended to the two step nilpotent Lie group. In particular, by developing the approximate singular point for f, the Smale point estimate theory is also extended to the two step nilpotent Lie group.
A Globally Convergent Inexact Newton-Like Cayley Transform Method for Inverse Eigenvalue Problems

Yonghui Ling,Xiubin Xu

DOI: https://doi.org/10.48550/arXiv.1304.6209

2013-04-23

Numerical Analysis

Abstract:We propose a inexact Newton method for solving inverse eigenvalue problems (IEP). This method is globalized by employing the classical backtracking techniques. A global convergence analysis of this method is provided and the R-order convergence property is proved under some mild assumptions. Numerical examples demonstrate that the proposed method is very effective for solving the IEP with distinct eigenvalues.
Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

Chong Li,Nuchun Hu,Jinhua Wang

DOI: https://doi.org/10.1016/j.jco.2010.02.001

IF: 1.333

2010-01-01

Journal of Complexity

Abstract:The notions of Lipschitz conditions with L average are introduced to the study of convergence analysis of Gauss–Newton’s method for singular systems of equations. Unified convergence criteria ensuring the convergence of Gauss–Newton’s method for one kind of singular systems of equations with constant rank derivatives are established and unified estimates of radii of convergence balls are also obtained. Applications to some special cases such as the Kantorovich type conditions, γ-conditions and the Smale point estimate theory are provided and some important known results are extended and/or improved.

Newton-type methods for inverse singular value problems with multiple singular values

Newton-type Methods for Inverse Singular Value Problems with Multiple Singular Values

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Convergence of the Newton-type methods for the square inverse singular value problems with multiple and zero singular values

An Inexact Newton-type Method for Inverse Singular Value Problems

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Convergence of Newton'S Method and Inverse Function Theorem in Banach Space

An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

Convergence of a Ulm-like Method for Square Inverse Singular Value Problems with Multiple and Zero Singular Values.

Convergence Analysis of Newton-Like Methods for Inverse Eigenvalue Problems with Multiple Eigenvalues

An Ulm-like Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

A SENSITIVITY ANALYSIS OF INVERSE SINGULAR VALUE PROBLEMS

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

On the Local Convergence of an Iterative Approach for Inverse Singular Value Problems

Riemannian Linearized Proximal Algorithms for Nonnegative Inverse Eigenvalue Problem.

A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

A Ulm-like Method for Inverse Eigenvalue Problems

Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

A Globally Convergent Inexact Newton-Like Cayley Transform Method for Inverse Eigenvalue Problems

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.