Perturbation bounds for constrained and weighted least squares problems

M. Gulliksson,Xiao-Qing Jin,Yi-Min Wei

DOI: https://doi.org/10.1016/S0024-3795(02)00262-8

IF: 1.307

2002-01-01

Linear Algebra and its Applications

Abstract:We derive perturbation bounds for the constrained and weighted linear least squares (LS) problems. Both the full rank and rank-deficient cases are considered. The analysis generalizes some results of earlier works.

What problem does this paper attempt to address?

Perturbation Identities for Regularized Tikhonov Inverses and Weighted Pseudoinverses

M. E. Gulliksson,P.-Å. Wedin,Yimin Wei

DOI: https://doi.org/10.1023/A:1022319830134

IF: 1.856

2000-01-01

BIT Numerical Mathematics

Abstract:We consider the perturbation analysis of two important problems for solving ill-conditioned or rank-deficient linear least squares problems. The Tikhonov regularized problem is a linear least squares problem with a regularization term balancing the size of the residual against the size of the weighted solution. The weight matrix can be a non-square matrix (usually with fewer rows than columns). The minimum-norm problem is the minimization of the size of the weighted solutions given by the set of solutions to the, possibly rank-deficient, linear least squares problem. It is well known that the solution of the Tikhonov problem tends to the minimum-norm solution as the regularization parameter of the Tikhonov problem tends to zero. Using this fact and the generalized singular value decomposition enable us to make a perturbation analysis of the minimum-norm problem with perturbation results for the Tikhonov problem. From the analysis we attain perturbation identities for Tikhonov inverses and weighted pseudoinverses.
A contribution to perturbation analysis for total least squares problems

Pengpeng Xie,Hua Xiang,Yimin Wei

DOI: https://doi.org/10.1007/s11075-017-0285-1

IF: 2.37

2017-01-01

Numerical Algorithms

Abstract:In this note, we present perturbation analysis for the total least squares (Tls) problems under the genericity condition. We review the three condition numbers proposed respectively by Zhou et al. (Numer. Algorithm, 51 (2009), pp. 381–399), Baboulin and Gratton (SIAM J. Matrix Anal. Appl. 32 (2011), pp. 685–699), Li and Jia (Linear Algebra Appl. 435 (2011), pp. 674–686). We also derive new perturbation bounds.
Perturbation Analysis and Randomized Algorithms for Large-Scale Total Least Squares Problems

Pengpeng Xie,Yimin Wei,Hua Xiang

DOI: https://doi.org/10.48550/arxiv.1401.6832

2014-01-01

Abstract:In this paper, we present perturbation analysis and randomized algorithms for the total least squares (TLS) problems. We derive the perturbation bound and check its sharpness by numerical experiments. Motivated by the recently popular probabilistic algorithms for low-rank approximations, we develop randomized algorithms for the TLS and the truncated total least squares (TTLS) solutions of large-scale discrete ill-posed problems, which can greatly reduce the computational time and still keep good accuracy.
Relative Errors Versus Residuals of Approximate Solutions of Weighted Least Squares Problems in Hilbert Space

J Ding,YM Wei

DOI: https://doi.org/10.1016/s0898-1221(02)00158-x

IF: 3.218

2002-01-01

Computers & Mathematics with Applications

Abstract:We give some lower and upper bounds in terms of residuals for the perturbation of general consistent systems of linear operator equations and weighted least squares problems in Hilbert space.
Condition Numbers and Perturbation of the Weighted Moore-Penrose Inverse and Weighted Linear Least Squares Problem.

YM Wei,DK Wang

DOI: https://doi.org/10.1016/s0096-3003(02)00437-x

IF: 4.397

2003-01-01

Applied Mathematics and Computation

Abstract:It is well known that the normwise relative condition numbers measure the sensitivity of matrix inversion and the solution of nonsingular linear systems. Here, we consider the condition number formulas for the weighted Moore–Penrose inverse of a rectangular matrix and give explicit expressions for the weighted condition numbers of the singular linear systems Ax=b. These explicit expressions extend the earlier work of several authors. As we know, the computed weighted least squares solution x of minx∥Ax−b∥M, in the presence of the round-off error, satisfies the perturbed equation miny∥(A+E)y−(b+f)∥M. Finally, an upper bound of ∥y−x∥N is derived for the case where the weighted matrix and vector norms and the assumption rank(A+E)=rank(A) are used.
Quantitative Analysis for Perturbed Abstract Inequality Systems in Banach Spaces

Chong Li,K. F. Ng

DOI: https://doi.org/10.1137/17m1151274

IF: 2.763

2018-01-01

SIAM Journal on Optimization

Abstract:Using the error bound results established in the present paper for approximate solutions, we study the stability issues when perturbed by possibly nonaffine smooth maps E for the abstract inequality system F >=(K) 0 defined by a (possible nonclosed) convex cone K and a Frechet differentiable function F satisfying the (extended) weak gamma-condition. We provide some sufficient conditions, in terms of the information at a solution x(0), for ensuring the lower semicontinuity and/or the Lipschitz-like continuity at x(0) of the solution mapping for the perturbed system F + E >=(K) 0 with smooth perturbation E. Explicit upper bounds of the Lipschitz-like moduli are also provided.
A Note on the Perturbation of the W-weighted Drazin Inverse

YM Wei,CW Woo,TG Lei

DOI: https://doi.org/10.1016/s0096-3003(03)00150-4

IF: 4.397

2004-01-01

Applied Mathematics and Computation

Abstract:The perturbation bound is presented for the W-weighted Drazin inverse for a rectangular matrix under the weaker condition. The application to the singular linear equations is also given in this note.
A Note on the Sensitivity of the Solution of the Weighted Linear Least Squares Problem

J Ji,YM Wei

DOI: https://doi.org/10.1016/s0096-3003(02)00502-7

IF: 4.397

2003-01-01

Applied Mathematics and Computation

Abstract:The purpose of this note is to extend the results by Joab Winkler [Proc. of the fifth SIAM conference on Applied Linear Algebra, SIAM Philadelphia, 1994, pp. 279] and Jun Ji and Andreas Lazari [Georgia J. Sci. 56 (1998) 99] concerning the sensitivity of the system of linear equations and linear least squares problem, respectively. A sharp upper bound in the worst case for the sensitivity of the M-least squares solution of minimal N-norm is derived.
Perturbation Bounds For The Generalized Inverses At,S-(2) With Application To Constrained Linear System

Nm Zhang,Ym Wei

DOI: https://doi.org/10.1016/S0096-3003(02)00284-9

IF: 4.397

2003-01-01

Applied Mathematics and Computation

Abstract:In this paper, the more general perturbation problem of the generalized inverse A(T,S)((2)) is considered. We derive its perturbation bounds when the subspaces T and S also have perturbation. And in special case, when T and S have no perturbation, we get some results on the condition numbers with respect to A(T,S)((2)) and constrained linear system Ax=b, x is an element of T which are similar to the regular inverse A(-1) and nonsingular linear system Ax=b. (C) 2002 Elsevier Science Inc. All rights reserved.
A Schatten-$q$ Low-rank Matrix Perturbation Analysis via Perturbation Projection Error Bound

Yuetian Luo,Rungang Han,Anru R. Zhang

DOI: https://doi.org/10.48550/arXiv.2008.01312

2021-08-13

Abstract:This paper studies the Schatten-$q$ error of low-rank matrix estimation by singular value decomposition under perturbation. We specifically establish a perturbation bound on the low-rank matrix estimation via a perturbation projection error bound. Then, we establish lower bounds to justify the tightness of the upper bound on the low-rank matrix estimation error. We further develop a user-friendly sin$\Theta$ bound for singular subspace perturbation based on the matrix perturbation projection error bound. Finally, we demonstrate the advantage of our results over the ones in the literature by simulation.

Numerical Analysis,Statistics Theory
Low rank approximation method for perturbed linear systems with applications to elliptic type stochastic PDEs

Yujun Zhu,Ju Ming,Jie Zhu,Zhongming Wang

2023-10-19

Abstract:In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly reduce the computational load and storage requirements associated with matrix inversion without losing accuracy. To demonstrate the versatility and applicability of our method, we apply it to address two crucial uncertainty quantification problems: stochastic elliptic equations and optimal control problems governed by stochastic elliptic PDE constraints. Based on varying dimension reduction ratios, our algorithm exhibits the capability to yield a high precision numerical solution for stochastic partial differential equations, or provides a rough representation of the exact solutions as a pre-processing phase. Meanwhile, our algorithm for solving stochastic optimal control problems allows a diverse range of gradient-based unconstrained optimization methods, rendering it particularly appealing for computationally intensive large-scale problems. Numerical experiments are conducted and the results provide strong validation of the feasibility and effectiveness of our algorithm.

Numerical Analysis,Analysis of PDEs,Optimization and Control
Relative perturbation bounds for the eigenvalues of diagonalizable and singular matrices – Application of perturbation theory for simple invariant subspaces

Yimin Wei,Xiezhang Li,Fanbin Bu,Fuzhen Zhang

DOI: https://doi.org/10.1016/j.laa.2006.06.015

IF: 1.307

2006-01-01

Linear Algebra and its Applications

Abstract:Perturbation bounds for the relative error in the eigenvalues of diagonalizable and singular matrices are derived by using perturbation theory for simple invariant subspaces of a matrix and the group inverse of a matrix. These upper bounds are supplements to the related perturbation bounds for the eigenvalues of diagonalizable and nonsingular matrices.
Perturbation Analysis of Singular Linear Systems with Arbitrary Index

YM Wei

DOI: https://doi.org/10.1016/s0096-3003(02)00488-5

IF: 1.75

2000-01-01

International Journal of Computer Mathematics

Abstract:A new perturbation result for singular but consistent linear systems with coefficient matrix of index one is presented. However, if the system is inconsistent, we also derive a perturbation bound of the generalized linear least squares solution. Our treatment extends a classical perturbation result in numerical linear algebra.
Perturbation and Inverse Problems of Stochastic Matrices

Joost Berkhout,Bernd Heidergott,Paul Van Dooren

DOI: https://doi.org/10.1137/22m1489162

IF: 1.908

2024-02-10

SIAM Journal on Matrix Analysis and Applications

Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 1, Page 553-584, March 2024. It is a classical task in perturbation analysis to find norm bounds on the effect of a perturbation [math] of a stochastic matrix [math] to its stationary distribution, i.e., to the unique normalized left Perron eigenvector. A common assumption is to consider [math] to be given and to find bounds on its impact, but in this paper, we rather focus on an inverse optimization problem called the target stationary distribution problem (TSDP). The starting point is a target stationary distribution, and we search for a perturbation [math] of the minimum norm such that [math] remains stochastic and has the desired target stationary distribution. It is shown that TSDP has relevant applications in the design of, for example, road networks, social networks, hyperlink networks, and queuing systems. The key to our approach is that we work with rank-1 perturbations. Building on those results for rank-1 perturbations, we provide heuristics for the TSDP that construct arbitrary rank perturbations as sums of appropriately constructed rank-1 perturbations.

mathematics, applied
A Note on "perturbation Bounds for Williamson's Symplectic Normal Form"

Meiyue Shao,Sizhe Zhang

DOI: https://doi.org/10.1016/j.laa.2023.07.032

IF: 1.307

2023-01-01

Linear Algebra and its Applications

Abstract:A perturbation bound for Williamson's symplectic normal form under any unitarily invariant norm has been derived in Idel et al. (2017) [3]. We improve this bound to a tight one, and derive a few alternative forms of our new bound.
A note on stable perturbations of Moore-Penrose inverses.

Zhao Li,Qingxiang Xu,Yimin Wei

DOI: https://doi.org/10.1002/nla.838

2013-01-01

Numerical Linear Algebra with Applications

Abstract:Perturbation bounds for MoorePenrose inverses of rectangular matrices play a significant role in the perturbation analysis for linear least squares problems. In this note, we derive a sharp upper bound for MoorePenrose inverses, which is better than a well known existing one. Copyright (c) 2011 John Wiley & Sons, Ltd.
ON THE PERTURBATION BOUND OF THE GROUP INVERSE WITH APPLICATION TO SINGULAR LINEAR SYSTEM

魏益民

DOI: https://doi.org/10.3321/j.issn:1000-8134.2003.01.003

2003-01-01

Abstract:A perturbation bound for the group inverse is developed. This bound is based on the Jordan canonical form and P-norm of A, where P is an invertible matrix such that and D is a nonsingular upper bidiagonal matrix withSharp estimates of p are derived when A and A + E are of the same rank and p is small. Under similar conditions the perturbation of a singular consistent linear system Ax = b is studied. Realistic bounds on the perturbation of xopi = A#b is presented, where xopt is the minimal P-norm solution.
Entrywise relative perturbation bounds for exponentials of essentially non-negative matrices

Jungong Xue,Qiang Ye

DOI: https://doi.org/10.1007/s00211-008-0167-5

IF: 2.5

2008-01-01

Numerische Mathematik

Abstract:A real square matrix is said to be essentially non-negative if all of its off-diagonal entries are non-negative. We establish entrywise relative perturbation bounds for the exponential of an essentially non-negative matrix. Our bounds are sharp and contain a condition number that is intrinsic to the exponential function. As an application, we study sensitivity of continuous-time Markov chains.
Componentwise perturbation analysis for the generalized Schurdecomposition

Guihua Zhang,Hanyu Li,Yimin Wei

DOI: https://doi.org/10.1007/s10092-022-00463-8

2021-01-01

CALCOLO

Abstract: By defining two important terms called basic perturbation vectors and obtaining their linear bounds, we obtain the linear componentwise perturbation bounds for unitary factors and upper triangular factors of the generalized schur decomposition. The perturbation bounds for the diagonal elements of the upper triangular factors and the generalized invariant subspace are also derived. From the former, we present an upper bound and a condition number of the generalized eigenvalue. Furthermore, with numerical iterative method, the nonlinear componentwise perturbation bounds of the generalized Schur decomposition are also provided. Numerical examples are given to test the obtained bounds. Among them, we compare our upper bound and condition number of the generalized eigenvalue with their counterparts given in the literature. Numerical results show that they are very close to each other but our results don't need to calculate the left and right eigenvectors.
Perturbation Analysis of Error Bounds for Convex Functions on Banach Spaces

Zhou Wei,Michel Théra,Jen-Chih Yao

2024-09-21

Abstract:This paper focuses on the stability of both local and global error bounds for a proper lower semicontinuous convex function defined on a Banach space. Without relying on any dual space information, we first provide precise estimates of error bound moduli using directional derivatives. For a given proper lower semicontinuous convex function on a Banach space, we prove that the stability of local error bounds under small perturbations is equivalent to the directional derivative at a reference point having a non-zero minimum over the unit sphere. Additionally, the stability of global error bounds is shown to be equivalent to the infimum of the directional derivatives, at all points on the boundary of the solution set, being bounded away from zero over some neighborhood of the unit sphere.

Optimization and Control

Perturbation bounds for constrained and weighted least squares problems

Perturbation Identities for Regularized Tikhonov Inverses and Weighted Pseudoinverses

A contribution to perturbation analysis for total least squares problems

Perturbation Analysis and Randomized Algorithms for Large-Scale Total Least Squares Problems

Relative Errors Versus Residuals of Approximate Solutions of Weighted Least Squares Problems in Hilbert Space

Condition Numbers and Perturbation of the Weighted Moore-Penrose Inverse and Weighted Linear Least Squares Problem.

Quantitative Analysis for Perturbed Abstract Inequality Systems in Banach Spaces

A Note on the Perturbation of the W-weighted Drazin Inverse

A Note on the Sensitivity of the Solution of the Weighted Linear Least Squares Problem

Perturbation Bounds For The Generalized Inverses At,S-(2) With Application To Constrained Linear System

A Schatten-$q$ Low-rank Matrix Perturbation Analysis via Perturbation Projection Error Bound

Low rank approximation method for perturbed linear systems with applications to elliptic type stochastic PDEs

Relative perturbation bounds for the eigenvalues of diagonalizable and singular matrices – Application of perturbation theory for simple invariant subspaces

Perturbation Analysis of Singular Linear Systems with Arbitrary Index

Perturbation and Inverse Problems of Stochastic Matrices

A Note on "perturbation Bounds for Williamson's Symplectic Normal Form"

A note on stable perturbations of Moore-Penrose inverses.

ON THE PERTURBATION BOUND OF THE GROUP INVERSE WITH APPLICATION TO SINGULAR LINEAR SYSTEM

Entrywise relative perturbation bounds for exponentials of essentially non-negative matrices

Componentwise perturbation analysis for the generalized Schurdecomposition

Perturbation Analysis of Error Bounds for Convex Functions on Banach Spaces