STRUCTURED BACKWARD ERRORS FOR STRUCTURED KKT SYSTEMS

XX Li,XG Liu

2004-01-01

Abstract:In this paper we study structured backward errors for some structured KKT systems. Normwise structured backward errors for structured KKT systems are defined, and computable formulae of the structured backward errors are obtained. Simple numerical examples show that the structured backward errors may be much larger than the unstructured ones in some cases.

What problem does this paper attempt to address?

Structured Backward Errors for Generalized Saddle Point Systems

Xiao Shan Chen,Wen Li,Xiaojun Chen,Jun Liu

DOI: https://doi.org/10.1016/j.laa.2011.10.012

IF: 1.307

2012-01-01

Linear Algebra and its Applications

Abstract:In this paper we investigate structured backward errors for three kinds of generalized saddle point systems where the matrix is not symmetric and its (2,2) block is not zero and has perturbations. Computable formula of backward errors are derived. The expressions are useful for testing the stability of practical algorithms.
On Normwise Structured Backward Errors for Saddle Point Systems

Hua Xiang,Yimin Wei

DOI: https://doi.org/10.1137/060663684

IF: 1.908

2007-01-01

SIAM Journal on Matrix Analysis and Applications

Abstract:We derive the explicit expressions of the normwise structured backward errors of saddle point systems; we extend the previous results of Sun [Linear Algebra Appl., 288 (1999), pp. 75-88] to a general $2 \times 2$ block linear system, where the (1,1) block is general and not symmetric. We also compare the structured backward error with the unstructured one and find that the difference can be arbitrarily large.
Adaptive Backstepping Control for a Class of Nonlinear Systems with Non-Triangular Structural Uncertainties.

Jianping Cai,Changyun Wen,Hongye Su,Zhitao Liu,Lantao Xing

DOI: https://doi.org/10.1109/tac.2016.2628159

IF: 6.549

2016-01-01

IEEE Transactions on Automatic Control

Abstract:In this technical note, a robust adaptive control scheme is proposed based on backstepping techniques for a class of nonlinear systems with unknown parameters. A modeling error may also exist in every state equation or channel and it is bounded by a known function which is allowed to depend on all system states. It is shown that the proposed adaptive control scheme can ensure all signals in the closed-loop system bounded, if the strength of system modeling errors is sufficiently weak. Transient performance is also established. Thus stabilizing systems in classical strict-feedback forms with sufficiently small non-triangular structural perturbations is successfully addressed. In the case that system parameters are known, a non-adaptive robust controller is designed to globally exponentially stabilize such a class of nonlinear systems. Finally simulation studies are used to verify the effectiveness of the proposed scheme.
On backward errors of structured polynomial eigenproblems solved by structure preserving linearizations

Bibhas Adhikari,Rafikul Alam

DOI: https://doi.org/10.1016/j.laa.2010.12.014

IF: 1.307

2011-05-01

Linear Algebra and its Applications

Abstract:We derive explicit computable expressions of structured backward errors of approximate eigenelements of structured matrix polynomials including symmetric, skew-symmetric, Hermitian, skew-Hermitian, even and odd polynomials. We determine minimal structured perturbations for which approximate eigenelements are exact eigenelements of the perturbed polynomials. We also analyze structured pseudospectra of a structured matrix polynomial and establish a partial equality between unstructured and structured pseudospectra. Finally, we analyze the effect of structure preserving linearizations of structured matrix polynomials on the structured backward errors of approximate eigenelements and show that structure preserving linearizations which minimize structured condition numbers of eigenvalues also minimize the structured backward errors of approximate eigenelements.

mathematics, applied
Structured backward errors for block three-by-three saddle point systems

Wei MaYadan FanXiaoyi XuSchool of Mathematics and Statistics,Nanyang Normal University,Nanyang,Henan,People's Republic of China

DOI: https://doi.org/10.1080/03081087.2024.2311264

2024-02-04

Linear and Multilinear Algebra

Abstract:In this paper, we analyze the structured backward error for block three-by-three saddle point systems. The computable formulas of structured backward errors are derived, which are useful for testing the stability of practical algorithms.

mathematics
Structured backward error analysis for sparse polynomial eigenvalue problems.

Kaijun Zhang,Yangfeng Su

DOI: https://doi.org/10.1016/j.amc.2012.09.035

IF: 4.397

2012-01-01

Applied Mathematics and Computation

Abstract:We study a backward error analysis for (structured) polynomial eigenvalue problems in homogeneous form arising in practical applications. The perturbation matrices preserve the sparsity as well as other structures, including symmetry, skew-symmetry, Hermite, skew-Hermite. We construct structured perturbation matrices of minimal Frobenius norm such that an approximate eigenpair is an exact eigenpair of the structured perturbed polynomial eigenvalue problem. This work is a complement of previous work for the polynomial eigenvalue problems in homogeneous form.
Structured eigenvalue backward errors for rational matrix functions with symmetry structures

Anshul Prajapati,Punit Sharma

DOI: https://doi.org/10.1007/s10543-024-01010-3

IF: 1.856

2024-02-18

BIT Numerical Mathematics

Abstract:We derive computable formulas for the structured backward errors of a complex number when considered as an approximate eigenvalue of rational matrix functions that carry a symmetry structure. We consider symmetric, skew-symmetric, Hermitian, skew-Hermitian, -palindromic, T-even, T-odd, -even, and -odd structures. Numerical experiments show that the backward errors with respect to structure-preserving and arbitrary perturbations are significantly different.

mathematics, applied,computer science, software engineering
Structured eigenvalue/eigenvector backward errors of matrix pencils arising in optimal control

Christian Mehl,Volker Mehrmann,Punit Sharma

DOI: https://doi.org/10.48550/arXiv.1712.08192

2017-12-22

Abstract:Eigenvalue and eigenpair backward errors are computed for matrix pencils arising in optimal control. In particular, formulas for backward errors are developed that are obtained under block-structure-preserving and symmetry-structure-preserving perturbations. It is shown that these eigenvalue and eigenpair backward errors are sometimes significantly larger than the corresponding backward errors that are obtained under perturbations that ignore the special structure of the pencil.

Numerical Analysis
Structured Backward Error for the WKB method

Robert M. Corless,Nicolas Fillion

2024-12-01

Abstract:The classical WKB method (also known as the WKBJ method, the LG method, or the phase integral method) for solving singularly perturbed linear differential equations has never, as far as we know, been looked at from the structured backward error (BEA) point of view. This is somewhat surprising, because a simple computation shows that for some important problems, the WKB method gives the exact solution of a problem of the same structure that can be expressed in finitely many terms. This kind of analysis can be extremely useful in assessing the validity of a solution provided by the WKB method. In this paper we show how to do this and explore some of the consequences, which include a new iterative algorithm to improve the quality of the WKB solution. We also explore a new hybrid method where the potential is approximated by Chebyshev polynomials, which can be implemented in a few lines of Chebfun.

Numerical Analysis,Classical Analysis and ODEs
Structured eigenvalue backward errors for rational matrix polynomials with symmetry structures

Anshul Prajapati,Punit Sharma

DOI: https://doi.org/10.48550/arXiv.2208.13420

2022-08-29

Abstract:We derive computable formulas for the structured backward errors of a complex number $\lambda$ when considered as an approximate eigenvalue of rational matrix polynomials that carry a symmetry structure. We consider symmetric, skew-symmetric, T-even, T-odd, Hermitian, skew-Hermitian, $*$-even, $*$-odd, and $*$-palindromic structures. Numerical experiments show that the backward errors with respect to structure-preserving and arbitrary perturbations are significantly different.

Optimization and Control
Robust stability for linear uncertain multi-time-delay system

Zheng-qun CHENG,Qi-qiang LI,Yong-ru GU,Jun MENG,Ji-xin QIANG

DOI: https://doi.org/10.3785/j.issn.1008-973X.2001.01.019

2001-01-01

Abstract:We focus on the problem of robust stability for the linear uncertain multi-time-delay system. Both the systems subjected to unstructured parametric uncertainties and structured parametric are concerned. Based on the fact that if the characteristic roots of a system lie in the left half complex plane then the system is asymptotically stable, several delay-independent asymptotically stable sufficient conditions for linear uncertain multi-time-delay systems are derived. These conditions only rely on the structure of the system; this can lead to reduction in conservatism. Some numerical example examples are given to show the superiority of our results to those in the literature.
Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

kexin wang,zhijiang shao,lorenz t biegler,yidong lang,jixin qian

DOI: https://doi.org/10.1016/B978-0-444-59506-5.50131-0

2012-01-01

Abstract:Global convergence and fast performance of barrier nonlinear programming (NLP) solvers are frequently challenged by linearly dependent constraints. Such constraints arise in many process optimization models, and they often preclude finding successful NLP solutions. To deal with this problem we present a structured regularization strategy for barrier methods that identifies and excludes dependent constraints in the KKT system while leaving independent constraints unchanged. As a result, more accurate Newton directions can be obtained and much faster convergence can be expected for the KKT system over the conventional regularization approach. Numerical experiments with examples derived from the CUTE and COPS test sets as well as two refinery blending problems demonstrate the effectiveness of the proposed method and significantly better performance of the NLP solver.
Structured backward error analysis of linearized structured polynomial eigenvalue problems

Froilán M. Dopico,Javier Pérez,Paul Van Dooren

DOI: https://doi.org/10.1090/mcom/3360

IF: 2.118

2018-06-14

Mathematics of Computation

Abstract:We start by introducing a new class of structured matrix polynomials, namely, the class of MA\mathbf {M}_A-structured matrix polynomials, to provide a common framework for many classes of structured matrix polynomials that are important in applications: the classes of (skew-)symmetric, (anti-)palindromic, and alternating matrix polynomials. Then, we introduce the families of MA\mathbf {M}_A-structured strong block minimal bases pencils and of MA\mathbf {M}_A-structured block Kronecker pencils, which are particular examples of block minimal bases pencils recently introduced by Dopico, Lawrence, Pérez and Van Dooren, and show that any MA\mathbf {M}_A-structured odd-degree matrix polynomial can be strongly linearized via an MA\mathbf {M}_A-structured block Kronecker pencil. Finally, for the classes of (skew-)symmetric, (anti-)palindromic, and alternating odd-degree matrix polynomials, the MA\mathbf {M}_A-structured framework allows us to perform a global and structured backward stability analysis of complete structured polynomial eigenproblems, regular or singular, solved by applying to a MA\mathbf {M}_A-structured block Kronecker pencil a structurally backward stable algorithm that computes its complete eigenstructure, like the palindromic-QR algorithm or the structured versions of the staircase algorithm. This analysis allows us to identify those MA\mathbf {M}_A-structured block Kronecker pencils that yield a computed complete eigenstructure which is the exact one of a slightly perturbed structured matrix polynomial. These pencils include (modulo permutations) the well-known block-tridiagonal and block-anti-tridiagonal structure-preserving linearizations. Our analysis incorporates structure to the recent (unstructured) backward error analysis performed for block Kronecker linearizations by Dopico, Lawrence, Pérez and Van Dooren, and share with it its key features, namely, it is a rigorous analysis valid for finite perturbations, i.e., it is not a first order analysis, it provides precise bounds, and it is valid simultaneously for a large class of structure-preserving strong linearizations.

mathematics, applied
Structured Backward Errors for Special Classes of Saddle Point Problems with Applications

Sk. Safique Ahmad,Pinki Khatun

2024-08-21

Abstract:Significant research efforts have been dedicated recently to explore the structured backward error (BE) for saddle point problems (SPPs). However, these investigations overlook the inherent sparsity pattern of the coefficient matrix of the SPP. Moreover, the existing techniques are not applicable when the block matrices have Circulant, Toeplitz, or symmetric-Toeplitz structures and do not even provide structure preserving minimal perturbation matrices for which the BE is attained. To overcome these limitations, we investigate the structured BEs of SPPs when the perturbation matrices exploit the sparsity pattern as well as Circulant, Toeplitz, and symmetric-Toeplitz structures. Furthermore, we construct minimal perturbation matrices that preserve the sparsity pattern and the aforementioned structures. Two applications of the obtained results are discussed: (i) deriving structured BEs for the weighted regularized least squares problem and (ii) finding an effective and reliable stopping criterion for numerical algorithms. Finally, numerical experiments validate our findings, showcasing the utility of the obtained structured BEs in assessing the strong stability of numerical algorithms

Numerical Analysis
Backward errors for multiple eigenpairs in structured and unstructured nonlinear eigenvalue problems

Miryam Gnazzo,Leonardo Robol

2024-05-10

Abstract:Given a nonlinear matrix-valued function $F(\lambda)$ and approximate eigenpairs $(\lambda_i, v_i)$, we discuss how to determine the smallest perturbation $\delta F$ such that $[F + \delta F](\lambda_i) v_i = 0$; we call the distance between the $F$ and $F + \delta F$ the backward error for this set of approximate eigenpairs. We focus on the case where $F(\lambda)$ is given as a linear combination of scalar functions multiplying matrix coefficients $F_i$, and the perturbation is done on the matrix coefficients. We provide inexpensive upper bounds, and a way to accurately compute the backward error by means of direct computations or through Riemannian optimization. We also discuss how the backward error can be determined when the $F_i$ have particular structures (such as symmetry, sparsity, or low-rank), and the perturbations are required to preserve them. For special cases (such as for symmetric coefficients), explicit and inexpensive formulas to compute the $\delta F_i$ are also given.

Numerical Analysis
Acceptable Solutions and Backward Errors for Tensor Complementarity Problems

Du Shouqiang,Ding Weiyang,Wei Yimin

DOI: https://doi.org/10.1007/s10957-020-01774-y

2020-01-01

Journal of Optimization Theory and Applications

Abstract:Backward error analysis reveals the numerical stability of algorithms and provides elaborate stopping criteria for iterative methods. Compared with numerical linear algebra problems, the backward error analysis for optimization problems is more rarely conducted in the literature. This paper is devoted to the backward error analysis for several generalizations of tensor complementarity problems. We first present sufficient and necessary conditions for the acceptable solutions for the extended tensor complementarity problem, the vertical tensor complementarity problem, and an extended form of tensor complementarity problem. Next, the backward errors for tensor complementarity problem are also proposed, which can be used to verify the stability of the tensor complementarity problem algorithms. Finally, some numerical examples are reported to illustrate the proposed backward errors for tensor complementarity problems.
Barrier NLP Methods with Structured Regularization for Optimization of Degenerate Optimization Problems

Kexin Wang,Zhijiang Shao,Yidong Lang,Jixin Qian,Lorenz T. Biegler

DOI: https://doi.org/10.1016/j.compchemeng.2013.04.023

IF: 4.13

2013-01-01

Computers & Chemical Engineering

Abstract:Barrier nonlinear programming (NLP) solvers exploit sparse Newton-based algorithms and are characterized by fast performance and global convergence properties. This makes them especially suitable for very large process optimization problems. On the other hand, they are frequently challenged by degenerate and indefinite problems, which lead to ill-conditioned Karush–Kuhn–Tucker (KKT) systems. Such problems arise when process optimization models contain linearly dependent constraints, or the reduced Hessian is not positive definite at the solution. This can lead to poor solver performance and may preclude finding successful NLP solutions. Moreover, such optimization models occur in blending problems and NLP subproblems generated by MINLP or global optimization strategies. To deal with these difficulties we present a structured regularization strategy for barrier methods that identifies and excludes dependent constraints in the KKT system while leaving independent constraints unchanged. As a result, more accurate Newton directions can be obtained and much faster convergence can be expected for the KKT system over the conventional regularization approach. Numerical experiments with examples derived from the CUTE and COPS test sets as well as two nonlinear blending problems demonstrate the effectiveness of the proposed method and significantly better performance of the NLP solver.
Structured Backward Error Analysis with Preserving Sparsity for Three-by-Three Block Saddle Point Problems

Sk. Safique Ahmad,Pinki Khatun

2024-08-26

Abstract:Backward error (\textit{BE}) analysis emerges as a powerful tool for assessing the backward stability and strong backward stability of iterative algorithms. In this paper, we explore structured \textit{BEs} for a class of three-by-three block saddle point problems (\textit{TBSPPs}), aiming to assess the strong backward stability of iterative algorithms devised to find their solution. Our investigations preserve the inherent matrix structure and sparsity pattern in the corresponding perturbation matrices and derive explicit formulae for the structure \textit{BEs}. Moreover, we provide formulae for the structure-preserving minimal perturbation matrices for which the structured \textit{BE} is attained. Furthermore, using the obtained structured \textit{BEs}, we propose three new termination criteria for the iterative algorithms to solve the \textit{TBSPP.} Numerical experiments are performed to test the strong backward stability of various iterative algorithms, as well as the reliability and effectiveness of the proposed termination criteria.

Numerical Analysis
Structured Backward Errors for Eigenvalues of Linear Port-Hamiltonian Descriptor Systems

Volker Mehrmann,Paul Van Dooren

DOI: https://doi.org/10.1137/20M1344184

IF: 1.908

2021-01-06

SIAM Journal on Matrix Analysis and Applications

Abstract:When computing the eigenstructure of matrix pencils associated with the passivity analysis of perturbed port-Hamiltonian descriptor system using a structured generalized eigenvalue method, one should make sure that the computed spectrum satisfies the symmetries that corresponds to this structure and the underlying physical system. We perform a backward error analysis and show that for matrix pencils associated with port-Hamiltonian descriptor systems and a given computed eigenstructure with the correct symmetry structure there always exists a nearby port-Hamiltonian descriptor system with exactly that eigenstructure. We also derive bounds for how near this system is and show that the stability radius of the system plays a role in that bound.

mathematics, applied
Structured Condition Number And Backward Error Of Nonsymmetric Algebraic Riccati Equation

Wei-Guo Wang,Yi-Min Wei,Nan Hao

2010-01-01

Abstract:We consider the nonsymmetric algebraic Riccati equation (NARE) which arises in transport theory and Markov chain model. It is known that some assumptions on the coefficient matrices guarantee the existence of minimal nonnegative solution. In this paper, we apply the theory of condition number by Rice in 1966 to define condition numbers of the NARE, and derive explicit expressions of the condition numbers in an unified manner. If M has no zero entries, we prove that the structured and unstructured condition numbers for the minimal nonnegative solution are the same. As for a special NARE arising in transport theory, structured condition number is derived. An upper bound and the approximate bounds for the structured backward error are also obtained. These results are illustrated by some numerical examples.

STRUCTURED BACKWARD ERRORS FOR STRUCTURED KKT SYSTEMS

Structured Backward Errors for Generalized Saddle Point Systems

On Normwise Structured Backward Errors for Saddle Point Systems

Adaptive Backstepping Control for a Class of Nonlinear Systems with Non-Triangular Structural Uncertainties.

On backward errors of structured polynomial eigenproblems solved by structure preserving linearizations

Structured backward errors for block three-by-three saddle point systems

Structured backward error analysis for sparse polynomial eigenvalue problems.

Structured eigenvalue backward errors for rational matrix functions with symmetry structures

Structured eigenvalue/eigenvector backward errors of matrix pencils arising in optimal control

Structured Backward Error for the WKB method

Structured eigenvalue backward errors for rational matrix polynomials with symmetry structures

Robust stability for linear uncertain multi-time-delay system

Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

Structured backward error analysis of linearized structured polynomial eigenvalue problems

Structured Backward Errors for Special Classes of Saddle Point Problems with Applications

Backward errors for multiple eigenpairs in structured and unstructured nonlinear eigenvalue problems

Acceptable Solutions and Backward Errors for Tensor Complementarity Problems

Barrier NLP Methods with Structured Regularization for Optimization of Degenerate Optimization Problems

Structured Backward Error Analysis with Preserving Sparsity for Three-by-Three Block Saddle Point Problems

Structured Backward Errors for Eigenvalues of Linear Port-Hamiltonian Descriptor Systems

Structured Condition Number And Backward Error Of Nonsymmetric Algebraic Riccati Equation