Matrix Factorizations via the Inverse Function Theorem

Paul W. Y. Lee,Paul W.Y. Lee

DOI: https://doi.org/10.48550/arXiv.1408.2611

2014-08-12

Classical Analysis and ODEs

Abstract:We give proofs of QR factorization, Cholesky's factorization, and LDU factorization using the inverse function theorem. As a consequence, we obtain analytic dependence of these matrix factorizations which does not follow immediately using Gaussian elimination.

What problem does this paper attempt to address?

The Loewner-Neville Factorization Of Generalized Matrices With Consecutive-Column And -Row Properties

Weidong Xu,Weijun Xu,Chongfeng Wu

2008-01-01

Abstract:A matrix over ring with identity has the consecutive-column (CC) property if for all k, all its relevant submatrices having k consecutive rows and the first k columns are invertible. Similarly, the consecutive-row (CR) is defined. In this paper, we show that a arbitrary m x n matrix has both CC and CR properties if and only if it admits a certain factorization with bidiagonal-type factors (with invertible entries). This factorization is unique. We also show that there is a mutual 1 - 1 relations between the matrices having CC and CR properties and this certain factorization with bidiagonal-type factors (with invertible entries). This bidiagonal factorization has important applications in computer aided geometry design, electrical network and many other fields.
Exact QR factorizations of rectangular matrices

Christopher Lourenco,Erick Moreno-Centeno

DOI: https://doi.org/10.1007/s11590-024-02095-z

IF: 1.5288

2024-02-23

Optimization Letters

Abstract:QR factorization is a key tool in mathematics, computer science, operations research, and engineering. This paper presents the roundoff-error-free (REF) QR factorization framework comprising integer-preserving versions of the standard and the thin QR factorizations and associated algorithms to compute them. Specifically, the standard REF QR factorization factors a given matrix as , where has pairwise orthogonal columns, D is a diagonal matrix, and is an upper trapezoidal matrix; notably, the entries of Q and R are integral, while the entries of D are reciprocals of integers. In the thin REF QR factorization, also has pairwise orthogonal columns, and is also an upper triangular matrix. In contrast to traditional (i.e., floating-point) QR factorizations, every operation used to compute these factors is integral; thus, REF QR is guaranteed to be an exact orthogonal decomposition. Importantly, the bit-length of every entry in the REF QR factorizations (and within the algorithms to compute them) is bounded polynomially. Notable applications of our REF QR factorizations include finding exact least squares or exact basic solutions, , to any given full column rank or rank deficient linear system , respectively. In addition, our exact factorizations can be used as a subroutine within exact and/or high-precision quadratic programming. Altogether, REF QR provides a framework to obtain exact orthogonal factorizations of any rational matrix (as any rational/decimal matrix can be easily transformed into an integral matrix).

mathematics, applied,operations research & management science
Complex matrix inversion via real matrix inversions

Zhen Dai,Lek-Heng Lim,Ke Ye

2023-10-09

Abstract:We study the inversion analog of the well-known Gauss algorithm for multiplying complex matrices. A simple version is $(A + iB)^{-1} = (A + BA^{-1}B)^{-1} - i A^{-1}B(A+BA^{-1} B)^{-1}$ when $A$ is invertible, which may be traced back to Frobenius but has received scant attention. We prove that it is optimal, requiring fewest matrix multiplications and inversions over the base field, and we extend it in three ways: (i) to any invertible $A + iB$ without requiring $A$ or $B$ be invertible; (ii) to any iterated quadratic extension fields, with $\mathbb{C}$ over $\mathbb{R}$ a special case; (iii) to Hermitian positive definite matrices $A + iB$ by exploiting symmetric positive definiteness of $A$ and $A + BA^{-1}B$. We call all such algorithms Frobenius inversions, which we will see do not follow from Sherman--Morrison--Woodbury type identities and cannot be extended to Moore--Penrose pseudoinverse. We show that a complex matrix with well-conditioned real and imaginary parts can be arbitrarily ill-conditioned, a situation tailor-made for Frobenius inversion. We prove that Frobenius inversion for complex matrices is faster than standard inversion by LU decomposition and Frobenius inversion for Hermitian positive definite matrices is faster than standard inversion by Cholesky decomposition. We provide extensive numerical experiments, applying Frobenius inversion to solve linear systems, evaluate matrix sign function, solve Sylvester equation, and compute polar decomposition, showing that Frobenius inversion can be more efficient than LU/Cholesky decomposition with negligible loss in accuracy. A side result is a generalization of Gauss multiplication to iterated quadratic extensions, which we show is intimately related to the Karatsuba algorithm for fast integer multiplication and multidimensional fast Fourier transform.

Numerical Analysis,Computational Complexity
New Representations of the Group Inverse of 2×2 Block Matrices

Xiaoji Liu,Qi Yang,Hongwei Jin

DOI: https://doi.org/10.1155/2013/247028

2013-01-01

Journal of Applied Mathematics

Abstract:This paper presents a full rank factorization of a 2×2 block matrix without any restriction concerning the group inverse. Applying this factorization, we obtain an explicit representation of the group inverse in terms of four individual blocks of the partitioned matrix without certain restriction. We also derive some important coincidence theorems, including the expressions of the group inverse with Banachiewicz-Schur forms.
Verified Error Bounds for Matrix Decompositions

Siegfried M. Rump,Takeshi Ogita

DOI: https://doi.org/10.1137/24m165096x

IF: 1.908

2024-11-13

SIAM Journal on Matrix Analysis and Applications

Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 4, Page 2155-2183, December 2024. In this note we consider common matrix factorizations such as LU decomposition of a square and rectangular matrix, Cholesky and QR decomposition, singular value decomposition for square and rectangular matrices, and eigen-, Schur, and Takagi decomposition. We first note that well-conditioned factors tend to be sensitive to perturbations of the input matrix, while ill-conditioned factors tend to be insensitive. It seems that this behavior has not been recognized in numerical analysis. We develop a formula for the relation between the condition number of the factor and its sensitivity with respect to input perturbations, and give reasons for that. Our main focus is to describe verification methods for the factors of the mentioned decompositions. That means proving existence of the factorization together with rigorous entrywise error bounds for the factors. Our goal is to develop algorithms requiring [math] operations for an [math] matrix with [math] and [math]. Moreover, bounds of high quality are aimed for, often not far from maximal accuracy. A main tool to achieve that is accurate dot products based on error-free transformations. Since preconditioning based on approximate inverses is used, our methods are restricted to full matrices.

mathematics, applied
Matrix Factorizations for Reversible Integer Mapping

PW Hao,QY Shi

DOI: https://doi.org/10.1109/78.950787

IF: 4.875

2001-01-01

IEEE Transactions on Signal Processing

Abstract:Reversible integer mapping is essential for lossless source coding by transformation. A general matrix factorization theory for reversible integer mapping of invertible linear transforms is developed. Concepts of the integer factor and the elementary reversible matrix (ERM) for integer mapping are introduced, and two forms of ERM-triangular ERM (TERM) and single-row ERM (SERM)-are studied. We prove that there exist some approaches to factorize a matrix into TERMs or SERMs if the transform is invertible and in a finite-dimensional space. The advantages of the integer implementations of an invertible linear transform are (i) mapping integers to integers, (ii) perfect reconstruction, and (iii) in-place calculation. We find that besides a possible permutation matrix, the TERM factorization of an N-by-N nonsingular matrix has at most three TERMs, and its SERM factorization has at most N+1 SERMs. The elementary structure of ERM transforms is the ladder structure. An executable factorization algorithm is also presented. Then, the computational complexity is compared, and some optimization approaches are proposed. The error bounds of the integer implementations are estimated as well. Finally, three ERM factorization examples of DFT, DCT, and DWT are given.
On rank‐revealing QR factorizations of quaternion matrices

Qiaohua Liu,Chuge Li

DOI: https://doi.org/10.1002/nla.2585

2024-09-01

Numerical Linear Algebra with Applications

Abstract:This work develops theories and algorithms for computing rank‐revealing QR factorizations (qRRQR) of quaternion matrices. First, by introducing a novel quaternion determinant, a quasi‐Cramer's rule is established to investigate the existence theory of the qRRQR factorization of an m×n quaternion matrix A . The proposed theory provides a systematic approach for selecting k linearly independent columns of A in order to ensure that the resulting diagonal blocks R11 , R22 of the R‐factor possess rank revealing properties in both spectral and Frobenius norms. Secondly, by increasing the quaternion determinants of R11 in each iteration by a factor of at least f−1 (0

mathematics, applied
QR Factorization for Row or Column Symmetric Matrix

Hongxing Zou,Dianjun Wang,Qionghai Dai,Yanda Li

DOI: https://doi.org/10.1360/03ys9009

2003-01-01

Science in China Series A Mathematics

Abstract:The problem of fast computing the QR factorization of row or column symmetric matrix is considered. We address two new algorithms based on a correspondence of Q and R matrices between the row or column symmetric matrix and its mother matrix. Theoretical analysis and numerical evidence show that, for a class of row or column symmetric matrices, the QR factorization using the mother matrix rather than the row or column symmetric matrix per se can save dramatically the CPU time and memory without loss of any numerical precision.
Tridiagonal and single-pair matrices and the inverse sum of two single-pair matrices

Sebastien Bossu

2024-02-29

Abstract:A novel factorization for the sum of two single-pair matrices is established as product of lower-triangular, tridiagonal, and upper-triangular matrices, leading to semi-closed-form formulas for tridiagonal matrix inversion. Subsequent factorizations are established, leading to semi-closed-form formulas for the inverse sum of two single-pair matrices. An application to derive the symbolic inverse of a particular Gram matrix is presented, and the numerical stability of the formulas is studied.

Rings and Algebras
Application of quasideterminants to the inverse of block triangular matrices over noncommutative rings

Xuzhou Zhan

DOI: https://doi.org/10.48550/arXiv.2006.15544

2020-06-28

Abstract:Given a block triangular matrix $M$ over a noncommutative ring with invertible diagonal blocks, this work gives two new representations of its inverse $M^{-1}$. Each block element of $M^{-1}$ is explicitly expressed via a quasideterminant of a submatrix of $M$ with the block Hessenberg type. Accordingly another representation for each inverse block is attained, which is in terms of recurrence relationship with multiple terms among blocks of $M^{-1}$. The latter result allows us to perform an off-diagonal rectangular perturbation analysis for the inverse calculation of $M$. An example is given to illustrate the effectiveness of our results.

Rings and Algebras,Quantum Algebra
Generalized elimination method and its applications to matrix factorizations

E. Golpar-Raboky

DOI: https://doi.org/10.1007/s13226-024-00678-1

2024-09-20

Indian Journal of Pure and Applied Mathematics

Abstract:An elimination method is a sequence of elementary row or column operations to divide a matrix into parts with partial zeroing of columns or rows of the matrix leading to a matrix factorization implicitly. We present a generalized elimination algorithm for solving real and Diophantine linear systems. The algorithm uses a zeroing process based on two index sets and provides a mechanism for constructing factorizations such as block LU factorization as well as the WZ and the ZW factorizations under a common framework. We also introduce the octant interlocking factorization method and present two new factorizations named as the ODS and the SDO factorizations. Necessary and sufficient conditions under which the generalized elimination method is carried out are proposed.

mathematics
Necessary And Sufficient Conditions For Existence of the LU Factorization of an Arbitrary Matrix

Pavel Okunev,Charles R. Johnson

DOI: https://doi.org/10.48550/arXiv.math/0506382

2005-06-19

Numerical Analysis

Abstract:If $A$ is an n-by-n matrix over a field $F$ ($A\in M_{n}(F)$), then $A$ is said to ``have an LU factorization'' if there exists a lower triangular matrix $L\in M_{n}(F)$ and an upper triangular matrix $U\in M_{n}(F)$ such that $$A=LU.$$ We give necessary and sufficient conditions for LU factorability of a matrix. Also simple algorithm for computing an LU factorization is given. It is an extension of the Gaussian elimination algorithm to the case of not necessarily invertible matrices. We consider possibilities to factors a matrix that does not have an LU factorization as the product of an ``almost lower triangular'' matrix and an ``almost upper triangular'' matrix. There are many ways to formalize what almost means. We consider some of them and derive necessary and sufficient conditions. Also simple algorithms for computing of an ``almost LU factorization'' are given.
Non-denseness of factorable matrix functions

Alex Brudnyi,Leiba Rodman,Ilya M. Spitkovsky

DOI: https://doi.org/10.48550/arXiv.1103.0336

2011-03-02

Abstract:It is proved that for certain algebras of continuous functions on compact abelian groups, the set of factorable matrix functions with entries in the algebra is not dense in the group of invertible matrix functions with entries in the algebra, assuming that the dual abelian group contains a subgroup isomorphic to Z^3. These algebras include the algebra of all continuous functions and the Wiener algebra. More precisely, it is shown that infinitely many connected components of the group of invertible matrix functions do not contain any factorable matrix functions, again under the same assumption. Moreover, these components actually are disjoint with the subgroup generated by the triangularizable matrix functions.

Functional Analysis,Algebraic Topology
Matrix-inversion Method: Applications to Möbius Inversion Adn Deconvolution.

Q Xie,NX Chen

DOI: https://doi.org/10.1103/physreve.52.6055

1995-01-01

Abstract:The purpose of this paper is threefold. The first is to show the matrix inversion method as a joint basis for the inversion of two important transforms: the M\"obius and Laplace transforms. It is found that the M\"obius transform is related to a multiplicative operator while the Laplace transform is related to an additive operator. The second is to show that the matrix inverison method is a useful tool for inverse problems not only in statistical physics but also in applied physics by means of adding two other applications, one the derivation of the Fuoss-Kirkwood formulas for relaxation spectra in studies of anelasticity and dielectrics and the other the reconstruction of real signal in signal processing. The third is to indicate the potentiality of the matrix inversion method as a rough algorithm for numerical solution of the convolution integral equation. The numerical examples given include the inversion of Laplace transform and the signal reconstruction with a Gaussian point spread kernel. (c) 1995 The American Physical Society
Communication-optimal parallel and sequential QR and LU factorizations: theory and practice

James Demmel,Laura Grigori,Mark Hoemmen,Julien Langou

DOI: https://doi.org/10.48550/arXiv.0806.2159

2008-08-30

Abstract:We present parallel and sequential dense QR factorization algorithms that are both optimal (up to polylogarithmic factors) in the amount of communication they perform, and just as stable as Householder QR. Our first algorithm, Tall Skinny QR (TSQR), factors m-by-n matrices in a one-dimensional (1-D) block cyclic row layout, and is optimized for m >> n. Our second algorithm, CAQR (Communication-Avoiding QR), factors general rectangular matrices distributed in a two-dimensional block cyclic layout. It invokes TSQR for each block column factorization.

Numerical Analysis
Reverse Cholesky factorization and tensor products of nest algebras

Vern I. Paulsen,Hugo J. Woerdeman

DOI: https://doi.org/10.48550/arXiv.1704.04323

2017-04-14

Abstract:We prove that every positive semidefinite matrix over the natural numbers that is eventually 0 in each row and column can be factored as the product of an upper triangular matrix times a lower triangular matrix. We also extend some known results about factorization with respect to tensor products of nest algebras. Our proofs use the theory of reproducing kernel Hilbert spaces.

Functional Analysis
Idempotent factorization on some matrices over quadratic integer rings

Peeraphat Gatephan,Kijti Rodtes

2023-06-01

Abstract:In 2020, Cossu and Zanardo raised a conjecture on the idempotent factorization on singular matrices in the form $\begin{pmatrix} p&z\\ \bar{z}&\sfrac{\lVert z\rVert}{p} \end{pmatrix},$ where $p$ is a prime integer which is irreducible but not prime element in the ring of integers $\mathbb{Z}[\sqrt{D}]$ and $z\in\mathbb{Z}[\sqrt{D}]$ such that $\langle p,z\rangle$ is a non-principal ideal. In this paper, we provide some classes of matrices that affirm the conjecture and some classes of matrices that oppose the conjecture. We further show that there are matrices in the above form that can not be written as a product of two idempotent matrices.

Rings and Algebras
Factorisation of cross-symmetric, totally nonnegative matrices and an amazing matrix

T H Lenagan,A P Neate

DOI: https://doi.org/10.48550/arXiv.2011.06980

2020-11-13

Abstract:We establish a factorisation theorem for invertible, cross-symmetric, totally nonnegative matrices, and illustrate the theory by verifying that certain cases of Holte's Amazing Matrix are totally nonnegative.

Rings and Algebras
The secret life of matrix factorizations: how matrix decompositions reveal and keep secrets of linear equations and what we can do about it

Michał P. Karpowicz

2023-04-25

Abstract:This paper explores the relationship between matrix factorizations and linear matrix equations. It shows that every matrix factorization defines two hidden projectors, one for the column space and one for the row space of a matrix, and how to calculate them. The projectors can be applied to solve linear matrix equations, generate low-rank approximations, or design randomized matrix algorithms. But also, as demonstrated, they can be applied in cryptography to encrypt and decrypt messages. The paper discusses some of the security implications of this application and leaves some questions open for further investigation. The basic concepts are illustrated with source code listings. Finally, this work shares some personal reflections on the meaning and importance of understanding in the time of the artificial intelligence revolution.

Numerical Analysis,Cryptography and Security,Information Theory
Adaptive Factored Incomplete Inverse Matrices

Christos K. Filelis‐Papadopoulos

DOI: https://doi.org/10.1002/nla.2603

2024-11-27

Numerical Linear Algebra with Applications

Abstract:The solution of large sparse linear systems is an essential part in many scientific fields. Numerical solution of such systems is usually performed using iterative methods in conjunction with effective preconditioning schemes. A new class of factored approximate inverses is proposed, namely adaptive factored incomplete inverse matrices, which are computed using a recursive Schur complement‐based approach. This class of approximate inverses does not require the knowledge of a sparsity pattern, which is formed adaptively during computation. For this to be possible, a flexible sparse storage scheme was designed. Several numerical dropping strategies are showcased and discussed, along with the effects of reordering to the preconditioner density and the corresponding convergence behavior. Dropping based on monitoring the growth of elements in the incomplete LU factorization is also presented and discussed along with improvements during computation of the successive Schur complements. A static sparsity pattern variant is also provided and discussed. Implementation details and analysis, for computing the proposed scheme, are given along with the computational complexity and memory requirements. Numerical results depicting the effectiveness and applicability of the proposed scheme are also presented.

mathematics, applied

Matrix Factorizations via the Inverse Function Theorem

The Loewner-Neville Factorization Of Generalized Matrices With Consecutive-Column And -Row Properties

Exact QR factorizations of rectangular matrices

Complex matrix inversion via real matrix inversions

New Representations of the Group Inverse of 2×2 Block Matrices

Verified Error Bounds for Matrix Decompositions

Matrix Factorizations for Reversible Integer Mapping

On rank‐revealing QR factorizations of quaternion matrices

QR Factorization for Row or Column Symmetric Matrix

Tridiagonal and single-pair matrices and the inverse sum of two single-pair matrices

Application of quasideterminants to the inverse of block triangular matrices over noncommutative rings

Generalized elimination method and its applications to matrix factorizations

Necessary And Sufficient Conditions For Existence of the LU Factorization of an Arbitrary Matrix

Non-denseness of factorable matrix functions

Matrix-inversion Method: Applications to Möbius Inversion Adn Deconvolution.

Communication-optimal parallel and sequential QR and LU factorizations: theory and practice

Reverse Cholesky factorization and tensor products of nest algebras

Idempotent factorization on some matrices over quadratic integer rings

Factorisation of cross-symmetric, totally nonnegative matrices and an amazing matrix

The secret life of matrix factorizations: how matrix decompositions reveal and keep secrets of linear equations and what we can do about it

Adaptive Factored Incomplete Inverse Matrices