Accurate Computation of Exponentials of Triangular Essentially Non-negative Matrices

DENG Li-jun,XUE Jun-gong

DOI: https://doi.org/10.15943/j.cnki.fdxb-jns.2011.01.010

2011-01-01

Abstract:A square matrix is called essentially non-negative if all its off-diagonal entries are non-negative.An algorithm to compute the exponential of a triangular essentially non-negative matrix to high relative accuracy in entrywise sense is presented.

What problem does this paper attempt to address?

Computing exponentials of essentially non-negative matrices entrywise to high relative accuracy.

Jungong Xue,Qiang Ye

DOI: https://doi.org/10.1090/S0025-5718-2013-02677-4

IF: 2.118

2013-01-01

Mathematics of Computation

Abstract:A real square matrix is said to be essentially non-negative if all of its off-diagonal entries are non-negative. It has recently been shown that the exponential of an essentially non-negative matrix is determined entrywise to high relative accuracy by its entries up to a condition number intrinsic to the exponential function (Numer. Math. 110 (2008), 393-403). Thus the smaller entries of the exponential may be computed to the same relative accuracy as the bigger entries. This paper develops algorithms to compute exponentials of essentially non-negative matrices entrywise to high relative accuracy.
Aggressively Truncated Taylor Series Method For Accurate Computation Of Exponentials Of Essentially Nonnegative Matrices

Meiyue Shao,Weiguo Gao,Jungong Xue

DOI: https://doi.org/10.1137/120894294

IF: 1.908

2014-01-01

SIAM Journal on Matrix Analysis and Applications

Abstract:Small relative perturbations to the entries of an essentially nonnegative matrix introduce small relative errors to entries of its exponential. It is thus desirable to compute the exponential with high componentwise relative accuracy. Taylor series approximation coupled with scaling and squaring is used to compute the exponential of an essentially nonnegative matrix. An a priori componentwise relative error bound of truncation is established, from which one can choose the degree of Taylor series expansion and the scale factor so that the exponential is computed with desired componentwise relative accuracy. To reduce the computational cost, the degree of the Taylor series expansion is chosen small, while the scale factor is chosen sufficiently large to achieve the desired accuracy. The rounding errors in the squaring stage are not serious as squaring is forward stable for nonnegative matrices. We also establish a posteriori componentwise error bounds and derive a novel interval algorithm for the matrix exponential of an essentially nonnegative matrix. Rounding error analysis and numerical experiments demonstrate the efficiency and accuracy of the proposed methods.
Dense and Structured Matrix Computations —the Parallel QR Algorithm and Matrix Exponentials

Meiyue Shao

2013-01-01

Abstract:This thesis is concerned with two classical topics in matrix computations : The QR algorithm for solving nonsymmetric eigenvalue problems and the computation of matrix exponentials for two types of structured matrices. We focus on the performance in the former topic and on accuracy in the latter one. For computing all eigenvalues of a non-Hermitian matrix, the QR algorithm which iteratively computes a Schur decomposition of the matrix is the method of choice. We present a new parallel implementation of the multishift QR algorithm targeting distributed memory architectures. Starting from recent developments of the parallel multishift QR algorithm, we propose a number of algorithmic and implementation improvements. Guidelines concerning several important tunable algorithmic parameters are also provided. Numerous computational experiments confirm that our new implementation significantly outperforms previous parallel implementations of the QR algorithm. The computation of the exponential of a square matrix is also an important task in matrix computations. For a general dense matrix, the scaling and squaring method coupled with Pade approximation is the most popular approach. However, for an essentially nonnegative matrix (a real square matrix with nonnegative off-diagonal entries), truncated Taylor series rather than Pade approximation is preferred to achieve componentwise accuracy in the matrix exponential. We propose a method which efficiently computes all entries of the exponential of an essentially nonnegative matrix to high relative accuracy. Truncation and rounding error bounds, as well as numerical experiments demonstrate the efficiency and accuracy of our method. When the matrix is banded, the entries of its matrix exponential decay exponentially away from the main diagonal. We analyze the decay property for the exponentials of several classes of doubly-infinite skew-Hermitian matrices. Then finite section methods based on the decay property are established. We also propose a repeated doubling strategy which works well even when a priori error estimates are pessimistic or not easy to compute. Finally, numerical experiments are presented to illustrate the effectiveness of the finite section method.
Generalizing the Fréchet Derivative Algorithm for the Matrix Exponential

Awad H. Al-Mohy

2024-10-05

Abstract:The computation of off-diagonal blocks of matrix functions $f(T)$, where $T$ is block triangular, poses a challenging problem in scientific computing. We present a novel algorithm that exploits the structure of block triangular matrices, generalizing the algorithm of Al-Mohy and Higham for computing the Fréchet derivative of the matrix exponential. This work has significant applications in fields such as exponential integrators for solving systems of first-order differential equations, Hamiltonian linear systems in control theory, and option pricing in finance. Our approach introduces a linear operator that maps off-diagonal blocks of $T$ into their counterparts in $f(T)$. By studying the algebraic properties of the operator, we establish a comprehensive computational framework, paving the way to extend existing Fréchet derivative algorithms of matrix functions to more general settings. For the matrix exponential, in particular, the algorithm employs the scaling and squaring method with diagonal Padé approximants to $\exp(x)$, with parameters chosen based on a rigorous backward error analysis, which notably does not depend on the norm of the off-diagonal blocks. The numerical experiment demonstrates that our algorithm surpasses existing algorithms in terms of accuracy and efficiency, making it highly valuable for a wide range of applications.

Numerical Analysis
Efficient scaling and squaring method for the matrix exponential

Sergio Blanes,Nikita Kopylov,Muaz Seydaoğlu

2024-04-19

Abstract:This work presents a new algorithm to compute the matrix exponential within a given tolerance. Combined with the scaling and squaring procedure, the algorithm incorporates Taylor, partitioned and classical Padé methods shown to be superior in performance to the approximants used in state-of-the-art software. The algorithm computes matrix--matrix products and also matrix inverses, but it can be implemented to avoid the computation of inverses, making it convenient for some problems. If the matrix A belongs to a Lie algebra, then exp(A) belongs to its associated Lie group, being a property which is preserved by diagonal Padé approximants, and the algorithm has another option to use only these. Numerical experiments show the superior performance with respect to state-of-the-art implementations.

Numerical Analysis
A technique for improving the computation of functions of triangular matrices

Jo ao R. Cardoso,Amir Sadeghi,Jo ao R. Cardoso

DOI: https://doi.org/10.1080/00207160.2022.2067751

IF: 1.75

2022-04-29

International Journal of Computer Mathematics

Abstract:We propose a simple technique that, if combined with algorithms for computing functions of triangular matrices, can make them more efficient. Basically, such a technique consists in a specific scaling similarity transformation that reduces the departure from normality of a triangular matrix, thus decreasing its norm and in general its function condition number. It can easily be extended to non-triangular matrices, provided that it is combined with algorithms involving a prior Schur decomposition. Situations where the technique should be used or not will be discussed in detail. Special attention is devoted to particular algorithms like the inverse scaling and squaring to the matrix logarithm or inverse cosine and the scaling and squaring to the matrix exponential. The advantages of our proposal are supported by theoretical results and illustrated with numerical experiments, involving matrices of small, medium and large size.

mathematics, applied
The sensitivity of the exponential of an essentially nonnegative matrix

Weifang Zhu,Jungong Xue,Weiguo Gao

2008-01-01

Journal of Computational Mathematics

Abstract:This paper performs perturbation analysis for the exponential of an essentially nonnegative matrix which is perturbed in the way that each entry has a small relative perturbation. For a general essentially nonnegative matrix, we obtain an upper bound for the relative error in 2-norm, which is sharper than the existing perturbation results. For a triangular essentially nonnegative matrix, we obtain an upper bound for the relative error in entrywise sense. This bound indicates that, if the spectral radius of an essentially nonnegative matrix is not large, then small entrywise relative perturbations cause small relative error in each entry of its exponential. Finally, we apply our perturbation results to the sensitivity analysis of RC networks and complementary distribution functions of phase-type distributions.
Computing the exponential of matrices

Hon-Wing Cheng,Yau, S.S.-T.

DOI: https://doi.org/10.1109/ACC.1994.735241

1994-01-01

Abstract:The following differential equation plays a fundamental role in the study of dynamical systems and linear systems: x˙=Ax; x(0)=x0; 0≤t<∞, where x and x0 are n-vectors and A is an nxn matrix of complex constants. The theoretical solution to this equation is given by x(t)=etAx0. In this paper, we discuss an algebraic method for computing etA and give explicit formular for n=3.
Entrywise relative perturbation bounds for exponentials of essentially non-negative matrices

Jungong Xue,Qiang Ye

DOI: https://doi.org/10.1007/s00211-008-0167-5

IF: 2.5

2008-01-01

Numerische Mathematik

Abstract:A real square matrix is said to be essentially non-negative if all of its off-diagonal entries are non-negative. We establish entrywise relative perturbation bounds for the exponential of an essentially non-negative matrix. Our bounds are sharp and contain a condition number that is intrinsic to the exponential function. As an application, we study sensitivity of continuous-time Markov chains.
Combinatorial and Recurrent Approaches for Efficient Matrix Inversion: Sub-cubic algorithms leveraging Fast Matrix products

Mohamed Kamel Riahi

2023-07-15

Abstract:In this paper, we introduce novel fast matrix inversion algorithms that leverage triangular decomposition and recurrent formalism, incorporating Strassen's fast matrix multiplication. Our research places particular emphasis on triangular matrices, where we propose a novel computational approach based on combinatorial techniques for finding the inverse of a general non-singular triangular matrix. Unlike iterative methods, our combinatorial approach for (block) triangular-type matrices enables direct computation of the matrix inverse through a nonlinear combination of carefully selected combinatorial entries from the initial matrix. This unique characteristic makes our proposed method fully parallelizable, offering significant potential for efficient implementation on parallel computing architectures. Our approach demonstrates intriguing features that allow the derivation of recurrent relations for constructing the matrix inverse. By combining the (block) combinatorial approach, with a recursive triangular split method for inverting triangular matrices, we develop potentially competitive algorithms that strike a balance between efficiency and accuracy. We provide rigorous mathematical proofs of the newly presented method. Additionally, we conduct extensive numerical tests to showcase its applicability and efficiency. The comprehensive evaluation and experimental results presented in this paper confirm the practical utility of our proposed algorithms, demonstrating their superiority over classical approaches in terms of computational efficiency.

Numerical Analysis,Combinatorics
An alternative recursive approach to functions of simple triangular matrices

Ellen Baake,Michael Baake

2024-05-13

Abstract:The computation of matrix functions is a well-studied problem. Of special importance are the exponential and the logarithm of a matrix, where the latter also raises existence and uniqueness questions. This is particularly relevant in the context of matrix semigroups and their generators. Here, we look at matrix functions of triangular matrices, where a recursive approach is possible when the matrix has simple spectrum. The special feature is that no knowledge of eigenvectors is required, and that the same recursion applies to the computation of multiple functions or semigroups simultaneously.

Rings and Algebras
On the inverses of general tridiagonal matrices

Hou-Biao Li,Ting-Zhu Huang,Xing-Ping Liu,Hong Li

DOI: https://doi.org/10.1016/j.laa.2010.04.042

IF: 1.307

2010-01-01

Linear Algebra and its Applications

Abstract:In this work, the sign distribution for all inverse elements of general tridiagonal H-matrices is presented. In addition, some computable upper and lower bounds for the entries of the inverses of diagonally dominant tridiagonal matrices are obtained. Based on the sign distribution, these bounds greatly improve some well-known results due to Ostrowski (1952) 23, Shivakumar and Ji (1996) 26, Nabben (1999) [21], [22] and recently given by Peluso and Politi (2001) 24, Peluso and Popolizio (2008) 25 and so forth. It is also stated that the inverse of a general tridiagonal matrix may be described by 2n-2 parameters ({θk}k=2n and {φk}k=1n-1) instead of 2n+2 ones as given by El-Mikkawy (2004) 3, El-Mikkawy and Karawia (2006) 4 and Huang and McColl (1997) 10. According to these results, a new symbolic algorithm for finding the inverse of a tridiagonal matrix without imposing any restrictive conditions is presented, which improves some recent results. Finally, several applications to the preconditioning technology, the numerical solution of differential equations and the birth–death processes together with numerical tests are given.
Computation of the exponential function of matrices by a formula without oscillatory integrals on infinite intervals

Masato Suzuki,Ken'ichiro Tanaka

2024-11-28

Abstract:We propose a quadrature-based formula for computing the exponential function of matrices with a non-oscillatory integral on an infinite interval and an oscillatory integral on a finite interval. In the literature, existing quadrature-based formulas are based on the inverse Laplace transform or the Fourier transform. We show these expressions are essentially equivalent in terms of complex integrals and choose the former as a starting point to reduce computational cost. By choosing a simple integral path, we derive an integral expression mentioned above. Then, we can easily apply the double-exponential formula and the Gauss-Legendre formula, which have rigorous error bounds. As numerical experiments show, the proposed formula outperforms the existing formulas when the imaginary parts of the eigenvalues of matrices have large absolute values.

Numerical Analysis
High-Performance Computation of the Exponential of a Large Sparse Matrix

Feng Wu,Kailing Zhang,Li Zhu,Jiayao Hu

DOI: https://doi.org/10.1137/20M1342987

IF: 1.908

2021-12-08

SIAM Journal on Matrix Analysis and Applications

Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 42, Issue 4, Page 1636-1655, January 2021. Computation of the large sparse matrix exponential has been an important topic in many fields, such as network and finite-element analysis. The existing scaling and squaring algorithm (SSA) is not suitable for the computation of the large sparse matrix exponential as it requires more memory and has a higher computational cost than is actually needed. By introducing two novel concepts, i.e., real bandwidth and bandwidth, to measure the sparsity of the matrix, the sparsity of the matrix exponential is analyzed. It is found that for every matrix computed in the squaring phase of the SSA, a corresponding sparse approximate matrix exists. To obtain the sparse approximate matrix, a new filtering technique based on forward error analysis is proposed. Combining the filtering technique with the idea of keeping track of the incremental part, a competitive algorithm is developed for the large sparse matrix exponential. Due to the filtering technique, the proposed method can greatly alleviate the overscaling problem. Three sets of numerical experiments, including one large matrix with a dimension larger than , are conducted. The numerical experiments show that, compared with the expm function in MATLAB, the proposed algorithm can provide higher accuracy at lower computational cost and with less memory.

mathematics, applied
Computing the matrix fractional power with the double exponential formula

Fuminori Tatsuoka,Tomohiro Sogabe,Yuto Miyatake,Tomoya Kemmochi,Shao-Liang Zhang

DOI: https://doi.org/10.1553/etna_vol54s558

2021-04-10

Abstract:Two quadrature-based algorithms for computing the matrix fractional power $A^\alpha$ are presented in this paper. These algorithms are based on the double exponential (DE) formula, which is well-known for its effectiveness in computing improper integrals as well as in treating nearly arbitrary endpoint singularities. The DE formula transforms a given integral into another integral that is suited for the trapezoidal rule; in this process, the integral interval is transformed to the infinite interval. Therefore, it is necessary to truncate the infinite interval into an appropriate finite interval. In this paper, a truncation method, which is based on a truncation error analysis specialized to the computation of $A^\alpha$, is proposed. Then, two algorithms are presented -- one computes $A^\alpha$ with a fixed number of abscissas, and the other computes $A^\alpha$ adaptively. Subsequently, the convergence rate of the DE formula for Hermitian positive definite matrices is analyzed. The convergence rate analysis shows that the DE formula converges faster than the Gaussian quadrature when $A$ is ill-conditioned and $\alpha$ is a non-unit fraction. Numerical results show that our algorithms achieved the required accuracy and were faster than other algorithms in several situations.

Numerical Analysis
Computation of Large-Dimension Jordan Normal Transform Via Popular Platforms

Shi Chunxiao,Chen Yong-Cong,Xiong Xia,Ao Ping

DOI: https://doi.org/10.1007/s44198-023-00108-6

2023-01-01

Journal of Nonlinear Mathematical Physics

Abstract:We address the practical issue that popular computation platforms like Matlab $$^{\copyright }$$ are unable to perform the Jordan normal (canonical) form J and the associated transform matrix P on a high-dimension matrix. Given the knowledge of the eigenvalues and eigenvectors of n-square matrix A obtained on these platforms, we present an efficient algorithm of Jordan transform with detailed computation steps. The efficiency is demonstrated by comparing the simulation results of 11 examples with varying orders of n to that computed by the symbolic-based and capacity-limited routine $$[P, J] = {\textsf {jordan}}(A)$$ in Matlab $$^{\copyright }$$ . Applications in stochastic dynamics are addressed.
Highly Accurate Doubling Algorithms for M -Matrix Algebraic Riccati Equations

Jungong Xue,Ren-Cang Li

DOI: https://doi.org/10.1007/s00211-016-0815-0

IF: 2.5

2016-01-01

Numerische Mathematik

Abstract:The doubling algorithms are very efficient iterative methods for computing the unique minimal nonnegative solution to an M-matrix algebraic Riccati equation (MARE). They are globally and quadratically convergent, except for MARE in the critical case where convergence is linear with the linear rate 1 / 2. However, the initialization phase and the doubling iteration kernel of any doubling algorithm involve inverting nonsingular M-matrices. In particular, for MARE in the critical case, the M-matrices in the doubling iteration kernel, although nonsingular, move towards singular M-matrices at convergence. These inversions are causes of concerns on entrywise relative accuracy of the eventually computed minimal nonnegative solution. Fortunately, a nonsingular M-matrix can be inverted by the GTH-like algorithm of Alfa et al. (Math Comp 71:217-236, 2002) to almost full entrywise relative accuracy, provided a triplet representation of the matrix is known. Recently, Nguyen and Poloni (Numer Math 130(4):763-792, 2015) discovered a way to construct triplet representations in a cancellation-free manner for all involved M-matrices in the doubling iteration kernel, for a special class of MAREs arising from Markov-modulated fluid queues. In this paper, we extend Nguyen's and Poloni's work to all MAREs by also devising a way to construct the triplet representations cancellation-free. Our construction, however, is not a straightforward extension of theirs. It is made possible by an introduction of novel recursively computable auxiliary nonnegative vectors. As the second contribution, we propose an entrywise relative residual for an approximate solution. The residual has an appealing feature of being able to reveal the entrywise relative accuracies of all entries, large and small, of the approximation. This is in marked contrast to the usual legacy normalized residual which reflects relative accuracies of large entries well but not so much those of very tiny entries. Numerical examples are presented to demonstrate and confirm our claims.
More Explicit Formulas for the Matrix Exponential

Hon-Wing Cheng,Stephen S.-T. Yau

DOI: https://doi.org/10.1016/s0024-3795(97)80028-6

IF: 1.307

1997-01-01

Linear Algebra and its Applications

Abstract:The matrix exponential plays an important role in the study of dynamical systems and linear systems. An elementary method is discussed for computing etA for general A ∈ Cn × n. It is shown that this method can be applied to generate explicit formulas for etA in various forms. Using this method, some well-known formulas are rederived, and some new formulas are also derived. As applications, explicit formulas for n = 3 or n = 4 are given. In each case, a characterization of etA is also made, based on the entries of A alone.
Zero-sum Triangles for Involutory, Idempotent, Nilpotent and Unipotent Matrices

Pengwei Hao,Chao Zhang,Huahan Hao

DOI: https://doi.org/10.1016/j.rinam.2022.100238

2022-01-01

Results in Applied Mathematics

Abstract:In some matrix formations, factorizations and transformations, we need special matrices with some properties and we wish that such matrices should be easily and simply generated and of integers. In this paper, we propose a zero-sum rule for the recurrence relations to construct integer triangles as triangular matrices with involutory, idempotent, nilpotent and unipotent properties, especially nilpotent and unipotent matrices of index 2. With the zero-sum rule we also give the conditions for the special matrices and the generic methods for the generation of those special matrices. Some of the generated integer triangles have been found by other methods, but most of them are newly discovered, and many combinatorial identities can be found with them. The results may also interest the economists for trading analysis and simulation.
An Algorithm of Improving the Consistence of the Positive Reciprocal Matrix Based on Relative Error.

Qiuhong Fan,Baoxiang Liu,Yuhuan Zhang,Ruiying Zhou

DOI: https://doi.org/10.1007/978-3-642-25255-6_23

2011-01-01

Abstract:By analyzing the inconsistent relationship between the small triangular matrix and positive reciprocal matrix, a convenient correction method based on the relative error is brought up. This method can fully retain the effective information of original positive reciprocal matrix. It helps people to solve practical problems effectively and enriches the theories and methods of decision analysis.

Accurate Computation of Exponentials of Triangular Essentially Non-negative Matrices

Computing exponentials of essentially non-negative matrices entrywise to high relative accuracy.

Aggressively Truncated Taylor Series Method For Accurate Computation Of Exponentials Of Essentially Nonnegative Matrices

Dense and Structured Matrix Computations —the Parallel QR Algorithm and Matrix Exponentials

Generalizing the Fréchet Derivative Algorithm for the Matrix Exponential

Efficient scaling and squaring method for the matrix exponential

A technique for improving the computation of functions of triangular matrices

The sensitivity of the exponential of an essentially nonnegative matrix

Computing the exponential of matrices

Entrywise relative perturbation bounds for exponentials of essentially non-negative matrices

Combinatorial and Recurrent Approaches for Efficient Matrix Inversion: Sub-cubic algorithms leveraging Fast Matrix products

An alternative recursive approach to functions of simple triangular matrices

On the inverses of general tridiagonal matrices

Computation of the exponential function of matrices by a formula without oscillatory integrals on infinite intervals

High-Performance Computation of the Exponential of a Large Sparse Matrix

Computing the matrix fractional power with the double exponential formula

Computation of Large-Dimension Jordan Normal Transform Via Popular Platforms

Highly Accurate Doubling Algorithms for M -Matrix Algebraic Riccati Equations

More Explicit Formulas for the Matrix Exponential

Zero-sum Triangles for Involutory, Idempotent, Nilpotent and Unipotent Matrices

An Algorithm of Improving the Consistence of the Positive Reciprocal Matrix Based on Relative Error.