Abstract:The solution of coupled discrete-time Markovian jump Lyapunov matrix equations (CDMJLMEs) is important in stability analysis and controller design for Markovian jump linear systems. This paper presents a simple and effective iterative method to produce numerical solutions to this class of matrix equations. The gradient-based algorithm is developed from an optimization point of view. A necessary and sufficient condition guaranteeing the convergence of the algorithm is established. This condition shows that the algorithm always converges provided the CDMJLMEs have unique solutions which is evidently different from the existing results that converge conditionally. A simple sufficient condition which is easy to test is also provided. The optimal step size in the algorithm such that the convergence rate of the algorithm is maximized is given explicitly. It turns out that an upper bound of the convergence rate is bounded by a function of the condition number of the augmented coefficient matrix of the CDMJLMEs. Some parameters are introduced to the algorithm that will potentially reduce the condition number and thus increase the convergence rate of the algorithm. A numerical example is used to illustrate the efficiency of the proposed approach.

Weighted Steepest Descent Method for Solving Matrix Equations

Gradient Based Iterative Algorithm for Solving Coupled Matrix Equations

Numerical Solution to Linear Matrix Equation by Finite Steps Iteration

Weighted least squares solutions to general coupled Sylvester matrix equations

Iterative algorithm for minimal norm least squares solution to general linear matrix equations

Gradient-based Maximal Convergence Rate Iterative Method for Solving Linear Matrix Equations

Coupled Iterative Algorithms Based on Optimisation for Solving Sylvester Matrix Equations

Two Iterative Algorithms for Stochastic Algebraic Riccati Matrix Equations.

Current-Estimation-Based Iterative Algorithms for Solving Periodic Lyapunov Matrix Equations

Finite iterative solutions to coupled Sylvester-conjugate matrix equations

Iterative Algorithms for Solving Continuous Stochastic Lyapunov Equations

Explicit Iterative Algorithms for Continuous Coupled Lyapunov Matrix Equations.

Positive Operator Based Iterative Algorithms for Solving Lyapunov Equations for Itô Stochastic Systems with Markovian Jumps

Solution to matrix equation with applications

Convergence of Gradient-Based Iterative Solution of Coupled Markovian Jump Lyapunov Equations.

Gradient-based iterative approach for solving constrained systems of linear matrix equations

Accelerated Smith Iterative Algorithms for Coupled Lyapunov Matrix Equations

A Novel Iterative Algorithm for Solving Coupled Riccati Equations

Low-Rank Methods for Solving Discrete-Time Projected Lyapunov Equations

On the Iterative Methods for the Solution of Three Types of Nonlinear Matrix Equations

An Inversion-Free Iterative Algorithm with a Scalar Tuning Parameter for Coupled Riccati Matrix Equations Arising in LQ Optimal Control of Markov Jump Systems