Abstract:The solution of coupled discrete-time Markovian jump Lyapunov matrix equations (CDMJLMEs) is important in stability analysis and controller design for Markovian jump linear systems. This paper presents a simple and effective iterative method to produce numerical solutions to this class of matrix equations. The gradient-based algorithm is developed from an optimization point of view. A necessary and sufficient condition guaranteeing the convergence of the algorithm is established. This condition shows that the algorithm always converges provided the CDMJLMEs have unique solutions which is evidently different from the existing results that converge conditionally. A simple sufficient condition which is easy to test is also provided. The optimal step size in the algorithm such that the convergence rate of the algorithm is maximized is given explicitly. It turns out that an upper bound of the convergence rate is bounded by a function of the condition number of the augmented coefficient matrix of the CDMJLMEs. Some parameters are introduced to the algorithm that will potentially reduce the condition number and thus increase the convergence rate of the algorithm. A numerical example is used to illustrate the efficiency of the proposed approach.

Iterative Solutions of Coupled Discrete Markovian Jump Lyapunov Equations

Delay-range-dependent and delay-distribution-independent stability criteria for discrete-time singular Markovian jump systems

New Iterative Algorithms for Solving Coupled Markovian Jump Lyapunov Equations

Finite Iterative Algorithm for Solving Coupled Lyapunov Equations Appearing in Continuous-Time Markov Jump Linear Systems.

Convergence of Gradient-Based Iterative Solution of Coupled Markovian Jump Lyapunov Equations.

Positive Operator Based Iterative Algorithms for Solving Lyapunov Equations for Itô Stochastic Systems with Markovian Jumps

Implicit Iterative Algorithms for Continuous Markovian Jump Lyapunov Equations

Iterative Algorithms for Solving Continuous Stochastic Lyapunov Equations

An Iterative Algorithm for Coupled Riccati Equations in Continuous-Time Markovian Jump Linear Systems

Accelerated Smith Iterative Algorithms for Coupled Lyapunov Matrix Equations

Asymptotic Stability of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps

A Novel Iterative Algorithm for Solving Coupled Riccati Equations

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

Delay-dependent Stabilization of Singular Markovian Jump Systems with State Delay

Stabilization of differential inclusion systems with Markovian jumping

Stochastic Stability Analysis of Markovian Jump Linear Systems with Incomplete Transition Descriptions

Delay-dependent Stability Analysis for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay

An Inversion-Free Iterative Algorithm for Riccati Matrix Equations in Discrete-Time Markov Jump Systems

Finite-time Stability and Stabilization of Markovian Jump Linear Systems Subject to Incomplete Transition Descriptions

An SOR Implicit Iterative Algorithm for Coupled Lyapunov Equations.

Stabilization of Discrete-Time Singular Markov Jump Systems With Repeated Scalar Nonlinearities