Abstract:This paper studies the iterative solutions of Lyapunov matrix equations associated with Itô stochastic systems having Markovian jump parameters. For the discrete-time case, when the associated stochastic system is mean square stable, two iterative algorithms with one in direct form and the other one in implicit form are established. The convergence of the implicit iteration is proved by the properties of some positive operators associated with the stochastic system. For the continuous-time case, a transformation is first performed so that it is transformed into an equivalent discrete-time Lyapunov equation. Then the iterative solution can be obtained by applying the iterative algorithm developed for discrete-time Lyapunov equation. Similar to the discrete-time case, an implicit iteration is also proposed for the continuous case. For both discrete-time and continuous-time Lyapunov equations, the convergence rates of the established algorithms are analyzed and compared. Numerical examples are worked out to validate the effectiveness of the proposed algorithms.

A Successive over Relaxation Implicit Iterative Algorithm for Solving Stochastic Linear Systems with Markov Jumps

An SOR Implicit Iterative Algorithm for Coupled Lyapunov Equations.

Iterative Algorithms for Solving Continuous Stochastic Lyapunov Equations

An SOR implicit iterative algorithm for coupled Riccati matrix equations in It stochastic systems with Markovian jump

Positive Operator Based Iterative Algorithms for Solving Lyapunov Equations for Itô Stochastic Systems with Markovian Jumps

An Iterative Algorithm for Coupled Riccati Equations in Continuous-Time Markovian Jump Linear Systems

Implicit Iterative Algorithms for Continuous Markovian Jump Lyapunov Equations

A Novel Iterative Algorithm for Solving Coupled Riccati Equations

Iterative Algorithms with the Latest Update for Riccati Matrix Equations in Itô Markov Jump Systems

Finite Iterative Algorithm for Solving Coupled Lyapunov Equations Appearing in Continuous-Time Markov Jump Linear Systems.

Data-driven Policy Iteration Algorithm for Optimal Control of Continuous-Time Itô Stochastic Systems with Markovian Jumps

New Iterative Algorithms for Solving Coupled Markovian Jump Lyapunov Equations

An Iterative Algorithm with a Tuning Parameter for Continuous Lyapunov Matrix Equations

Implicit Iterative Algorithms with a Tuning Parameter for Discrete Stochastic Lyapunov Matrix Equations

Successive over Relaxation for Model-Free LQR Control of Discrete-Time Markov Jump Systems

Two Iterative Algorithms for Stochastic Algebraic Riccati Matrix Equations.

An Inversion-Free Iterative Algorithm with a Scalar Tuning Parameter for Coupled Riccati Matrix Equations Arising in LQ Optimal Control of Markov Jump Systems

A novel implicit iterative algorithm for solving the generalized Lyapunov equation

An improved iterative algorithm for solving optimal tracking control problems of stochastic systems

General Lyapunov-Based Iterative Algorithm for Linear Quadratic Regulator Problem of Stochastic Systems with Markovian Jump

Finite-Time Stability for Markovian Jump Nonlinear Systems with Random Delays