Abstract:In this paper, the infinite time horizon linear quadratic optimal control problem is investigated for the continuous-time Ito stochastic Markovian jump linear systems (MJESs) with time-varying transition rates. It is assumed that the time-varying transition rates of the MJLSs possess piecewise homogeneous time-varying property, which implies that the transition rates are time-varying in the whole time domain but they are time-invariant in some small time intervals. The variations of the transition rates in these small time intervals are considered to be in two cases: arbitrary variation and stochastic variation. With this, the considered system becomes a piecewise homogeneous Ito stochastic MJLS. The main contribution of this paper is that two linear quadratic optimal controllers in infinite time horizon are proposed for the above modeled continuous-time piecewise homogeneous Ito stochastic MJLS in the sense of arbitrary variation and stochastic variation, respectively. Moreover, the sufficient and necessary conditions for the existence of the designed controllers are established based on the existence of the unique positive definite solution of two coupled algebraic Riccati matrix equations. Finally, a simulation example is provided to illustrate the effectiveness of the proposed linear quadratic optimal controllers. (C) 2020 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.

Linear quadratic optimal control for a class of continuous-time nonhomogeneous Markovian jump linear systems in infinite time horizon

Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Linear Quadratic Optimal Control for Discrete-time Markov Jump Linear Systems.

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

A Stochastic Linear-Quadratic Optimal Control Problem with Jumps in an Infinite Horizon

Linear Quadratic Optimal Control of Infinite Dimensional Stochastic Evolution Equation with Jumps

Linear quadratic regulation of polytopic time-inhomogeneous Markov jump linear systems (extended version)

H∞ Control of a Class of Piecewise Homogeneous Markov Jump Linear Systems

Linear Quadratic Optimal Control of Discrete-Time Stochastic Systems Driven by Homogeneous Markov Processes

ROBUST H∞ CONTROL OF UNCERTAIN MARKOVIAN JUMP LINEAR SYSTEMS WITH MODE-DEPENDENT TIME-DELAYS

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

New approach to delay-dependent H∞ control for continuous-time Markovian jump systems with time-varying delay and deficient transition descriptions

H∞ Control of Time-Delay State Feedback Markovian Jump Linear Systems with Uncertain Transition Rates

Infinite Horizon Mean-Field Linear Quadratic Optimal Control Problems with Jumps and the Related Hamiltonian Systems

Optimal Stabilization Control for Discrete-time Markov Jump Linear System with Control Input Delay

Stability and Stabilisation of Itô Stochastic Systems with Piecewise Homogeneous Markov Jumps

Linear quadratic optimal control problems of infinite‐dimensional mean‐field type with jumps

Infinite horizon H∞ control for nonlinear stochastic Markov jump systems with (x,u,v)-dependent noise via fuzzy approach

Stochastic linear quadratic optimal control problems with regime-switching jumps in infinite horizon