Abstract:In this paper, the infinite time horizon linear quadratic optimal control problem is investigated for the continuous-time Ito stochastic Markovian jump linear systems (MJESs) with time-varying transition rates. It is assumed that the time-varying transition rates of the MJLSs possess piecewise homogeneous time-varying property, which implies that the transition rates are time-varying in the whole time domain but they are time-invariant in some small time intervals. The variations of the transition rates in these small time intervals are considered to be in two cases: arbitrary variation and stochastic variation. With this, the considered system becomes a piecewise homogeneous Ito stochastic MJLS. The main contribution of this paper is that two linear quadratic optimal controllers in infinite time horizon are proposed for the above modeled continuous-time piecewise homogeneous Ito stochastic MJLS in the sense of arbitrary variation and stochastic variation, respectively. Moreover, the sufficient and necessary conditions for the existence of the designed controllers are established based on the existence of the unique positive definite solution of two coupled algebraic Riccati matrix equations. Finally, a simulation example is provided to illustrate the effectiveness of the proposed linear quadratic optimal controllers. (C) 2020 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.

Linear Quadratic Optimal Control of Infinite Dimensional Stochastic Evolution Equation with Jumps

A Stochastic Linear-Quadratic Optimal Control Problem with Jumps in an Infinite Horizon

Linear quadratic optimal control problems of infinite‐dimensional mean‐field type with jumps

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Linear‐Quadratic Optimal Control Problems for Mean‐Field Stochastic Differential Equations with Jumps

Optimal Control with State Constraints for Stochastic Evolution Equation with Jumps in Hilbert Space

Infinite Horizon Mean-Field Linear Quadratic Optimal Control Problems with Jumps and the Related Hamiltonian Systems

A Mean-Field Stochastic Linear-Quadratic Optimal Control Problem with Jumps under Partial Information

Indefinite Stochastic Linear-Quadratic Optimal Control Problems with Random Jumps and Related Stochastic Riccati Equations

Linear quadratic optimal control problems for stochastic evolution equations in infinite horizon

General Linear Quadratic Optimal Stochastic Control Problem Driven by a Brownian Motion and a Poisson Random Martingale Measure with Random Coefficients

Optimal Controls of Stochastic Differential Equations with Jumps and Random Coefficients: Stochastic Hamilton–Jacobi–Bellman Equations with Jumps

Stochastic Evolution Equations of Jump Type with Random Coefficients: Existence, Uniqueness and Optimal Control.

Infinite time horizon stochastic recursive control problems with jumps: dynamic programming and stochastic verification theorems

Finite Horizon H2∕H∞ Control for SDEs with Infinite Markovian Jumps

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Linear quadratic optimal control for a class of continuous-time nonhomogeneous Markovian jump linear systems in infinite time horizon

Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Nonlinear Stochastic H∞ Control with Markov Jumps and (x,u,v)-Dependent Noise: Finite and Infinite Horizon Cases

Optimal Feedback Controls of Stochastic Linear Quadratic Control Problems in Infinite Dimensions with Random Coefficients