Abstract:In this paper, the infinite time horizon linear quadratic optimal control problem is investigated for the continuous-time Ito stochastic Markovian jump linear systems (MJESs) with time-varying transition rates. It is assumed that the time-varying transition rates of the MJLSs possess piecewise homogeneous time-varying property, which implies that the transition rates are time-varying in the whole time domain but they are time-invariant in some small time intervals. The variations of the transition rates in these small time intervals are considered to be in two cases: arbitrary variation and stochastic variation. With this, the considered system becomes a piecewise homogeneous Ito stochastic MJLS. The main contribution of this paper is that two linear quadratic optimal controllers in infinite time horizon are proposed for the above modeled continuous-time piecewise homogeneous Ito stochastic MJLS in the sense of arbitrary variation and stochastic variation, respectively. Moreover, the sufficient and necessary conditions for the existence of the designed controllers are established based on the existence of the unique positive definite solution of two coupled algebraic Riccati matrix equations. Finally, a simulation example is provided to illustrate the effectiveness of the proposed linear quadratic optimal controllers. (C) 2020 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.

Mean-field Stochastic Linear–quadratic Optimal Control with Markov Jump Parameters

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Mean-Field Stochastic Linear Quadratic Optimal Control for Jump-Diffusion Systems with Hybrid Disturbances

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Infinite Horizon Mean-Field Linear Quadratic Optimal Control Problems with Jumps and the Related Hamiltonian Systems

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Linear quadratic optimal control problems of infinite‐dimensional mean‐field type with jumps

Robust control for uncertain systems with time-delay and jump parameters*

Stochastic linear-quadratic optimal control problems with multi-dimensional state and non-Markovian regime switching

Finite-time L2−l∞ Tracking Control for Markov Jump Repeated Scalar Nonlinear Systems with Partly Usable Model Information

Stochastic linear-quadratic optimal control problems with non-Markovian regime switching

Discrete Time Mean-Field Stochastic Linear-Quadratic Optimal Control Problems

Stochastic Stability and Stabilization of Positive Systems with Markovian Jump Parameters

Networked guaranteed cost control for uncertain discrete-time markovian jump linear systems

Quantized Control of Markov Jump Nonlinear Systems Based on Fuzzy Hidden Markov Model.

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Linear quadratic regulation of polytopic time-inhomogeneous Markov jump linear systems (extended version)

A Class of Discrete-time Mean-field Stochastic Linear-quadratic Optimal Control Problems with Financial Application

Optimal Controls of Stochastic Differential Equations with Jumps and Random Coefficients: Stochastic Hamilton–Jacobi–Bellman Equations with Jumps

Linear quadratic optimal control for a class of continuous-time nonhomogeneous Markovian jump linear systems in infinite time horizon