Abstract:In this paper, a stochastic linear-quadratic (LQ, for short) optimal control problem with jumps in an infinite horizon is studied, where the state system is a controlled linear stochastic differential equation containing affine term driven by a one-dimensional Brownian motion and a Poisson stochastic martingale measure, and the cost functional with respect to the state process and control process is quadratic and contains cross terms. Firstly, in order to ensure the well-posedness of our stochastic optimal control of infinite horizon with jumps, the $ L^2 $-stabilizability of our control system with jump is introduced. Secondly, it is proved that the $ L^2 $-stabilizability of our control system with jump is equivalent to the non-emptiness of the admissible control set for all initial state and is also equivalent to the existence of a positive solution to some integral algebraic Riccati equation (ARE, for short). Thirdly, the equivalence of the open-loop and closed-loop solvability of our infinite horizon optimal control problem with jumps is systematically studied. The corresponding equivalence is established by the existence of a $ stabilizing\ solution $ of the associated generalized algebraic Riccati equation, which is different from the finite horizon case. Moreover, any open-loop optimal control for the initial state $ x $ admiting a closed-loop representation is obatined.

Stochastic LQ optimal control for Markov jumping systems with multiplicative noise using reinforcement learning

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Finite-time L2−l∞ Tracking Control for Markov Jump Repeated Scalar Nonlinear Systems with Partly Usable Model Information

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Model-free optimal controller for discrete-time Markovian jump linear systems: A Q-learning approach

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

H∞ optimal output tracking control for Markov jump systems: A reinforcement learning‐based approach

A Neural Network Based Online Learning and Control Approach for Markov Jump Systems

Average Cost Optimal Control of Stochastic Systems Using Reinforcement Learning

Model-free Optimal Control of Discrete-Time Systems with Additive and Multiplicative Noises

Optimal tracking control for completely unknown nonlinear discrete-time Markov jump systems using data-based reinforcement learning method.

Mean-field Stochastic Linear–quadratic Optimal Control with Markov Jump Parameters

Reinforcement Q-learning Algorithm for H ∞ Tracking Control of Discrete-Time Markov Jump Systems

L2 - L∞ Analysis and Control to Markov Jump Systems with Multiplicative Noise

Stochastic Linear Quadratic Optimal Control for Model-Free Discrete-Time Systems Based on Q-learning Algorithm

Reinforcement learning‐based composite suboptimal control for Markov jump singularly perturbed systems with unknown dynamics

A Stochastic Linear-Quadratic Optimal Control Problem with Jumps in an Infinite Horizon

Adaptive Linear Quadratic Gaussian Control of Markov Jump Linear Systems

Adaptive Control of Linear Markov Jump Systems