Abstract:It is well known that stability is the most fundamental nature with regard to a control system, in view of this, the stabilization becomes an inevitable control problem. This article mainly discusses the optimal control and stabilization problem for discrete-time systems involving Markov jump and multiplicative noise. The state and control weighting matrices in the cost function are allowed to be indefinite. By solving the forward-backward stochastic difference equations with Markov jump (FBSDEs-MJ) derived from the maximum principle, we conclude that the necessary and sufficient conditions of the solvability of indefinite optimal control problem in finite-horizon, whose method is different from most previous works [13], etc. Furthermore, necessary and sufficient conditions that stabilize the Markov jump discrete- time systems in the mean square sense with indefinite weighting matrices in the cost are first developed under the basic assumption of exactly observable, which is different from the previous works [12], [14] where an additional assumption of stabilization of systems is made. The key points of this article can be summed up as that an analytic solution to FBSDEs- MJ which makes the optimal controller to be explicitly expressed and the method of trans- formation, i.e., the stabilization problem of indefinite case is boiled down to a definite one whose stabilization is expressed by defining Lyapunov function via the optimal cost subject to a new algebraic Riccati equation involving Markov jump (NGARE-MJ).

Linear Quadratic Optimal Control for Discrete-time Markov Jump Linear Systems.

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Optimal Stabilization Control for Discrete-time Markov Jump Linear System with Control Input Delay

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Optimal Control for Unknown Discrete-Time Nonlinear Markov Jump Systems Using Adaptive Dynamic Programming.

Optimal Control and Stabilization Problem for Discrete-time Markov Jump Systems with Indefinite Weight Costs

Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Linear quadratic optimal control for a class of continuous-time nonhomogeneous Markovian jump linear systems in infinite time horizon

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

Optimal Control for Discrete-Time Markov Jump Linear Systems with Multiple Input Channels.

Mean-field Stochastic Linear–quadratic Optimal Control with Markov Jump Parameters

Stabilization and Optimal Control for Discrete-time Markov Jump Linear System with Multiplicative Noises and Input Delays: A Complete Solution

Optimal Control for Unknown Nonlinear System with Semi-Markovian Jump Parameters Via Adaptive Dynamic Programming

Optimal Control and Stabilization for Discrete-time Markov Jump Systems with Indefinite Weight Costs with Multi-channel Multiplicative Noise

Adaptive Linear Quadratic Gaussian Control of Markov Jump Linear Systems

Linear Quadratic Optimal Control of Discrete-Time Stochastic Systems Driven by Homogeneous Markov Processes

Risk-Sensitive Stochastic Linear-Quadratic Optimal Control with Markov Jump Parameters

Optimal Output Feedback Control for Discrete-time Markov Jump Linear System with Multi-step Input Delays

A Stochastic Linear-Quadratic Optimal Control Problem with Jumps in an Infinite Horizon

Linear Quadratic Optimal Control of Infinite Dimensional Stochastic Evolution Equation with Jumps