Abstract:It is well known that stability is the most fundamental nature with regard to a control system, in view of this, the stabilization becomes an inevitable control problem. This article mainly discusses the optimal control and stabilization problem for discrete-time systems involving Markov jump and multiplicative noise. The state and control weighting matrices in the cost function are allowed to be indefinite. By solving the forward-backward stochastic difference equations with Markov jump (FBSDEs-MJ) derived from the maximum principle, we conclude that the necessary and sufficient conditions of the solvability of indefinite optimal control problem in finite-horizon, whose method is different from most previous works [13], etc. Furthermore, necessary and sufficient conditions that stabilize the Markov jump discrete- time systems in the mean square sense with indefinite weighting matrices in the cost are first developed under the basic assumption of exactly observable, which is different from the previous works [12], [14] where an additional assumption of stabilization of systems is made. The key points of this article can be summed up as that an analytic solution to FBSDEs- MJ which makes the optimal controller to be explicitly expressed and the method of trans- formation, i.e., the stabilization problem of indefinite case is boiled down to a definite one whose stabilization is expressed by defining Lyapunov function via the optimal cost subject to a new algebraic Riccati equation involving Markov jump (NGARE-MJ).

Optimal Control and Stabilization for Discrete-time Markov Jump Systems with Indefinite Weight Costs with Multi-channel Multiplicative Noise

Optimal Control and Stabilization Problem for Discrete-time Markov Jump Systems with Indefinite Weight Costs

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Stabilization and Optimal Control for Discrete-time Markov Jump Linear System with Multiplicative Noises and Input Delays: A Complete Solution

Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems

Networked guaranteed cost control for uncertain discrete-time markovian jump linear systems

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Optimal Stabilization Control for Discrete-time Markov Jump Linear System with Control Input Delay

Infinite Horizon Stabilization and Linear Quadratic Optimal Control of Descriptor Stochastic Markov Jump Systems

Robust control for uncertain systems with time-delay and jump parameters*

Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Resilient Guaranteed Cost Control for Uncertain Discrete Linear Jump Systems

Stochastic H2 Optimal Control of Discrete-Time Markov Jump Systems with Periodic Coefficients

Stabilization for Markovian Jump Systems with Partial Information on Transition Probability Based on Free-Connection Weighting Matrices.

Mean-field Stochastic Linear–quadratic Optimal Control with Markov Jump Parameters

Stabilization of Discrete-Time Markovian Jump Systems with Partially Unknown Transition Probabilities

On Robust Stabilization Of Uncertain Singular Markovian Jump Systems With Time-Delay

Optimal Control for Discrete-Time Markov Jump Linear Systems with Multiple Input Channels.

Stability Analysis and Stabilization of Markovian Jump Systems with Time‐varying Delay and Uncertain Transition Information