Abstract:It is well known that stability is the most fundamental nature with regard to a control system, in view of this, the stabilization becomes an inevitable control problem. This article mainly discusses the optimal control and stabilization problem for discrete-time systems involving Markov jump and multiplicative noise. The state and control weighting matrices in the cost function are allowed to be indefinite. By solving the forward-backward stochastic difference equations with Markov jump (FBSDEs-MJ) derived from the maximum principle, we conclude that the necessary and sufficient conditions of the solvability of indefinite optimal control problem in finite-horizon, whose method is different from most previous works [13], etc. Furthermore, necessary and sufficient conditions that stabilize the Markov jump discrete- time systems in the mean square sense with indefinite weighting matrices in the cost are first developed under the basic assumption of exactly observable, which is different from the previous works [12], [14] where an additional assumption of stabilization of systems is made. The key points of this article can be summed up as that an analytic solution to FBSDEs- MJ which makes the optimal controller to be explicitly expressed and the method of trans- formation, i.e., the stabilization problem of indefinite case is boiled down to a definite one whose stabilization is expressed by defining Lyapunov function via the optimal cost subject to a new algebraic Riccati equation involving Markov jump (NGARE-MJ).

Stabilization and Optimal Control for Discrete-time Markov Jump Linear System with Multiplicative Noises and Input Delays: A Complete Solution

Delay-range-dependent and delay-distribution-independent stability criteria for discrete-time singular Markovian jump systems

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Dissipativity‐based Asynchronous Control of Discrete‐time Markov Jump Systems with Mixed Time Delays

Improved delay-dependent stability conditions and H∞ control for jump time-delay systems.

Asynchronous Observer-Based Control for Exponential Stabilization of Markov Jump Systems.

Delay-dependent Stabilization of Singular Markovian Jump Systems with State Delay

Optimal Control and Stabilization Problem for Discrete-time Markov Jump Systems with Indefinite Weight Costs

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

Delay-dependent Stability Analysis for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay

ROBUST H∞ CONTROL OF UNCERTAIN MARKOVIAN JUMP LINEAR SYSTEMS WITH MODE-DEPENDENT TIME-DELAYS

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Robust control for uncertain systems with time-delay and jump parameters*

Asynchronous Mean Stabilization of Positive Jump Systems With Piecewise-Homogeneous Markov Chain

Guaranteed Cost Control Of Networked Control Systems With Time-Delays And Packet Losses

Finite-Time Stability for Markovian Jump Nonlinear Systems with Random Delays

Asynchronous Static Output-Feedback Control of Markovian Jump Linear Systems

Linear Quadratic Regulation and Stabilization of Discrete-Time Systems With Delay and Multiplicative Noise

Stochastic Stabilization for Discrete-Time Markovian Jump Systems With Time-Varying Delay and Two Markov Chains Under Partly Known Transition Probabilities

Extended Dissipativity Asynchronous Static Output Feedback Control of Markov Jump Systems