Abstract:It is well known that stability is the most fundamental nature with regard to a control system, in view of this, the stabilization becomes an inevitable control problem. This article mainly discusses the optimal control and stabilization problem for discrete-time systems involving Markov jump and multiplicative noise. The state and control weighting matrices in the cost function are allowed to be indefinite. By solving the forward-backward stochastic difference equations with Markov jump (FBSDEs-MJ) derived from the maximum principle, we conclude that the necessary and sufficient conditions of the solvability of indefinite optimal control problem in finite-horizon, whose method is different from most previous works [13], etc. Furthermore, necessary and sufficient conditions that stabilize the Markov jump discrete- time systems in the mean square sense with indefinite weighting matrices in the cost are first developed under the basic assumption of exactly observable, which is different from the previous works [12], [14] where an additional assumption of stabilization of systems is made. The key points of this article can be summed up as that an analytic solution to FBSDEs- MJ which makes the optimal controller to be explicitly expressed and the method of trans- formation, i.e., the stabilization problem of indefinite case is boiled down to a definite one whose stabilization is expressed by defining Lyapunov function via the optimal cost subject to a new algebraic Riccati equation involving Markov jump (NGARE-MJ).

Optimal Control of DC-DC Buck Converter Via Linear Systems with Inaccessible Markovian Jumping Modes

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Modeling and Control for DC-DC Converters Based on Hybrid System

Networked guaranteed cost control for uncertain discrete-time markovian jump linear systems

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Stabilization and optimization of discrete-time Markovian jump linear systems via mode feedback control

Asynchronous Static Output-Feedback Control of Markovian Jump Linear Systems

Quantized Control of Markov Jump Nonlinear Systems Based on Fuzzy Hidden Markov Model.

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

AsynchronousH∞control of Semi-Markov Jump Linear Systems

Guaranteed cost control for discrete-time Markovian jump linear system with time delay

Data-driven Adaptive Optimal Control of Linear Uncertain Systems with Unknown Jumping Dynamics

Resilient Guaranteed Cost Control for Uncertain Discrete Linear Jump Systems

Optimal Control and Stabilization Problem for Discrete-time Markov Jump Systems with Indefinite Weight Costs

Output Feedback Sliding Mode Control of Markovian Jump Systems and Its Application to Switched Boost Converter

H∞ optimal output tracking control for Markov jump systems: A reinforcement learning‐based approach

Dynamic Sensorless Control Approach for Markovian Switching Systems Applied to PWM DC–DC Converters with Time-Delay and Partial Input Saturation

Optimal control of mode transition rates/probabilities for Markovian jump systems

Robust normalization and guaranteed cost control for a class of uncertain singular Markovian jump systems via hybrid impulsive control