Abstract:This article is devoted to a specific kind of discrete-time switched linear systems, where the switching signal is governed by a Markov chain, i.e., Markovian jump linear systems. For such systems, a mode feedback control mechanism is adopted to adjust the mode transition probability matrix, which is referred to as the switching law design, and the optimal mode feedback controller is sought to minimize a quadratic performance index containing both the system state and the mode feedback control input. First, the admissible set of the mode feedback control is investigated, and a sufficient condition is derived to ensure the desired stochastic stability. Second, under the assumption that the concerned system is mode-cost sequential, the original performance index is approximated into a new tractable one and a suboptimal mode feedback controller is then derived within the admissible set. Third, we consider a general situation where no specific requirements are imposed on the Markovian jump linear systems dynamics, derive the optimal mode feedback controller via a value-iteration-based algorithm, and prove the convergence of the obtained optimal controller. Finally, simulation results are provided to illustrate the validity of the proposed mode feedback control mechanism.

Probability rate optimization of positive Markov jump linear systems via DC programming

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Stability Optimization of Positive Semi-Markov Jump Linear Systems via Convex Optimization

Stabilization of Time-Delay Markovian Jump Systems Via Probability Rate Synthesis and State Feedback

Stochastic Stability of Positive Markov Jump Linear Systems with Completely/partially Known Transition Rates

Linear programming-based stochastic stabilization of hidden semi-Markov jump positive systems

Asynchronous Mean Stabilization of Positive Jump Systems With Piecewise-Homogeneous Markov Chain

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Stochastic Stability and Stabilization of Positive Systems with Markovian Jump Parameters

Asynchronous Control of Positive Markov Jump Systems: A Necessary and Sufficient Condition

A Hybrid Design Approach for Output Feedback Exponential Stabilization of Markovian Jump Systems.

Stabilization of differential inclusion systems with Markovian jumping

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Optimal Decision Strategy for Discrete-Time Markovian Jump Linear Systems.

Optimal control of mode transition rates/probabilities for Markovian jump systems

Exponential Stability and L1-gain Analysis for Positive Time-Delay Markovian Jump Systems with Switching Transition Rates Subject to Average Dwell Time

Stability and Stabilization for Positive Systems with Semi-Markov Switching

Optimization of Markov Jump Linear System with Controlled Jump Probabilities of Modes

Stabilization and optimization of discrete-time Markovian jump linear systems via mode feedback control