Abstract:This article is devoted to a specific kind of discrete-time switched linear systems, where the switching signal is governed by a Markov chain, i.e., Markovian jump linear systems. For such systems, a mode feedback control mechanism is adopted to adjust the mode transition probability matrix, which is referred to as the switching law design, and the optimal mode feedback controller is sought to minimize a quadratic performance index containing both the system state and the mode feedback control input. First, the admissible set of the mode feedback control is investigated, and a sufficient condition is derived to ensure the desired stochastic stability. Second, under the assumption that the concerned system is mode-cost sequential, the original performance index is approximated into a new tractable one and a suboptimal mode feedback controller is then derived within the admissible set. Third, we consider a general situation where no specific requirements are imposed on the Markovian jump linear systems dynamics, derive the optimal mode feedback controller via a value-iteration-based algorithm, and prove the convergence of the obtained optimal controller. Finally, simulation results are provided to illustrate the validity of the proposed mode feedback control mechanism.

Stabilisation of Discrete-Time Piecewise Homogeneous Markov Jump Linear System with Imperfect Transition Probabilities

Stability And Stabilization Of Markovian Jump Singular Systems With Partly Known Transition Probabilities

Stability and Stabilisation of Itô Stochastic Systems with Piecewise Homogeneous Markov Jumps

Stabilization control of a class of discrete-time Markov jump singular systems

Output Feedback Stabilization for Discrete Singular Systems with Random Abrupt Changes

Stability of Discrete-time Stochastic Markov Jump Linear Systems with Not Fully Known Transition Probabilities

Stochastic Stability Analysis of Markovian Jump Linear Systems with Incomplete Transition Descriptions

Asynchronous Static Output-Feedback Control of Markovian Jump Linear Systems

Asynchronous Mean Stabilization of Positive Jump Systems With Piecewise-Homogeneous Markov Chain

Finite-time Stability and Stabilization of Markovian Jump Linear Systems Subject to Incomplete Transition Descriptions

Delay-dependent Stabilization of Singular Markovian Jump Systems with State Delay

Stabilisation of Descriptor Markovian Jump Systems with Partially Unknown Transition Probabilities

Stochastic Stability and Stabilization of Discrete‐time Singular Markovian Jump Systems with Partially Unknown Transition Probabilities

Stabilization and optimization of discrete-time Markovian jump linear systems via mode feedback control

Stability and stabilization of discrete-time Markov jump singular systems with general uncertain transition rates

Stabilization of Discrete-Time Markovian Jump Systems with Partially Unknown Transition Probabilities

Mean Stability for a Class of Discrete-Time Non-Homogeneous Positive Markov Jump Linear Systems

Stability and stabilisation of neutral stochastic delay Markovian jump systems

Finite-Time Stochastic Stability and Stabilisation of Linear Discrete-Time Markovian Jump Systems with Partly Unknown Transition Probabilities

Stability Analysis and Stabilization of Continuous-Time Markov Jump Singular Systems

Stability and Static Output Feedback Stabilization for Nonlinear Discrete-Time Descriptor Markov Jump Systems with Time-Varying Delay