Abstract:This article is devoted to a specific kind of discrete-time switched linear systems, where the switching signal is governed by a Markov chain, i.e., Markovian jump linear systems. For such systems, a mode feedback control mechanism is adopted to adjust the mode transition probability matrix, which is referred to as the switching law design, and the optimal mode feedback controller is sought to minimize a quadratic performance index containing both the system state and the mode feedback control input. First, the admissible set of the mode feedback control is investigated, and a sufficient condition is derived to ensure the desired stochastic stability. Second, under the assumption that the concerned system is mode-cost sequential, the original performance index is approximated into a new tractable one and a suboptimal mode feedback controller is then derived within the admissible set. Third, we consider a general situation where no specific requirements are imposed on the Markovian jump linear systems dynamics, derive the optimal mode feedback controller via a value-iteration-based algorithm, and prove the convergence of the obtained optimal controller. Finally, simulation results are provided to illustrate the validity of the proposed mode feedback control mechanism.

Inverse optimal gain assignment control for Markovian jump nonlinear systems

Robust H∞ Output Feedback Control for Markovian Jump Systems with Actuator Saturation

Inverse Optimal Adaptive Stochastic Gain Assignment for A Class of Nonlinear Systems with Markovian Jump

Output Feedback Stabilization for Discrete Singular Systems with Random Abrupt Changes

Risk-sensitive control design for strict-feedback nonlinear stochastic systems with Markovian jump

Stabilization of differential inclusion systems with Markovian jumping

Asynchronous Static Output-Feedback Control of Markovian Jump Linear Systems

Asynchronous Observer-Based Control for Exponential Stabilization of Markov Jump Systems.

Robust control for uncertain systems with time-delay and jump parameters*

Delay-dependent Stabilization of Singular Markovian Jump Systems with State Delay

The Robust Feedback Stabilization of a Class of Nonlinear Systems with Markovian Jumping

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Robust Adaptive Stabilization for a Class of Markovian Jumping Nonlinear Systems

Output-feedback Control for a Class of Markovian Jump Non-Linear Systems under a Risk-Sensitive Cost Criterion with Unknown Transition Probabilities

Robust Finite-Time Bounded H∞ Control for a Class of Nonlinear Quadratic Markovian Jump Systems

Robust Adaptive Switching Control for Markovian Jump Nonlinear Systems Via Backstepping Technique

Switching Controller Design for a Class of Markovian Jump Nonlinear Systems Using Stochastic Small-Gain Theorem

A Robust Suppress Of Stochastic Nonlinear Systems With Markovian Jump Parameters

Output-Feedback Robust Adaptive Control For Strict-Feed Back Stochastic Nonlinear Systems Under Inverse Optimality Costs

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Stabilization and optimization of discrete-time Markovian jump linear systems via mode feedback control