Abstract:This article is devoted to a specific kind of discrete-time switched linear systems, where the switching signal is governed by a Markov chain, i.e., Markovian jump linear systems. For such systems, a mode feedback control mechanism is adopted to adjust the mode transition probability matrix, which is referred to as the switching law design, and the optimal mode feedback controller is sought to minimize a quadratic performance index containing both the system state and the mode feedback control input. First, the admissible set of the mode feedback control is investigated, and a sufficient condition is derived to ensure the desired stochastic stability. Second, under the assumption that the concerned system is mode-cost sequential, the original performance index is approximated into a new tractable one and a suboptimal mode feedback controller is then derived within the admissible set. Third, we consider a general situation where no specific requirements are imposed on the Markovian jump linear systems dynamics, derive the optimal mode feedback controller via a value-iteration-based algorithm, and prove the convergence of the obtained optimal controller. Finally, simulation results are provided to illustrate the validity of the proposed mode feedback control mechanism.

Optimal Control for Markovian Jump Systems with Colored Process Noise

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Asynchronous Output Regulation Control for Continuous-Time Markovian Jump Systems with Colored-Noise

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Finite-time L2−l∞ Tracking Control for Markov Jump Repeated Scalar Nonlinear Systems with Partly Usable Model Information

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Optimal control of mode transition rates/probabilities for Markovian jump systems

Saturated controller Design for Markovian jump Systems via Particle Control Approach.

Optimal Control Strategy for Discrete-Time MJLS with Controllable Markov Chain and Gaussian White Noise

Quantized control for nonlinear Markovian jump systems

Stochastic LQ optimal control for Markov jumping systems with multiplicative noise using reinforcement learning

$\mathcal H_{\infty }$ Control for 2-D Markov Jump Systems in Roesser Model

Optimal output feedback control of a class of linear systems with quasi-colored control-dependent multiplicative noise

&Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\mathcal H_{\infty }$&Lt;/tex-Math> &Lt;/inline-Formula> Control for 2-D Markov Jump Systems in Roesser Model

Robust Adaptive Switching Control for Markovian Jump Nonlinear Systems Via Backstepping Technique

L2 - L∞ Analysis and Control to Markov Jump Systems with Multiplicative Noise

Passivity-based non-fragile control for Markovian jump systems with aperiodic sampling.

Jump Linear Quadratic Gaussian Problem for A Class of Nonhomogeneous Markov Jump Linear Systems

A Robust Suppress Of Stochastic Nonlinear Systems With Markovian Jump Parameters

Stabilization and optimization of discrete-time Markovian jump linear systems via mode feedback control

H∞ optimal output tracking control for Markov jump systems: A reinforcement learning‐based approach