Abstract:This article is devoted to a specific kind of discrete-time switched linear systems, where the switching signal is governed by a Markov chain, i.e., Markovian jump linear systems. For such systems, a mode feedback control mechanism is adopted to adjust the mode transition probability matrix, which is referred to as the switching law design, and the optimal mode feedback controller is sought to minimize a quadratic performance index containing both the system state and the mode feedback control input. First, the admissible set of the mode feedback control is investigated, and a sufficient condition is derived to ensure the desired stochastic stability. Second, under the assumption that the concerned system is mode-cost sequential, the original performance index is approximated into a new tractable one and a suboptimal mode feedback controller is then derived within the admissible set. Third, we consider a general situation where no specific requirements are imposed on the Markovian jump linear systems dynamics, derive the optimal mode feedback controller via a value-iteration-based algorithm, and prove the convergence of the obtained optimal controller. Finally, simulation results are provided to illustrate the validity of the proposed mode feedback control mechanism.

Optimal Control for Discrete-Time Markov Jump Linear Systems with Multiple Input Channels.

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Asynchronous Observer-Based Control for Exponential Stabilization of Markov Jump Systems.

Optimal Stabilization Control for Discrete-time Markov Jump Linear System with Control Input Delay

Reliable Control Against Sensor Failures for Markov Jump Systems with Unideal Measurements

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Mean-field Stochastic Linear–quadratic Optimal Control with Markov Jump Parameters

Robust Adaptive H∞ Control for Networked Uncertain Semi-Markov Jump Nonlinear Systems with Input Quantization

Asynchronous Static Output-Feedback Control of Markovian Jump Linear Systems

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Optimal Output Feedback Control for Discrete-time Markov Jump Linear System with Multi-step Input Delays

Observer-Based Control for Discrete-Time Hidden Semi-Markov Jump Systems

Optimal control for continuous-time Markov jump singularly perturbed systems : A hybrid reinforcement learning scheme

Disturbance Attenuation and Rejection for Discrete-Time Markovian Jump Systems with Lossy Measurements.

Observer-based Optimal Control for a Class of Impulsive Switched Systems

Stabilization and optimization of discrete-time Markovian jump linear systems via mode feedback control

Stabilization and Optimal Control for Discrete-time Markov Jump Linear System with Multiplicative Noises and Input Delays: A Complete Solution

Adaptive control for time-delay Markovian jump linear systems with state-dependant switching

Controller Design for Network-Based Markovian Jump Systems with Unreliable Communication Links

Disturbance-observer-based control for time-delay Markovian jump systems subject to actuator saturation