Abstract:In this article, we focus on the asynchronous $\mathscr{H}_{\infty}$ control problem for discrete-time hidden Markov jump systems (MJSs) with complex mode transition probabilities (C-TPs). The significance of this study can be revealed as follows. First, a hidden Markov model (HMM) is used to estimate the system mode, which cannot always be accurately detected in practical scenarios. Second, the TPs of the Markov process are commonly difficult to be precisely obtained in practical scenarios; hence, some TPs of the Markov process could be unknown or imprecise, resulting in the C-TPs circumstances. Particularly, when taking the HMM into consideration, the C-TPs can also appear in the conditional TPs of the joint process. Therefore, in this work, we consider that the C-TPs may simultaneously exist in both processes of the HMM, which is more practical for hidden MJSs. Additionally, the established results can cover some special cases, for instance, the cases in which C-TPs only exist in one of the processes or neither. The Markov and the joint processes of the HMM are separated by a mode separation strategy so that the C-TPs of them can be, respectively, addressed. Furthermore, only necessary conservatism in dealing with the C-TPs is further introduced. Specifically, when the TPs are perfectly known, the established results can be reduced to an existing result without increasing conservatism. Two examples are presented to demonstrate the effectiveness of the developed results.

Optimal Control for Unknown Discrete-Time Nonlinear Markov Jump Systems Using Adaptive Dynamic Programming.

Modular‐based Adaptive Control of Uncertain Nonlinear Time‐varying Systems with Piecewise Jumping Parameters

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Optimal Control of Markovian Jump Systems Via a Neural Network-Based ADP Iterative Algorithm

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

Policy Iteration-Based Adaptive Optimal Control for Markov Jump Systems: a Transition-Probability-free Asynchronous Approach

Dynamic event-triggered control for discrete-time nonlinear Markov jump systems using policy iteration-based adaptive dynamic programming

Asynchronous Event-Triggered Output-Feedback Control of Singular Markov Jump Systems

Asynchronous Observer-Based Control for Exponential Stabilization of Markov Jump Systems.

Asynchronous Event-triggered Control for Polynomial Fuzzy-Model-Based Markov Jump Systems with Complex Transition Probabilities

Robust Adaptive H∞ Control for Networked Uncertain Semi-Markov Jump Nonlinear Systems with Input Quantization

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Reinforcement Learning-Based Optimal Control for Markov Jump Systems with Completely Unknown Dynamics

H∞ optimal output tracking control for Markov jump systems: A reinforcement learning‐based approach

Optimal Asynchronous Control of Discrete-Time Hidden Markov Jump Systems with Complex Transition Probabilities

Fuzzy-Based Adaptive Optimization of Unknown Discrete-Time Nonlinear Markov Jump Systems With Off-Policy Reinforcement Learning

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Optimal Stabilization Control for Discrete-time Markov Jump Linear System with Control Input Delay

Stochastic H2 Optimal Control of Discrete-Time Markov Jump Systems with Periodic Coefficients

H∞ Performance for Delayed Singular Nonlinear Markovian Jump Systems with Unknown Transition Rates Via Adaptive Control Method