Analysis and Design of Markov Jump Discrete Systems

Yonggui Kao,Panpan Zhang,Changhong Wang,Hongwei Xia

2023-01-01

Abstract:This book proposes analysis and design techniques for Markov jump systems (MJSs) using Lyapunov function and sliding mode control techniques.

What problem does this paper attempt to address?

Extended Dissipative Sliding-Mode Control for Discrete-Time Piecewise Nonhomogeneous Markov Jump Nonlinear Systems

Shanling Dong,Kan Xie,Guanrong Chen,Meiqin Liu,Zheng-Guang Wu

DOI: https://doi.org/10.1109/tcyb.2021.3052647

IF: 11.8

2022-01-01

IEEE Transactions on Cybernetics

Abstract:This article analyzes the problem of the sliding-mode control (SMC) design for discrete-time piecewise nonhomogeneous Markov jump nonlinear systems (MJNSs) subject to an external disturbance with time-varying transition probabilities (TPs). A discrete-time asynchronous integral sliding surface is constructed, which yields matched-nonlinearity-free sliding-mode dynamics (SMDs). Then, by using the mode-dependent Lyapunov function technique, a sufficient condition is established for ensuring the stochastic stability of SMD with extended dissipation. The solution to designing controller gains is obtained. Moreover, an SMC law and an adaptive law are, respectively, derived for driving the system trajectories to move into a predetermined sliding-mode region with specified precision. Finally, the feasibility and effectiveness of the new design are verified and demonstrated by a simulation example.
Sliding Mode Control for Markov Jump Systems with Delays Via Asynchronous Approach.

Mei Fang,Peng Shi,Shanling Dong

DOI: https://doi.org/10.1109/tsmc.2019.2917926

2021-01-01

Abstract:In this paper, the problem of sliding mode control (SMC) is considered for a class of nonlinear continuous-time Markov jump systems (MJSs) with uncertainties and time delay. A novel integral-type switching sliding surface function is designed, where the controller gain may jump asynchronously with original MJSs. Then, an SMC law is constructed to force system trajectories onto the specified switching sliding surface in a finite time. The stochastic stability and dissipative performance of sliding mode dynamics are analyzed and the delay-dependent sufficient condition for the existence of the desired switching surface is developed. Moreover, we also extend SMC to investigate the finite-time stability problem during both reaching phase and sliding motion phase in the stochastic setting. Finally, simulation results are given to illustrate the effectiveness of the proposed design techniques.
Asynchronous Event-Triggered Output-Feedback Control of Singular Markov Jump Systems

Yue-Yue Tao,Zheng-Guang Wu,Tingwen Huang,Prasun Chakrabarti,Choon Ki Ahn

DOI: https://doi.org/10.1109/tcyb.2022.3217197

IF: 11.8

2023-01-01

IEEE Transactions on Cybernetics

Abstract:This study focused on the asynchronous event-triggered output-feedback controller design problem for discrete-time singular Markov jump systems (MJSs). A hidden Markov model (HMM) was employed to estimate the system mode, which cannot always be ideally detected in practice. Because the full state is also difficult to obtain in practical scenarios, an output-feedback control scheme was used. In addition, an HMM-based event-triggered mechanism was also employed in the design of the controller to reduce the communication burden of the networked system. Sufficient conditions for the stochastic admissibility of a closed-loop singular MJS with a prescribed $H_{\infty }$ performance index were established using the Lyapunov functional technique. Finally, design procedures for an asynchronous event-triggered controller were summarized as a linear-matrix-inequality-based optimization algorithm. Two examples were considered to verify the effectiveness of the asynchronous event-triggered output-feedback controller design method.
Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

Shanling Dong,Zheng-Guang Wu

DOI: https://doi.org/10.1109/iecon.2018.8591101

2018-01-01

Abstract:The paper investigates the problem of l2-l∞ asynchronous static output feedback control for discrete-time Markov jump linear systems. The hidden Markov model is applied to describe the asynchronization between the original system and the designed controller. Via the system augmentation technique, the closed-loop system is represented as a descriptor system. Based on stochastic Lyapunov function technique, a sufficient condition is developed to ensure that the closed-loop system is stochastically admissible with a given l2-l∞ performance. By Finsler's lemma and the convexification approach, controller parameters can be obtained by solving a set of linear matrix inequalities. Finally, the applicability and effectiveness of the proposed approach is demonstrated by an example.
A Brief Tutorial and Survey on Markovian Jump Systems Stability and Control

Ping Zhao,Yu Kang,Yun-Bo Zhao

DOI: https://doi.org/10.1109/msmc.2018.2881337

2019-01-01

IEEE Systems Man and Cybernetics Magazine

Abstract:Markovian jump systems (MJSs) can be regarded as a special type of jump system, whose jumping law governing the switches among the subsystems are a Markovian chain or process [1]. Similar to other control systems, the subsystems in MJSs are usually described by some type of dynamic equations, while a Markov process that can be either continuous time or discrete time describes the jumping law. On t...
Asynchronous Observer-Based Control for Exponential Stabilization of Markov Jump Systems.

Meng Zhang,Chao Shen,Zheng-Guang Wu

DOI: https://doi.org/10.1109/tcsii.2019.2946320

2020-01-01

Abstract:This brief investigates the problem of asynchronous observer-based control for a class of discrete-time Markov jump systems (MJSs). Compared with most existing results on observer-based control of MJSs, the proposed asynchronous observer-based controller has its own jump mode thus not necessarily to work synchronously with the controlled systems. Based on stochastic Lyapunov function approach, sufficient criteria are derived to ensure the exponential stability with a predefined H-infinity performance of the resulting closed-loop system. Moreover, to determine gains of the observer-based controller, two totally different linearization methods are presented and the later one is proved to be less conservative. A numerical example is provided to illustrate the effectiveness of the proposed design techniques.
Analysis and Synthesization for A Class of Discrete-Time Markovian Jumping Systems with Mode-Dependent Delays and Actuators Saturation

Weike Shang,Yu Kang,Xin Wang,Hongsheng Xi

DOI: https://doi.org/10.1109/icarcv.2012.6485416

2012-01-01

Abstract:A class of discrete-time Markovian jumping systems with mode-dependent delays and actuators saturation is investigated in this paper. Sufficient conditions for local stochastic stability is presented, and an estimate of domain of attraction in mean square (DOAMS for short) is provided for the systems. Controller design problems for both mode-dependent and mode-independent cases are considered. A globally convergent algorithm including convex optimization is given to construct corresponding effective controllers. Finally, a numerical example is presented to show the effectiveness of the results.
A Hybrid Sliding Mode Control Scheme of Markovian Jump Systems via Transition Rates Optimal Design

Zhiru Cao,Yugang Niu,James Lam,Xiaoqi Song

DOI: https://doi.org/10.1109/TSMC.2020.2980851

2021-01-01

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Abstract:This article investigates the hybrid sliding mode control problem for the uncertain Markovian jump systems (MJSs) via the transition rates optimal design. The stability condition for the transition rates is first established to ensure the exponential mean-square (EMS) stability of the unforced uncertain MJSs. Then the hybrid design strategy on the sliding mode controller and transition rate matrix...
Two-Dimensional Asynchronous Sliding-Mode Control of Markov Jump Roesser Systems

Yue-Yue Tao,Zheng-Guang Wu,Yingxin Guo

DOI: https://doi.org/10.1109/tcyb.2020.3006329

IF: 11.8

2022-01-01

IEEE Transactions on Cybernetics

Abstract:In this article, asynchronous sliding-mode control (SMC) is investigated for 2-D discrete-time Markov jump systems. As the system modes are not always accessible to the controller, the hidden Markov model is employed to describe the asynchronization between the system modes and controller. A new 2-D sliding surface is constructed and the corresponding asynchronous SMC law is designed under the framework of the hidden Markov model. By Lyapunov function and linear matrix inequality (LMI) approaches, the reachability of system dynamics to the predefined sliding surface is investigated, and sufficient conditions are established to guarantee that the underlying 2-D system is asymptotically mean-square stable (AMSS) with an H∞ disturbance attenuation performance. Then, an algorithm is provided to derive the asynchronous 2D-SMC law. Finally, an example is given to verify the validity and effectiveness of the new SMC law design algorithm.
Sliding mode control for Markovian jump systems with external disturbance

Yao Deyin,Zhou Qi,Gao Yabin,Wu Chengwei

DOI: https://doi.org/10.1109/chicc.2015.7259888

2015-01-01

Abstract:In this paper, the adaptive sliding mode control problem of nonlinear Markovian jump systems (MJSs) is studied. Our attention is mainly focused on designing an adaptive sliding mode controller for such a complex dynamics. Firstly, for each mode, we construct appropriate mode-dependent sliding mode surface, of which the stochastic stability is guaranteed by some sufficient conditions. Secondly, an adaptive sliding mode controller is designed such that the MJSs state trajectories satisfy the reaching condition. Then, the stochastic stability of the closed-loop system can be guaranteed. Finally, a numerical example is exploited to demonstrate the effectiveness of the proposed scheme.
Stochastic Stability Analysis for Discrete-Time Singular Markov Jump Systems with Time-Varying Delay and Piecewise-Constant Transition Probabilities

Zheng-Guang Wu,Ju H. Park,Hongye Su,Jian Chu

DOI: https://doi.org/10.1016/j.jfranklin.2012.08.012

IF: 4.246

2012-01-01

Journal of the Franklin Institute

Abstract:This paper concerns the stochastic stability analysis for discrete-time singular Markov jump systems with time-varying delay and time-varying transition probabilities. The time-varying transition probabilities in the underlying systems are assumed to be finite piecewise-constant. Based on the delay partitioning technique, a delay-dependent stochastic stability condition is derived for these systems, which is formulated by linear matrix inequalities and thus can be checked easily. Some special cases are also considered. Finally, two numerical examples are provided to demonstrate the application and less conservativeness of the developed approaches.
Delay-dependent Stability Analysis for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay

Zheng-Guang Wu,Peng Shi,Hongye Su,Jian Chu

DOI: https://doi.org/10.1080/00207721.2011.564327

IF: 2.648

2012-01-01

International Journal of Systems Science

Abstract:This article considers the problem of delay-dependent stability analysis for a class of discrete-time singular systems with Markovian jump and time-varying delay. The transition probabilities in Markov chain are assumed to be partially unknown. In terms of linear matrix inequality approach, the delay-dependent criteria are proposed to ensure the underlying system to be regular, causal and stochastically stable. Several numerical examples are given to demonstrate the effectiveness and less conservatism of the obtained results.
Extended Dissipativity Asynchronous Static Output Feedback Control of Markov Jump Systems

Shanling Dong,Mei Fang,Shiming Chen

DOI: https://doi.org/10.1016/j.ins.2019.11.038

IF: 8.1

2019-01-01

Information Sciences

Abstract:This paper is concerned with both continuous- and discrete-time extended dissipativity-based control problems for Markov jump systems. Hidden Markov model is employed to describe the jump asynchronization behavior between the original system and the controller. Then, an asynchronous static output feedback controller is designed. By using the mode-dependent Lyapunov function technique with slack matrices, several sufficient conditions are obtained to ensure that the closed-loop systems are stochastically stable with extended dissipativity performance. Based on these conditions, solutions to the controller gains are derived. Finally, simulation results are presented to illustrate the feasibility and the effectiveness of the proposed approaches.
Finite-time Stochastic Boundedness of Markovian Jump Systems: A Sliding-Mode-based Hybrid Design Method

Zhiru Cao,Yugang Niu

DOI: https://doi.org/10.1016/j.nahs.2020.100862

2020-01-01

Abstract:This work investigates the problem of finite-time stochastic boundedness for a class of Markovian jump systems by synthesizing the sliding mode control and the transition rate matrix. First, a sufficient condition on the transition rate matrix is derived to guarantee the finite-time stochastic boundedness of the unforced Markovian jump systems. Moreover, a hybrid design scheme integrating the transition rate matrix with the sliding mode controller is synthesized such that the closed-loop systems are ensured to be finite-time stochastically bounded over both reaching phase and sliding motion phase. Finally, two examples are exploited to illustrate the proposed method.
Stability Analysis for Discrete-Time Markov Jump System

Ming Wei Li,Yi Chen,Xiao Han Zhang

DOI: https://doi.org/10.4028/www.scientific.net/amm.249-250.1224

2012-01-01

Applied Mechanics and Materials

Abstract:Network control systems (NCSs) where the problems of data packet dropout induced by communication channel is studied in this paper. We model the data packet dropout a Markov Jump Linear systems and introduce a freedom matrix. Our goal is to find a controller such that the Markov Jump Linear systems mean square stable. According to linear matrix inequalities (LMI), we can get the sufficient condition on the mean square stabilization of NCSs. Finally, a numerical example is provided to demonstrate the effectiveness of the proposed approach.
Control of Discrete-Time Markovian Jumping Systems with Unknown Delay and Actuators Saturation

Shang Weike,Kang Yu,Wang Xin,Xi Hongsheng

2010-01-01

Abstract:In this note, A class of discrete-time Markovian jumping systems with unknown delays and actuators saturation is investigated. Through Lyapunov methods, sufficient conditions under which the investigated system is locally stochastic stable are presented. Moreover, an estimate of the domain of attraction in mean square is provided for the systems. Then, we design the mode-dependent memoryless state feedback controller to expand the domain of attraction. Finally, numerical examples are given to verify the effectiveness of the methods.
Analysis and Synthesis of Markov Jump Linear Systems With Time-Varying Delays and Partially Known Transition Probabilities

Lixian Zhang,El-KÉbir Boukas,James Lam

DOI: https://doi.org/10.1109/TAC.2008.2007867

2008-01-01

Abstract:In this note, the stability analysis and stabilization problems for a class of discrete-time Markov jump linear systems with partially known transition probabilities and time-varying delays are investigated. The time-delay is considered to be time-varying and has a lower and upper bounds. The transition probabilities of the mode jumps are considered to be partially known, which relax the traditional assumption in Markov jump systems that all of them must be completely known a priori . Following the recent study on the class of systems, a monotonicity is further observed in concern of the conservatism of obtaining the maximal delay range due to the unknown elements in the transition probability matrix. Sufficient conditions for stochastic stability of the underlying systems are derived via the linear matrix inequality (LMI) formulation, and the design of the stabilizing controller is further given. A numerical example is used to illustrate the developed theory.
Stability Analysis for A Class of Discrete-Time Markovian Jumping Systems with Input Quantization

He Enyu,Kang Yu,Tang Hao

2012-01-01

Abstract:A class of discrete-time Markovian jumping systems with mode-dependent delays and input quantization is investigated in this paper. The quantized input signals are dealt with by utilizing the sector bound method. Sufficient conditions under which the close-loop system is stochastic stable are developed and the corresponding controller is designed. Finally, a numerical example is presented to show the effectiveness of the results.
Stochastic Stability Analysis of Markovian Jump Linear Systems with Incomplete Transition Descriptions

Hui-Jie Sun,Ying Zhang,Ai-Guo Wu

DOI: https://doi.org/10.1049/iet-cta.2017.1445

IF: 2.67

2018-01-01

IET Control Theory and Applications

Abstract:In this study, the authors focus on the stability analysis for Markovian jump linear systems with partly known transition rates in the continuous-time domain and partly known transition probabilities in the discrete-time domain. By using the properties of the transition rates and transition probabilities, two new sufficient conditions are derived for the stochastic stability of the continuous-time and discrete-time Markovian jump linear systems, respectively. The main advantage of the proposed stability conditions is that the total number of linear matrix inequalities (LMIs) in the proposed stability conditions is much less than that in some existing results. Based on the presented stability conditions, two state feedback controllers are designed for the considered systems in terms of LMIs. In addition, two kinds of stability criteria are developed for the stochastic stability of the considered systems with incomplete transition descriptions by the existence of the unique positive definite solution of the coupled Lyapunov matrix equations. Finally, two numerical examples and one practical example are provided to verify the correctness of the theoretical results.
Sliding Mode Output Feedback Controller Design of Discrete-Time Markov Jump System Based on Hidden Markov Model Approach

Ming Xu,Longhua Ma,Hongyu Ma,Zhaowen Xu

DOI: https://doi.org/10.1109/access.2021.3097494

IF: 3.9

2021-01-01

IEEE Access

Abstract:This paper investigates the problem of sliding mode controller design based on output feedback for discrete-time Markov jump systems. Considering the typical asynchronous phenomenon for jump systems, here we adopt the Hidden Markov Model (HMM) to quantify the asynchronous degree. Based on this, a static output feedback sliding surface is constructed. Sufficient conditions in terms of bilinear matrix inequalities are proposed ensuring the sliding motion dynamic to be stochastically stable and its $\mathcal {H}_\infty $ performance for the considered discrete time Markov jump systems. Moreover, the reachability of the sliding mode surface is ensured by a predesigned control law. The whole design scheme is presented by using an iterative algorithm. Finally, simulation results are presented to illustrate the effectiveness of the design methodology.

Analysis and Design of Markov Jump Discrete Systems

Extended Dissipative Sliding-Mode Control for Discrete-Time Piecewise Nonhomogeneous Markov Jump Nonlinear Systems

Sliding Mode Control for Markov Jump Systems with Delays Via Asynchronous Approach.

Asynchronous Event-Triggered Output-Feedback Control of Singular Markov Jump Systems

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

A Brief Tutorial and Survey on Markovian Jump Systems Stability and Control

Asynchronous Observer-Based Control for Exponential Stabilization of Markov Jump Systems.

Analysis and Synthesization for A Class of Discrete-Time Markovian Jumping Systems with Mode-Dependent Delays and Actuators Saturation

A Hybrid Sliding Mode Control Scheme of Markovian Jump Systems via Transition Rates Optimal Design

Two-Dimensional Asynchronous Sliding-Mode Control of Markov Jump Roesser Systems

Sliding mode control for Markovian jump systems with external disturbance

Stochastic Stability Analysis for Discrete-Time Singular Markov Jump Systems with Time-Varying Delay and Piecewise-Constant Transition Probabilities

Delay-dependent Stability Analysis for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay

Extended Dissipativity Asynchronous Static Output Feedback Control of Markov Jump Systems

Finite-time Stochastic Boundedness of Markovian Jump Systems: A Sliding-Mode-based Hybrid Design Method

Stability Analysis for Discrete-Time Markov Jump System

Control of Discrete-Time Markovian Jumping Systems with Unknown Delay and Actuators Saturation

Analysis and Synthesis of Markov Jump Linear Systems With Time-Varying Delays and Partially Known Transition Probabilities

Stability Analysis for A Class of Discrete-Time Markovian Jumping Systems with Input Quantization

Stochastic Stability Analysis of Markovian Jump Linear Systems with Incomplete Transition Descriptions

Sliding Mode Output Feedback Controller Design of Discrete-Time Markov Jump System Based on Hidden Markov Model Approach