H2/H∞ Control for MJLS with Infinite Markov Chain

Ting Hou,Jie Wang,Yueying Liu,Xiao Shen

DOI: https://doi.org/10.1155/2017/9038469

IF: 1.43

2017-01-01

Mathematical Problems in Engineering

Abstract:With the help of a stochastic bounded real lemma, we deal with finite horizon H2/H∞ control problem for discrete-time MJLS, whose Markov chain takes values in an infinite set. Besides, a unified control design for H2, H∞, and H2/H∞ is given.

What problem does this paper attempt to address?

Finite horizon H 2 /H ∞ control for discrete-time time-varying stochastic systems with infinite Markov jumps

Jie Wang,Ting Hou

DOI: https://doi.org/10.23919/chicc.2017.8027862

2017-01-01

Abstract:This paper discusses the finite horizon H 2 /H ∞ control for discrete-time time-varying systems with infinite Markov jumps parameters and multiplicative noise. Firstly, we present a stochastic bounded real lemma, which is crucial to solve the mixed H 2 /H ∞ control problem of the concerned systems. A sufficient and necessary condition for the existence of the state feedback H 2 /H ∞ controller is represented by the solvability of four coupled difference matrix-valued recursions.
Finite Horizon H2∕H∞ Control for SDEs with Infinite Markovian Jumps

Hou Ting,Liu Yueying,Deng Feiqi

DOI: https://doi.org/10.1016/j.nahs.2019.05.009

IF: 5.477

2019-01-01

Nonlinear Analysis Hybrid Systems

Abstract:This paper concerns the finite horizon H-2/H-infinity control for a broad class of linear It (o) over cap stochastic differential equations (SDEs) with infinite Markovian jumps and (x, u, v)-dependent noise. We derive stochastic bounded real lemma (SBRL) and linear quadratic (LQ) optimal control result for the considered system at first. Further, a necessary and sufficient condition, which is represented by the solution of a countably infinite set of coupled generalized difference Riccati equations (GDREs), is proposed for the existence of the mixed H-2/H-infinity control. Moreover, an iterative algorithm is given to solve GDREs. (C) 2019 Elsevier Ltd. All rights reserved.
Infinite horizon H∞ control for nonlinear stochastic Markov jump systems with (x,u,v)-dependent noise via fuzzy approach

Li Sheng,Ming Gao,Weihai Zhang,Bor-Sen Chen

DOI: https://doi.org/10.1016/j.fss.2014.10.015

2015-01-01

Abstract:In this paper, the H∞ control problem is studied for nonlinear stochastic Markov jump systems with state, control and external disturbance-dependent noise ((x,u,v)-dependent noise for short). A sufficient condition is derived for the infinite horizon H∞ control of such systems in terms of a set of coupled second-order Hamilton–Jacobi inequalities (HJIs). In general, it is difficult to solve these coupled HJIs. By using fuzzy approach, the infinite horizon H∞ control design for nonlinear stochastic Markov jump systems is developed via solving a set of linear matrix inequalities (LMIs) instead of HJIs. Two numerical examples are presented to illustrate the effectiveness of the proposed design methods.
Finite Horizon H 2 /H ∞ Control of Time-Varying Stochastic Systems with Markov Jumps and ( X, U, V )-Dependent Noise

Ming Gao,Li Sheng,Weihai Zhang

DOI: https://doi.org/10.1049/iet-cta.2013.1070

IF: 2.67

2014-01-01

IET Control Theory and Applications

Abstract:This study investigates the finite horizon H-2/H control of time-varying stochastic Markov jump systems (SMJSs) with state, control and disturbance-dependent noise. Firstly, the stochastic bounded real lemma of SMJSs is established, which by itself has theoretical importance. Secondly, several necessary and sufficient conditions for H-2/H control of SMJSs are proposed by means of coupled generalised differential Riccati equations. Finally, two numerical examples are given to show the effectiveness of the obtained results.
H∞ Control for Markovian Jump Linear Singularly Perturbed Systems

HP Liu,FC Sun,ZQ Sun

DOI: https://doi.org/10.1049/ip-cta:20040852

2004-01-01

IEE Proceedings - Control Theory and Applications

Abstract:The stochastic stability and H-infinity disturbance attenuation is studied for Markovian jump linear singularly perturbed systems (MJLSPS) via a matrix inequality approach. Both analysis and synthesis problems are investigated. In analysis, the stochastic stability and H-infinity performance conditions are derived and recast in the formulation of a set of coupled linear matrix inequalities. In synthesis, the sufficient conditions under which the closed-loop H-infinity disturbance attenuation performance turn out to be in the form of a set of coupled bilinear matrix inequalities and are solved with a proposed heuristic algorithm, and an epsilon-independent H-infinity controller can then be obtained. The reduced controller which is independent of the fast states is also developed. The results proposed apply not only to standard, but also to nonstandard MJLSPS. An example is presented to illustrate the proposed algorithm.
Nonlinear Stochastic Control with Markov Jumps and -Dependent Noise: Finite and Infinite Horizon Cases

li sheng,meijun zhu,weihai zhang,yuhong wang

DOI: https://doi.org/10.1155/2014/948134

IF: 1.43

2014-01-01

Mathematical Problems in Engineering

Abstract:This paper is concerned with the H infinity control problem for nonlinear stochastic Markov jump systems with state, control, and external disturbance-dependent noise. By means of inequality techniques and coupled Hamilton-Jacobi inequalities, both finite and infinite horizon H infinity control designs of such systems are developed. Two numerical examples are provided to illustrate the effectiveness of the proposed design method.
Nonlinear Stochastic H∞ Control with Markov Jumps and (x,u,v)-Dependent Noise: Finite and Infinite Horizon Cases

Li Sheng,Meijun Zhu,Weihai Zhang,Yuhong Wang

DOI: https://doi.org/10.1155/2014/948134

IF: 1.43

2014-01-01

Mathematical Problems in Engineering

Abstract:This paper is concerned with the H∞ control problem for nonlinear stochastic Markov jump systems with state, control, and external disturbance-dependent noise. By means of inequality techniques and coupled Hamilton-Jacobi inequalities, both finite and infinite horizon H∞ control designs of such systems are developed. Two numerical examples are provided to illustrate the effectiveness of the proposed design method.
$\mathcal H_{\infty }$ Control for 2-D Markov Jump Systems in Roesser Model

Zhengguang Wu,Ying Shen,P. Shi,Zhan Shu,H. Su

DOI: https://doi.org/10.1109/TAC.2018.2831176

IF: 6.549

2018-01-01

IEEE Transactions on Automatic Control

Abstract:This paper considers the problem of asynchronous <inline-formula><tex-math notation="LaTeX">$\mathcal H_{\infty }$</tex-math></inline-formula> control for two-dimensional (2-D) Markov jump systems. The underlying system is described based upon the Roesser model. Especially, the hidden Markov model is employed when dealing with the asynchronization between a controlled system and a controller, and the relation between them is constructed through a conditional probability matrix. Based on the Lyapunov function technique, the asymptotic mean square stability and <inline-formula><tex-math notation="LaTeX">$\mathcal H_{\infty }$</tex-math></inline-formula> noise attenuation performance are investigated for the closed-loop 2-D system. Moreover, the controller gain can be obtained by solving a convex optimization problem. An example is presented to show the effectiveness and potential of the proposed new design technique.
Relaxed H ∞ Controller Design for Continuous Markov Jump System with Incomplete Transition Probabilities

Mouquan Shen,Guangming Zhang,Yuhao Yuan,Dan Ye

DOI: https://doi.org/10.1007/s00034-013-9695-z

IF: 2.146

2014-01-01

Transactions of the Institute of Measurement and Control

Abstract:This paper studies the H ∞ state feedback control of continuous-time Markov jump linear systems (MJLSs) with incomplete transition probabilities (TPs) which are allowed to be known, uncertain with known lower and upper bounds, and completely unknown. Combining the TP property and a matrix transformation technique, a new method for the H ∞ controller synthesis is proposed in terms of linear matrix inequalities (LMIs). The dominant feature of the proposed method is that two sets of slack variables without coupling relationship are introduced. It is shown that the proposed method is less conservative than the existing result. The effectiveness of the proposed method is further illustrated by numerical examples.
Some remarks on infinite horizon stochastic H2/H∞ control with (x,u,v)-dependent noise and Markov jumps

li sheng,weihai zhang,ming gao

DOI: https://doi.org/10.1016/j.jfranklin.2015.05.037

IF: 4.246

2015-01-01

Journal of the Franklin Institute

Abstract:This paper investigates the infinite horizon H2/H∞ control problem for stochastic systems with (x,u,v)-dependent noise and Markov jumps. Under the condition of exact detectability, a necessary and sufficient condition for the infinite horizon stochastic H2/H∞ control is derived in terms of four sets of coupled matrix-valued equations. The relationship between the infinite horizon H2/H∞ control and the Nash equilibrium point is discussed when disturbance does or does not enter into the diffusion term. Moreover, a heuristic iteration algorithm is proposed to solve coupled stochastic Riccati equations for the first time.
H∞ Control of a Class of Piecewise Homogeneous Markov Jump Linear Systems

Lixian Zhang

2009-01-01

Abstract:In this paper, the problem of H-infinity control for a class of Markov jump linear system (MJLS) with time-varying transition rates (TRs) is investigated. The time-varying character of TRs is considered as finite piecewise homogeneous and the variations of TR matrices in the finite set are considered as two types: arbitrary variation and stochastic variation. The latter means that the variations are subject to a higher-level transition rate matrix. The mode-dependent and variation-dependent Lyapunov function evaluated for the system energy is constructed, and the appropriate evolvement of the Lyapunov function is explored for both categories of variations such that the stability and performance analysis of the closed-loop system can be carried out. Then, the H-infinity controllers in an adaptation sense are designed ensuring that the resulting closed-loop systems are stochastically stable and have a guaranteed H-infinity noise-attenuation performance index. A numerical example is provided to verify the theoretical results.
H$$ {H}_{\infty } $$ constraint Pareto optimal control for discrete-time Markov jump linear stochastic systems in finite horizon

Xiushan Jiang,Kai Cui,Dongya Zhao

DOI: https://doi.org/10.1002/asjc.2992

IF: 2.4

2023-01-01

Asian Journal of Control

Abstract:This paper mainly focuses on discrete-time Markov jump linear stochastic systems (DMJLSSs) with external disturbances and multiplicative noise. Due to the multi-player in the systems and multi-objective cost function, the strategy design for these systems is more difficult than the traditional Markov jump stochastic systems. We combine H infinity$$ {H}_{\infty } $$ theory with Pareto control and use the weighted sum method of the objective functional of each player to solve the problem of Pareto cooperative game. Four coupled difference matrix-valued recursion equations (CDMREs) are derived by stochastic bounded real lemma (SBRL). Then, a sufficient and necessary condition for the existence of the Pareto optimal strategy is obtained, and the Pareto solution for every controller is derived under this strategy. A simulation example is given to verify the correctness of the theory.
H ∞ Control for Markovian Jump Systems with Partly Known Transition Probabilities in Discrete-time Domain

Hui-Jie Sun,Ai-Guo Wu,Can Liu

DOI: https://doi.org/10.23919/ccc50068.2020.9188576

2020-01-01

Abstract:In this paper, the H ∞ controller design problem is investigated for the discrete-time Markovian jump linear system in the presence of incomplete transition descriptions. A less conservative criterion is presented such that the considered system is stochastically stable with a guaranteed H ∞ performance index by using the properties of the transition probabilities. In addition, a H ∞ state-feedback controller is proposed for the discrete-time Markovian jump system with incomplete transition description via LMI formulation. Finally, some simulation results are given to verify the effectiveness of the presented methods.
Linear quadratic optimal control for a class of continuous-time nonhomogeneous Markovian jump linear systems in infinite time horizon

Yuzhu Bai,Hui-Jie Sun,Ai-Guo Wu

DOI: https://doi.org/10.1016/j.jfranklin.2020.07.038

IF: 4.246

2020-01-01

Journal of the Franklin Institute

Abstract:In this paper, the infinite time horizon linear quadratic optimal control problem is investigated for the continuous-time Ito stochastic Markovian jump linear systems (MJESs) with time-varying transition rates. It is assumed that the time-varying transition rates of the MJLSs possess piecewise homogeneous time-varying property, which implies that the transition rates are time-varying in the whole time domain but they are time-invariant in some small time intervals. The variations of the transition rates in these small time intervals are considered to be in two cases: arbitrary variation and stochastic variation. With this, the considered system becomes a piecewise homogeneous Ito stochastic MJLS. The main contribution of this paper is that two linear quadratic optimal controllers in infinite time horizon are proposed for the above modeled continuous-time piecewise homogeneous Ito stochastic MJLS in the sense of arbitrary variation and stochastic variation, respectively. Moreover, the sufficient and necessary conditions for the existence of the designed controllers are established based on the existence of the unique positive definite solution of two coupled algebraic Riccati matrix equations. Finally, a simulation example is provided to illustrate the effectiveness of the proposed linear quadratic optimal controllers. (C) 2020 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
H-Infinity Control For Markovian Jump Systems With Partly Known Transition Probabilities In Discrete-Time Domain

Hui-Jie Sun,Ai-Guo Wu,Can Liu

2020-01-01

Abstract:In this paper, the H-infinity controller design problem is investigated for the discrete-time Markovian jump linear system in the presence of incomplete transition descriptions. A less conservative criterion is presented such that the considered system is stochastically stable with a guaranteed H-infinity performance index by using the properties of the transition probabilities. In addition, a H-infinity state-feedback controller is proposed for the discrete-time Markovian jump system with incomplete transition description via LMI formulation. Finally, some simulation results are given to verify the effectiveness of the presented methods.
H∞ Control for Discrete‐time Markovian Jump Linear Systems with Partially Uncertain Transition Probabilities

Hui-Jie Sun,Ying Zhang,Ai-Guo Wu

DOI: https://doi.org/10.1002/oca.2644

2020-01-01

Abstract:SummaryThis work is concerned with the H∞ state‐feedback control for the discrete‐time Markovian jump systems with incomplete knowledge of transition probabilities. A less conservative criterion is proposed via linear matrix inequalities (LMIs) such that the considered systems are stochastically stable and have a prescribed H∞ disturbance attention level. Furthermore, based on the obtained results, a state‐feedback controller is presented via LMIs to guarantee the stochastic stability of the resulted closed‐loop system with a prescribed H∞ performance level γ. The number of the LMIs to be solved in the developed methods is much less than that in many existing methods. A numerical example and a practical example are provided to verify the effectiveness of the presented methods.
H∞ Control of Time-Delay State Feedback Markovian Jump Linear Systems with Uncertain Transition Rates

Chao Li,Yan Wang,Bowen Liu,Zongyue Li

DOI: https://doi.org/10.1109/peam.2011.6135004

2011-01-01

Abstract:This paper deals with the H∞ time-delay control problem for a class of uncertain Markovian jump linear systems (MJLSs). Since it's difficult to obtain the transition rates of real control systems, we consider the systems with uncertain transition rates. Combining H∞ control theory, we propose a sufficient robust stochastic stability criterion of the system. Then, the H∞ time-delay state-feedback controller that makes the underlying system stabilizable with γ-disturbance attenuation is designed. By constructing a Lyapunov functional, the time-delay independent LMI-formatted globally stability criterion is proposed based on robust control theory. Then, numerical example is provided to demonstrate the effectiveness of the derived results.
H ∞ Control of a Class of Extended Markov Jump Linear Systems

L. Zhang,E. -K. Boukas

DOI: https://doi.org/10.1049/iet-cta.2008.0023

2009-01-01

Abstract:A class of extended continuous-time Markov jump linear systems is proposed in this study. The generality lies in that the discrete dynamics of the class of systems is described by a Markov stochastic process, but with only partially known transition probabilities, which relax the traditional assumption in Markov jump systems that all the transition probabilities must be known a priori. Moreover, in contrast with the uncertain transition probabilities studied recently, no structure (polytopic ones), bounds (norm-bounded ones) or 'nominal' terms (both) are required for the partially unknown elements in the transition rate matrix. The sufficient conditions for H-infinity control are derived via the linear matrix inequality formulation such that the closed-loop system is stochastically stable and has a guaranteed H-infinity noise-attenuation performance. A tradeoff can be built using our approach between the difficulties to obtain all the transition probabilities and the systems performance benefits. A numerical example is provided to show the validity and potential of the developed theoretical results.
Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Yichun Li,Shuping Ma

DOI: https://doi.org/10.1016/j.jfranklin.2021.09.013

IF: 4.246

2021-11-01

Journal of the Franklin Institute

Abstract:This paper concerns the indefinite linear quadratic (LQ) optimal control problem for discrete-time singular Markov jump systems (MJSs) with finite and infinite horizon, where the weight matrices for state and control of cost function are all indefinite. Firstly, the indefinite LQ problem for singular MJSs is equivalently transformed into indefinite LQ problem for MJSs under a series of equivalent transformations. Then, the sufficient and necessary condition is proposed for the solvability of finite horizon case, the optimal control and optimal cost value are given, and the resulting optimal closed-loop system is regular, casual. Next, some sufficient and necessary conditions are obtained to ensure the transformed equivalent LQ problem for MJSs to be definite one, which can guarantee the generalized algebraic Riccati equation with Markov jump has a unique semi-positive definite solution. Meanwhile, the optimal control and nonnegative optimal cost value in infinite horizon are acquired, and the resulting optimal closed-loop system is stochastically admissible. Finally, three examples are presented to illustrate the theoretical results.
Finite-time H2/H∞ Control for Linear Itô Stochastic Markovian Jump Systems with Brownian Motion and Poisson Jumps.

Zhiguo Yan,Shiyu Zhong,Shuping He

DOI: https://doi.org/10.1016/j.sysconle.2022.105285

IF: 2.742

2022-01-01

Systems & Control Letters

Abstract:This paper is concerned with the problems of finite-time H2/H∞ control for linear stochastic Markovian jump systems (SMJSs) suffered from external disturbance and both Brownian motion and Poisson jumps. First, with the help of operator spectrum, a necessary and sufficient condition is given for the exact observability of SJMSs with Brownian motion and Poisson jumps, which is utilized to design observer-based controller. Second, a new differential inequality is constructed and the mode-dependent parameter approach (MDPA) is adopted, to obtain some less conservative results for the existence of state feedback and observer-based feedback finite-time H2/H∞ controllers. Compared with the common parameter approach, the advantages of MDPA are clearly shown. Moreover, H2 cost function under observer-based feedback proposed in this paper further considers the estimation errors on the basis of the states and estimations, which is more accurate than previous H2 cost function. Third, two new design algorithms are proposed. One is to search the ranges of some design parameters, and the other is to show the relationship between H2 and H∞ performance indices. Finally, a detailed design example is given to illustrate the merits of the proposed results.

H2/H∞ Control for MJLS with Infinite Markov Chain

Finite horizon H 2 /H ∞ control for discrete-time time-varying stochastic systems with infinite Markov jumps

Finite Horizon H2∕H∞ Control for SDEs with Infinite Markovian Jumps

Infinite horizon H∞ control for nonlinear stochastic Markov jump systems with (x,u,v)-dependent noise via fuzzy approach

Finite Horizon H 2 /H ∞ Control of Time-Varying Stochastic Systems with Markov Jumps and ( X, U, V )-Dependent Noise

H∞ Control for Markovian Jump Linear Singularly Perturbed Systems

Nonlinear Stochastic Control with Markov Jumps and -Dependent Noise: Finite and Infinite Horizon Cases

Nonlinear Stochastic H∞ Control with Markov Jumps and (x,u,v)-Dependent Noise: Finite and Infinite Horizon Cases

$\mathcal H_{\infty }$ Control for 2-D Markov Jump Systems in Roesser Model

Relaxed H ∞ Controller Design for Continuous Markov Jump System with Incomplete Transition Probabilities

Some remarks on infinite horizon stochastic H2/H∞ control with (x,u,v)-dependent noise and Markov jumps

H∞ Control of a Class of Piecewise Homogeneous Markov Jump Linear Systems

H$$ {H}_{\infty } $$ constraint Pareto optimal control for discrete-time Markov jump linear stochastic systems in finite horizon

H ∞ Control for Markovian Jump Systems with Partly Known Transition Probabilities in Discrete-time Domain

Linear quadratic optimal control for a class of continuous-time nonhomogeneous Markovian jump linear systems in infinite time horizon

H-Infinity Control For Markovian Jump Systems With Partly Known Transition Probabilities In Discrete-Time Domain

H∞ Control for Discrete‐time Markovian Jump Linear Systems with Partially Uncertain Transition Probabilities

H∞ Control of Time-Delay State Feedback Markovian Jump Linear Systems with Uncertain Transition Rates

H ∞ Control of a Class of Extended Markov Jump Linear Systems

Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Finite-time H2/H∞ Control for Linear Itô Stochastic Markovian Jump Systems with Brownian Motion and Poisson Jumps.