Almost Sure Exponential Stability of Time-Varying Linear Stochastic Markovian Jump Systems

Xiaohua Liu,Xueyan Zhao,Feiqi Deng,Wenhua Gao

DOI: https://doi.org/10.1109/ccta.2019.8920413

2019-01-01

Abstract:This paper studies the the stability of time-varying linear stochastic Markovian jump systems. Compared with the past literature, the effect of both time-varying parameter and Markovian jumps have been highlighted in the main results.

What problem does this paper attempt to address?

Mean-square stability of stochastic Markovian jumping systems with variable delay

Yun Chen,Anke Xue,Jianzhong Wang,Hongye Su,Ming Ge

DOI: https://doi.org/10.3182/20110828-6-IT-1002.01938

2011-01-01

Abstract:The mean-square stability of stochastic Markovian jumping systems with variable delay is investigated in this paper. Based on Lyapunov-Krasovskii functional (LKF) method, new stability criteria are presented by applying generalized Finsler lemma (GFL). Convex analysis property is applied to use the information of the time-varying delay such that the worst-case enlargement for variable delay is avoided. The result is formulated in terms of a set of linear matrix inequalities (LMIs). Numerical examples are given to show the effectiveness of the approach. © 2011 IFAC.
Delay-range-dependent and delay-distribution-independent stability criteria for discrete-time singular Markovian jump systems

Falu Weng,Weijie Mao

DOI: https://doi.org/10.1007/s12555-012-0200-4

2013-01-01

Abstract:The problem of delay-range-dependent stability for discrete-time singular Markovian jump systems with time-varying delay is discussed in this paper. Based on time-delay partitioning technique, a new delay-range-dependent Lyapunov functional is established firstly. Then, based on the probability idea, LMIs-based delay-range-dependent and delay-distribution-independent conditions are proposed for the system to be regular, causal, and stochastically stable. Furthermore, in terms of solving a set of coupled LMIs, the stabilizing controller is obtained such that the closed-loop system is regular, causal, and stochastically stable. Finally, numerical examples are given to show the results derived from the proposed methods are less conservative than the existing ones.
Asymptotic Stability of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps

R. H. Huan,W. Q. Zhu,F. Ma,Z. G. Ying

DOI: https://doi.org/10.1016/j.probengmech.2016.02.005

IF: 2.954

2016-01-01

Probabilistic Engineering Mechanics

Abstract:Systems which specifications change abruptly and statistically, referred to as Markovian-jump systems, are considered in this paper. An approximate method is presented to assess the asymptotic stability, with probability one, of nonlinear, multi-degree-of-freedom, Markovian-jump quasi-nonintegrable Hamiltonian systems subjected to stochastic excitations. Using stochastic averaging and linearization, an approximate formula for the largest Lyapunov exponent of the Hamiltonian equations is derived, from which necessary and sufficient conditions for asymptotic stability are obtained for different jump rules. In a Markovian-jump system with unstable operating forms, the stability conditions prescribe limitations on time spent in each unstable form so as to render the entire system asymptotically stable. The validity and utility of this approximate technique are demonstrated by a nonlinear two-degree-of-freedom oscillator that is stochastically driven and capable of Markovian jumps.
Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

R. H. Huan,R. C. Hu,D. Pu,W. Q. Zhu

DOI: https://doi.org/10.1155/2016/9641075

IF: 1.616

2015-01-01

Shock and Vibration

Abstract:The semi-infinite time optimal control for a class of stochastically excited Markovian jump nonlinear system is investigated. Using stochastic averaging, each form of the system is reduced to a one-dimensional partially averaged Itô equation of total energy. A finite set of coupled dynamical programming equations is then set up based on the stochastic dynamical programming principle and Markovian jump rules, from which the optimal control force is obtained. The stationary response of the optimally controlled system is predicted by solving the Fokker-Planck-Kolmogorov (FPK) equation associated with the fully averaged Itô equation. Two examples are worked out in detail to illustrate the application and effectiveness of the proposed control strategy.
Stochastic Stability Analysis for Discrete-Time Singular Markov Jump Systems with Time-Varying Delay and Piecewise-Constant Transition Probabilities

Zheng-Guang Wu,Ju H. Park,Hongye Su,Jian Chu

DOI: https://doi.org/10.1016/j.jfranklin.2012.08.012

IF: 4.246

2012-01-01

Journal of the Franklin Institute

Abstract:This paper concerns the stochastic stability analysis for discrete-time singular Markov jump systems with time-varying delay and time-varying transition probabilities. The time-varying transition probabilities in the underlying systems are assumed to be finite piecewise-constant. Based on the delay partitioning technique, a delay-dependent stochastic stability condition is derived for these systems, which is formulated by linear matrix inequalities and thus can be checked easily. Some special cases are also considered. Finally, two numerical examples are provided to demonstrate the application and less conservativeness of the developed approaches.
Delay-dependent Stability Analysis for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay

Zheng-Guang Wu,Peng Shi,Hongye Su,Jian Chu

DOI: https://doi.org/10.1080/00207721.2011.564327

IF: 2.648

2012-01-01

International Journal of Systems Science

Abstract:This article considers the problem of delay-dependent stability analysis for a class of discrete-time singular systems with Markovian jump and time-varying delay. The transition probabilities in Markov chain are assumed to be partially unknown. In terms of linear matrix inequality approach, the delay-dependent criteria are proposed to ensure the underlying system to be regular, causal and stochastically stable. Several numerical examples are given to demonstrate the effectiveness and less conservatism of the obtained results.
Improved delay-dependent stability conditions and H∞ control for jump time-delay systems.

yongyan cao,wenjun yan,anke xue

DOI: https://doi.org/10.1109/CDC.2004.1429496

2004-01-01

Abstract:This paper concerns the problem of the stochastic stability and H ∞ control for the time-delay systems with randomly Markovian jumping parameters. A new approach is proposed to analyze the delay-dependent condition on the stochastic stability by the stochastic Lyapunov-Krasovskii functional approach. It is shown that this new stochastic stability condition combines the so-called delay-independent and delay-dependent conditions. H ∞ disturbance attenuation problem of the systems is also addressed. At last a numerical example illustrates the effectiveness of the proposed approach, and the conservativeness is compared with the existing results.
Stochastic Stability for Uncertain Neutral Markovian Jump Systems with Nonlinear Perturbations

Xinghua Liu,Hongsheng Xi

DOI: https://doi.org/10.1007/s10883-014-9265-0

IF: 1.27

2015-01-01

Journal of Dynamical and Control Systems

Abstract:The delay-range-dependent stochastic stability for uncertain neutral Markovian jump systems with interval time-varying delays and nonlinear perturbations is investigated. The perturbations under consideration are time-varying and norm-bounded. By delay interval dividing, a novel augmented Lyapunov functional which contains triple-integral terms to reduce the conservativeness is introduced. Based on the Lyapunov functional approach and the nature of convex combination, some improved delay-range-dependent stochastic stability criteria are obtained in terms of linear matrix inequalities without introducing any free-weighting matrices. Finally, numerical examples are given to illustrate the effectiveness of the developed techniques.
Almost sure stability for a class of dual switching linear discrete‐time systems

Fei Long,Cai Liu,Weihua Ou

DOI: https://doi.org/10.1002/cpe.5666

2020-01-12

Concurrency and Computation: Practice and Experience

Abstract:<p>In this paper, a dual switching discrete‐time linear system, simultaneously subject to deterministic switching and Markov chain, is considered. This study does not consider the transition probability of the Markov chain as fixed but determined by the current position of deterministic switching. Namely, such dual switching discrete‐time linear system is composed of a family of discrete‐time Markov jump systems and follows a rule that directs the switching sequences between them. The exponentially almost sure stability problem, for dual switching discrete‐time linear system with exponential uncertainty, is addressed by using persistent dwell time and stochastic multi‐Lyapunov function. The sufficient conditions for the exponentially almost sure stability of dual switching discrete‐time linear system are expressed as linear matrix inequalities. Finally, a simulation example demonstrates the validity of the derived results.</p>
Existence, Uniqueness, and Almost Sure Exponential Stability of Solutions to Nonlinear Stochastic System with Markovian Switching and Lévy Noises

Chao Wei

DOI: https://doi.org/10.1155/2020/2804184

IF: 2.3

2020-06-20

Complexity

Abstract:This paper is concerned with existence, uniqueness, and almost sure exponential stability of solutions to nonlinear stochastic system with Markovian switching and Lévy noises. Firstly, the existence and uniqueness of solutions to the system is studied. Then, the almost sure exponential stability of the system is derived. Finally, an example is presented to illustrate the results.

mathematics, interdisciplinary applications,multidisciplinary sciences
Stabilization of differential inclusion systems with Markovian jumping

Liu, H.,Ding, S.,Zhou, H.

DOI: https://doi.org/10.1109/ChiCC.2014.6895857

2014-01-01

Abstract:The stabilization of differential inclusions with Markovian jumping is discussed. A kind of uncertain Markovian jumping systems are modeled as differential inclusions with Markovian jumping. Based on the convex hull Lyapunov function, a kind of stochastical Lyapunov function is presented. The feedback control law is obtained to make the closed-loop system exponentially stable in the mean square. Finally, a simulation is given to show the effectiveness of this control design.
Stability with General Decay Rates of Stochastic Differential Delay Equations with Poisson Jumps and Markovian Switching

Wen Zhang,Jun Ye,Haibo Li

DOI: https://doi.org/10.1016/j.spl.2014.04.024

IF: 0.718

2014-01-01

Statistics & Probability Letters

Abstract:In this paper, some criteria on pth moment stability and almost sure stability with general decay rates of stochastic differential delay equations with Poisson jumps and Markovian switching are obtained. Two examples are presented to illustrate our theories.
Stationary Response of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps

Rong-Hua Huan,Wei-qiu Zhu,Fai Ma,Zu-guang Ying

DOI: https://doi.org/10.1115/1.4029954

2015-01-01

Journal of Applied Mechanics

Abstract:Systems whose specifications change abruptly and statistically, referred to as Markovian-jump systems, are considered in this paper. An approximate method is presented to assess the stationary response of multidegree, nonlinear, Markovian-jump, quasi-nonintegrable Hamiltonian systems subjected to stochastic excitation. Using stochastic averaging, the quasi-nonintegrable Hamiltonian equations are first reduced to a one-dimensional Itô equation governing the energy envelope. The associated Fokker–Planck–Kolmogorov equation is then set up, from which approximate stationary probabilities of the original system are obtained for different jump rules. The validity of this technique is demonstrated by using a nonlinear two-degree oscillator that is stochastically driven and capable of Markovian jumps.
On Exponential Stability for a Class of Uncertain Neutral Markovian Jump Systems with Mode-Dependent Delays

Xinghua Liu,Hongsheng Xi

DOI: https://doi.org/10.1155/2013/691650

2013-01-01

Abstract and Applied Analysis

Abstract:The exponential stability of neutral Markovian jump systems with interval mode-dependent time-varying delays, nonlinear perturbations, and partially known transition rates is investigated. A novel augmented stochastic Lyapunov functional is constructed, which employs the improved bounding technique and contains triple-integral terms to reduce conservativeness; then the delay-range-dependent and rate-dependent exponential stability criteria are developed by Lyapunov stability theory, reciprocally convex lemma, and free-weighting matrices. The corresponding results are extended to the uncertain case. Finally, numerical examples are given to illustrate the effectiveness of the proposed methods.
Asymptotic stability analysis of nonlinear stochastic semiâ€�Markov jump systems

Jiamin Liu,Patrizio Colaneri,Paolo Bolzern,Zhaoâ€�Yan Li

DOI: https://doi.org/10.1002/rnc.6837

IF: 3.8973

2023-06-26

International Journal of Robust and Nonlinear Control

Abstract:In this article, three different types of stochastic asymptotic stability for nonlinear stochastic semiâ€�Markov jump systems (SSMJS) are investigated. Novel sufficient conditions for p th (p>0) â€�moment asymptotic stability, almost sure asymptotic stability and stochastic asymptotic stability in the large are obtained. It is remarkable that the obtained results in the latter case cover the results in existing literature. Finally, two examples are presented to confirm the validity of the obtained theoretical results.

automation & control systems,engineering, electrical & electronic,mathematics, applied
New expectation-based conditions for almost sure exponential stability of discrete-time semi-Markovian linear systems with time-delayed control

Yongchun Yan,Dianli Zhao

DOI: https://doi.org/10.1016/j.jfranklin.2024.106875

IF: 4.246

2024-04-29

Journal of the Franklin Institute

Abstract:This paper studies almost sure exponential stability of discrete-time semi-Markovian linear systems with time-delayed control. New expectation-based sufficient conditions for almost sure exponential stability of the system are derived by employing the coupled Lyapunov function related to the sojourn time and the ergodic property of semi-Markov chains. Compared with known results on almost sure exponential stability of discrete-time semi-Markovian linear systems, the results in this paper are shown to be less conservative. At last, two numerical examples are given to illustrate the results.

automation & control systems,engineering, electrical & electronic, multidisciplinary,mathematics, interdisciplinary applications
New Results on Stability of Singular Stochastic Markov Jump Systems with State-Dependent Noise

Yong Zhao,Weihai Zhang

DOI: https://doi.org/10.48550/arXiv.1509.01102

2015-09-03

Optimization and Control

Abstract:This paper aims to develop the stability theory for singular stochastic Markov jump systems with state-dependent noise, including both continuous- and discrete-time cases. The sufficient conditions for the existence and uniqueness of a solution to the system equation are provided. Some new and fundamental concepts such as non-impulsiveness and mean square admissibility are introduced, which are different from those of other existing works. By making use of the $\mathcal{H}$-representation technique and the pseudo inverse $E^+$ of a singular matrix $E$, sufficient conditions ensuring the system to be mean square admissible are established in terms of strict linear matrix inequalities, which can be regarded as extensions of the corresponding results of deterministic singular systems and normal stochastic systems. Practical examples are given to demonstrate the effectiveness of the proposed approaches.
Delay-dependent Stabilization of Singular Markovian Jump Systems with State Delay

Zhengguang Wu,Hongye Su,Jian Chu

DOI: https://doi.org/10.1007/s11768-009-8145-8

2009-01-01

Abstract:This paper deals with the delay-dependent stabilization problem for singular systems with Markovian jump parameters and time delays. A delay-dependent condition is established for the considered system to be regular, impulse free and stochastically stable. Based on the condition, a design algorithm of the desired state feedback controller which guarantees the resultant closed-loop system to be regular, impulse free and stochastically stable is proposed in terms of a set of strict linear matrix inequalities （LMIs）. Numerical examples show the effectiveness of the proposed methods.
Delay-dependent Stability for Markovian Jumping Systems with Time-Delay and Partial Information on Transition Probabilities Based on Double Integral Inequality

Zhang Yan,Lou Ke,Liu Shilin,Huang Yiqing

DOI: https://doi.org/10.1109/chicc.2016.7553302

2016-01-01

Abstract:This paper focuses on delay-dependent stability for a class of Markovian jumping systems with time delay, whose transition rates are not completely known. Taking into account the influence of time delay and partial information on transition probabilities, double integral inequality and extended Wirtinger's inequality are used to value the bounds of Lyapunov-Krasovskii function and their weak infinitesimal generator operator, and free-connection is applied to separate the unknown transition rates. As a result, improved stability criteria are derived. Finally, two examples are provided to show the effectiveness and the benefits of the proposed criteria.
Stabilization Control for a Class of Two-Dimensional Markovian Jumping Nonlinear Systems with Time-delays

Zhao Ping,Kang Yu

DOI: https://doi.org/10.1109/chicc.2006.4347502

2006-01-01

Abstract:In this paper, stabilization control problem for a class of two dimensional Markovian jumping nonlinear systems with time-delays is investigated. A sufficient condition of existence and uniqueness of the solution process to Markovian jumping nonlinear systems is given. And, a criterion for asymptotical stability in probability is obtained. Through properly constructing Lyapunov function and using the backstepping method, a memoryless state-feedback controller is designed. It is shown that the equilibrium of the closed-loop system is globally asymptotically stable in probability.

Almost Sure Exponential Stability of Time-Varying Linear Stochastic Markovian Jump Systems

Mean-square stability of stochastic Markovian jumping systems with variable delay

Delay-range-dependent and delay-distribution-independent stability criteria for discrete-time singular Markovian jump systems

Asymptotic Stability of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Stochastic Stability Analysis for Discrete-Time Singular Markov Jump Systems with Time-Varying Delay and Piecewise-Constant Transition Probabilities

Delay-dependent Stability Analysis for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay

Improved delay-dependent stability conditions and H∞ control for jump time-delay systems.

Stochastic Stability for Uncertain Neutral Markovian Jump Systems with Nonlinear Perturbations

Almost sure stability for a class of dual switching linear discrete‐time systems

Existence, Uniqueness, and Almost Sure Exponential Stability of Solutions to Nonlinear Stochastic System with Markovian Switching and Lévy Noises

Stabilization of differential inclusion systems with Markovian jumping

Stability with General Decay Rates of Stochastic Differential Delay Equations with Poisson Jumps and Markovian Switching

Stationary Response of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps

On Exponential Stability for a Class of Uncertain Neutral Markovian Jump Systems with Mode-Dependent Delays

Asymptotic stability analysis of nonlinear stochastic semiâ€�Markov jump systems

New expectation-based conditions for almost sure exponential stability of discrete-time semi-Markovian linear systems with time-delayed control

New Results on Stability of Singular Stochastic Markov Jump Systems with State-Dependent Noise

Delay-dependent Stabilization of Singular Markovian Jump Systems with State Delay

Delay-dependent Stability for Markovian Jumping Systems with Time-Delay and Partial Information on Transition Probabilities Based on Double Integral Inequality

Stabilization Control for a Class of Two-Dimensional Markovian Jumping Nonlinear Systems with Time-delays