On sufficient conditions of transience for a stochastic differential equation with switching

Kirill Mosievich

2024-06-25

Abstract:Conditions sufficient for the transience of the process have been established for the Markov diffusion model with switching and two modes, transient and ergodic, with intensities bounded away from zero. This paper shows limitations on the conditions for exponential ergodicity with a given switching system.

Probability

What problem does this paper attempt to address?

The Euler-Maruyama Approximation of State-Dependent Regime Switching Diffusions

Xinghu Jin,Tian Shen,Zhonggen Su,Yuzhen Tan

DOI: https://doi.org/10.1007/s10959-024-01379-5

2024-01-01

Journal of Theoretical Probability

Abstract:In this paper, we consider the state-dependent regime switching diffusion process (X(t), R(t))_t ⩾ 0 , where the drift term does not necessarily satisfy the dissipative condition for certain states of the switching component. We develop delicately the Lindeberg replacement trick and a change-of-measure technique to obtain the convergence rate between the law of (X(t), R(t))_t⩾ 0 and that of its Euler-Maruyama scheme with constant and decreasing step sizes. This convergence rate is quantified in terms of a function-class distance d_𝒢 . Moreover, we establish the ergodicity property of the Euler-Maruyama scheme. To illustrate our theoretical findings, we present in detail an example.
Exponential stability of neutral stochastic differential functional equations with Markovian switching

Xining Li,Qimin Zhang

DOI: https://doi.org/10.1109/ICMLC.2009.5212513

2009-01-01

Abstract:A sufficient condition of exponential stability is established for a class of neutral stochastic differential functional equations Markovian jumping parameters. The analysis consist in using Burkholder-Davis-Gundy lemma and Ito's formula derived for our stability purposes. The stability results derived also are applied to a piecewise deterministic system which arises quite often in practice in systems with multiple modes. An application to neutral stochastic differential functional equation is studied to illustrate our theory.
Asymptotic stability of switching diffusions having sub-exponential rates of decay

Haibo Li,George Yin,Jun Ye

2013-01-01

Dynamic Systems and Applications

Abstract:This work focuses on stability of switching diffusions, in which both continuous dynamics and discrete events coexist. Our attention is devoted to the case that one has asymptotic stability but the decay rates are slower than exponential. The main effort is on obtaining asymptotic results in the almost sure sense. Sufficient conditions are provided for switching diffusion systems whose switching component depends on the diffusion process. Then Markovian regime-switching diffusions are treated, in which weaker conditions are needed. In addition, systems with delays are also treated. Examples are provided to demonstrate our results.
Stability of Reaction–diffusion Systems with Stochastic Switching

Lijun Pan,Jinde Cao,Ahmed Alsaedi

DOI: https://doi.org/10.15388/na.2019.3.1

IF: 1.743

2019-01-01

Nonlinear Analysis

Abstract:In this paper, we investigate the stability for reaction systems with stochastic switching. Two types of switched models are considered: (i) Markov switching and (ii) independent and identically distributed switching. By means of the ergodic property of Markov chain, Dynkin formula and Fubini theorem, together with the Lyapunov direct method, some sufficient conditions are obtained to ensure that the zero solution of reaction–diffusion systems with Markov switching is almost surely exponential stable or exponentially stable in the mean square. By using Theorem 7.3 in [R. Durrett, Probability: Theory and Examples, Duxbury Press, Belmont, CA, 2005], we also investigate the stability of reaction–diffusion systems with independent and identically distributed switching. Meanwhile, an example with simulations is provided to certify that the stochastic switching plays an essential role in the stability of systems.
Recurrence and Ergodicity of Switching Diffusions with Past-Dependent Switching Having a Countable State Space

Dang H. Nguyen,George Yin

DOI: https://doi.org/10.1007/s11118-017-9641-y

2017-07-03

Potential Analysis

Abstract:This work focuses on recurrence and ergodicity of switching diffusions consisting of continuous and discrete components, in which the discrete component takes values in a countably infinite set and the rates of switching at current time depend on the value of the continuous component over an interval including certain past history. Sufficient conditions for recurrence and ergodicity are given. Moreover, the relationship between systems of partial differential equations and recurrence when the switching is past-independent is established under suitable conditions.

mathematics
Strong Ergodicity of the Regime-Switching Diffusion Processes

Jinghai Shao,Fubao Xi

DOI: https://doi.org/10.1016/j.spa.2013.06.002

IF: 1.43

2013-01-01

Stochastic Processes and their Applications

Abstract:We provide criteria for the strong ergodicity of regime-switching diffusion processes. Our conditions are imposed on the coefficients of the processes. Particularly, we show that for regime-switching diffusions on the half line, if the corresponding diffusion on each fixed environment is strongly ergodic, then the regime-switching diffusion is strongly ergodic as well, which does not depend on the changing rate of the environment. Moreover, the converse is not always true, which is shown by an example. For transience, recurrence and positive recurrence, there is no such good consistency [R. Pinsky and M. Scheutzow, Some remarks and examples concerning the transience and recurrence of random diffusions, Ann. Inst. Henri. Poincaré 28 (1992) 519–536].
Exponential Ergodicity for Stochastic Functional Differential Equations with Markovian Switching

Yafei Zhai,Fubao Xi

DOI: https://doi.org/10.1016/j.jmaa.2023.128030

IF: 1.417

2024-01-01

Journal of Mathematical Analysis and Applications

Abstract:This paper investigates exponential ergodicity for several kinds of stochastic functional differential equations (SFDEs) with Markovian switching. Firstly, we derive exponential ergodicity for SFDEs with Markovian switching using the Krylov-Bogoliubov theorem in the space C equipped with the uniform topology. Then, we obtain exponential ergodicity for neutral SFDEs with Markovian switching by making use of M-matrix theory and a generalized Razumikhin-type argument. Finally, we focus on SFDEs driven by Lévy processes with Markovian switching and prove exponential ergodicity through the Kurtz criterion of tightness for the space D endowed with the Skorohod topology. A concrete example is also given to illustrate our main results.
Stability and rate of decay for solutions to stochastic differential equations with Markov switching

Shuaishuai Lu,Xue Yang

DOI: https://doi.org/10.58997/ejde.2024.01

2024-01-03

Electronic journal of differential equations

Abstract:In this article, we present the almost sure asymptotic stability and a general rate of decay for solutions to stochastic differential equations (SDEs) with Markov switching. By establishing a suitable Lyapunov function and using an exponential Martingale inequality and the Borel-Cantelli theorem, we give sufficient conditions for the asymptotic stability. Also, we obtain sufficient conditions for the construction of two kinds of Lyapunov functions. Finally give two examples to illustrate the validity of our results. For more information see https://ejde.math.txstate.edu/Volumes/2024/01/abstr.html

mathematics, applied
Necessary and Sufficient Conditions of Near‐optimality in a Regime‐switching Diffusion Model

Min Li,Zhen Wu

DOI: https://doi.org/10.1002/oca.2571

2020-01-01

Abstract:SummaryThis paper is concerned with the stochastic near‐optimal control problem for a regime‐switching diffusion model, where the control domains are convex. The controlled system is described by the Itô‐type stochastic differential equation (SDE) with a continuous‐time Markov chain, which possesses a finite state structure. Some new estimates for state and adjoint processes are obtained in the presence of the Markovian jumps. Based on these estimates and Ekeland's variational principle, the necessary and sufficient conditions for near‐optimality of this model are established. A numerical example is given to illustrate the effectiveness of theoretical results.
Controllability of Stochastic Differential Equations with Markovian Switching

Guangliang Zhao,Zhixin Yang,Quan Yuan,Le Yi Wang

DOI: https://doi.org/10.1109/allerton.2017.8262846

2017-01-01

Abstract:For systems of switching diffusions, a concept of controllability is proposed by using the finite expected value of the first reaching time (or mean reaching time) to an arbitrarily small open set of the terminal point. A necessary and sufficient condition is obtained utilizing positive recurrent. A verification criterion is provided by using Liapnov functions, and a matrix form criterion if the system is linear. Finally, a simulation example is provided to show that when coupled with regime switching, the hybrid system of uncontrollable ODEs could be controllable.
Attraction of Stochastic Neutral Delay Differential Equations with Markovian Switching

Bing Li,Daoyi Xu

DOI: https://doi.org/10.1093/imamci/dns043

2013-01-01

IMA Journal of Mathematical Control and Information

Abstract:In this paper, we investigate stochastic neutral delay differential equations with Markovian switching. By constructing an improved singular differential inequality and using some stochastic analysis techniques, we derive a sufficient criterion for ensuring the existence of the global attracting set and give a quantitative estimation with exponential decay form for solutions. Two numerical examples are discussed to illustrate the efficiency of the proposed method.
Permanence and Extinction of Stochastic Regime-Switching Mutualism Model

Guangying Lv,Beibei Zhang

DOI: https://doi.org/10.1142/s179352452050028x

2020-01-01

International Journal of Biomathematics

Abstract:This paper is concerned with the permanence and extinction of a stochastic regime-switching mutualism model. We aim to find the difference between the stochastic mutualism model with regime-switching and without regime-switching. By studying ergodicity of regime-switching diffusion processes, we establish the sufficient conditions to estimate the permanence and extinction of a species in a random switching environment. Moreover, compared with the system without switching, the advantages of the stochastic regime-switching mutualism model are given.
Stochastic functional differential equation under regime switching

Ling Bai,Zhang Kai

DOI: https://doi.org/10.1155/2012/206438

IF: 1.4

2012-01-01

Discrete Dynamics in Nature and Society

Abstract:We discuss stochastic functional differential equation under regime switching dx(t) = f(x(t),r(t),t)dt + q(r(t))x(t)dW(1)(t) + sigma(r(t))vertical bar x(t)|(beta)x(t)dW(2)(t). We obtain unique global solution of this system without the linear growth condition; furthermore, we prove its asymptotic ultimate boundedness. Using the ergodic property of the Markov chain, we give the sufficient condition of almost surely exponentially stable of this system.
Stochastic Delay Logistic Model under Regime Switching

Zheng Wu,Hao Huang,Lianglong Wang

DOI: https://doi.org/10.1155/2012/241702

2012-01-01

Abstract and Applied Analysis

Abstract:This paper is concerned with a delay logistical model under regime switching diffusion in random environment. By using generalized Itô formula, Gronwall's inequality, and Young's inequality, some sufficient conditions for existence of global positive solutions and stochastically ultimate boundedness are obtained, respectively. Also, the relationships between the stochastic permanence and extinction as well as asymptotic estimations of solutions are investigated by virtue of V-function technique, M-matrix method, and Chebyshev's inequality. Finally, an example is given to illustrate the main results.
Ergodicity of Regime-Switching Functional Diffusions with Infinite Delay and Application to a Numerical Algorithm for Stochastic Optimization

Banban Shi,Ya Wang,Fuke Wu

DOI: https://doi.org/10.1137/22m1470050

IF: 2.2

2022-01-01

SIAM Journal on Control and Optimization

Abstract:It is well known that ergodicity and the strong law of large numbers (SLLN) play important roles in stochastic control and stochastic approximations. For a class of regime-switching functional diffusion processes with infinite delay, this paper establishes exponential ergodicity in a Wasserstein distance under certain ``averaging conditions."" It follows from such an ergodicity property that an SLLN for additive functionals of the regime-switching diffusions is obtained based on the property of uniform mixing. Finally, an example is presented to illustrate the application of ergodicity and the SLLN to a numerical algorithm for stochastic optimization.
Exponential Stability of Stochastic Singular Delay Systems with General Markovian Switchings

Guoliang Wang,Qingling Zhang,Chunyu Yang

DOI: https://doi.org/10.1002/rnc.3276

IF: 3.8973

2014-01-01

International Journal of Robust and Nonlinear Control

Abstract:SummaryIn recent years, Markovian jump systems have received much attention. However, there are very few results on the stability of stochastic singular systems with Markovian switching. In this paper, the discussed system is the stochastic singular delay system with general transition rate matrix in terms of uncertain and partially unknown transition rate matrix. The aim is to answer the question whether there are conditions guaranteeing the underlying system having a unique solution and being exponentially admissible simultaneously. The proposed results show that all the features of the underlying system such as time delay, diffusion, and general Markovian switchings play important roles in the system analysis of exponential admissibility. A numerical example is used to demonstrate the effectiveness of the proposed methods. Copyright © 2014 John Wiley & Sons, Ltd.
Persistence and Extinction of a Stochastic Delay Logistic Equation under Regime Switching.

Meng Liu,Wenxue Li,Ke Wang

DOI: https://doi.org/10.1016/j.aml.2012.04.010

IF: 4.294

2012-01-01

Applied Mathematics Letters

Abstract:A stochastic delay Logistic equation under regime switching is proposed and studied. Sufficient conditions for extinction, non-persistence in the mean and weak persistence of the solutions are established. The critical value between weak persistence and extinction is obtained.
Stability Analysis of Stochastic Differential Equations with Markovian Switching

Fubo Zhu,Zhengzhi Han,Junfeng Zhang

DOI: https://doi.org/10.1016/j.sysconle.2012.08.013

IF: 2.742

2012-01-01

Systems & Control Letters

Abstract:This paper discusses the asymptotic stability of the nonlinear stochastic differential equations with Markovian switching (SDEWMSs). The equations under consideration are more general, whose transition jump rates matrix Q is not precisely known. By using the switching process jump times to subdivide the “time” and then investigate the related sequence, we provide sufficient conditions for asymptotic stability of SDEWMSs when each subsystem is stable and a certain “slow switching” condition holds. For the general multi-dimensional linear SDEWMSs, sufficient conditions via bi-linear matrix inequalities are also proposed for the design of robust stabilization. Some examples are given to illustrate the effectiveness of our results.
Threshold Dynamics and Ergodicity of an SIRS Epidemic Model with Markovian Switching

Dan Li,Shengqiang Liu,Jing'an Cui

DOI: https://doi.org/10.1016/j.jde.2017.08.066

IF: 2.615

2018-01-01

Journal of Differential Equations

Abstract:This work studies the threshold dynamics and ergodicity of a stochastic SIRS epidemic model with the disease transmission rate driven by a semi-Markov process. The semi-Markov process used in this paper for describing a randomly changing environment is a very large extension of the most common Markov regime-switching process. We define a basic reproduction number for the semi-Markov regime-switching environment and show that its position with respect to 1 determines the extinction or persistence of the disease. In the case of disease persistence, we give mild sufficient conditions for ensuring the existence and absolute continuity of the invariant probability measure. Under the same conditions, we also prove the global attractivity of the Ω-limit set of the system and the convergence in total variation norm of the transition probability to the invariant measure. Compared with the existing results in the Markov regime-switching environment, the results generalized require almost no additional conditions.
General Decay Stability of Stochastic Differential Equations with Markovian Switching

Feiqi Deng,Kuang Shi-fang,Zhao Xue-yan

DOI: https://doi.org/10.3969/j.issn.1000-565X.2012.10.014

2012-01-01

Abstract:It is worth pointing out that some stochastic systems are indeed stable but subject to a certain lower decay rate which is different from exponential decay,such as polynomial or logarithmic.For more accurate quantitative analyses of stability properties,this paper extends the usual exponential stability concepts to a more general stable decay function and investigates the general decay stability of stochastic differential equations with Markovian switching.Firstly,some φ(t)-stability criteria in p-th moment and almost surely sense for the analytical solutions are established,by utilizing It formula,Borel-Cantelli and martingale exponential inequalities.Then the Euler Maruyama method is shown to be effective in capturing φ(t)-stability behavior for all sufficiently small timesteps under appropriate conditions.

On sufficient conditions of transience for a stochastic differential equation with switching

The Euler-Maruyama Approximation of State-Dependent Regime Switching Diffusions

Exponential stability of neutral stochastic differential functional equations with Markovian switching

Asymptotic stability of switching diffusions having sub-exponential rates of decay

Stability of Reaction–diffusion Systems with Stochastic Switching

Recurrence and Ergodicity of Switching Diffusions with Past-Dependent Switching Having a Countable State Space

Strong Ergodicity of the Regime-Switching Diffusion Processes

Exponential Ergodicity for Stochastic Functional Differential Equations with Markovian Switching

Stability and rate of decay for solutions to stochastic differential equations with Markov switching

Necessary and Sufficient Conditions of Near‐optimality in a Regime‐switching Diffusion Model

Controllability of Stochastic Differential Equations with Markovian Switching

Attraction of Stochastic Neutral Delay Differential Equations with Markovian Switching

Permanence and Extinction of Stochastic Regime-Switching Mutualism Model

Stochastic functional differential equation under regime switching

Stochastic Delay Logistic Model under Regime Switching

Ergodicity of Regime-Switching Functional Diffusions with Infinite Delay and Application to a Numerical Algorithm for Stochastic Optimization

Exponential Stability of Stochastic Singular Delay Systems with General Markovian Switchings

Persistence and Extinction of a Stochastic Delay Logistic Equation under Regime Switching.

Stability Analysis of Stochastic Differential Equations with Markovian Switching

Threshold Dynamics and Ergodicity of an SIRS Epidemic Model with Markovian Switching

General Decay Stability of Stochastic Differential Equations with Markovian Switching