The invariant meauures, probability flux and circulations of one-dimensional Markov processes

Gong Guang,Qian Minping

DOI: https://doi.org/10.1007/BFb0093042

1982-01-01

Abstract:Without Abstract

What problem does this paper attempt to address?

On Central Limit Theorems for Vector Random Measures and Measure-Valued Processes

ZG Su

DOI: https://doi.org/10.1137/s0040585x97979111

2002-01-01

Theory of Probability and Its Applications

Abstract:Let B be a separable Banach space, Suppose that (F. F-t, greater than or equal to 1) is a sequence of independent identically distributed (i.i.d.) and symmetrical (s.i.s.) B-valued random measures. We first establish the central limit theorem for Y-n = 1/rootn Sigma(i=1)(n) F-t by taking the viewpoint of random linear functionals on Schwartz distribution spaces, Then let (X, X-i, i greater than or equal to 1) be a sequence of i.i.d. symmetric B-valued random vectors and (B, B-i, i greater than or equal to 1) a sequence of independent standard Brownian motions on [0,1] independent of (X, X-t, i greater than or equal to 1). The central limit theorem for measure-valued processes Z(n)(t) = 1/rootn Sigma(i=1)(n) X(i)delta(Bi)(t). t is an element of [0, 1], will be investigated in the same frame. Our main results concerning Y-n differ front D. H. Thang's [Probab. Theory Related Fields, 88 (1991), pp. 1-16] in that we take into account F as a whole: while the results related to Z(n) are extensions of I. Mitoma [Ann. Probab., 11 (1983), pp. 989 099] to random weighted mass.
The Invariance Principle for Some Class of Markov Chains

ZY Lin

DOI: https://doi.org/10.4213/tvp615

2000-01-01

Theory of Probability and Its Applications

Abstract:This work is devoted to the invariance principle for homogeneous Markov chains with a finite state space. The proof is based on a comparison of the asymptotic behavior of sums of random variables constructed by Markov chains with the same transition matrix and various initial distributions.
2 Circulation Distribution, Entropy Production and Irreversibility of Finite Markov Chains with Continuous Parameter

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_3

2004-01-01

Abstract: • 2.1 Circulation Distribution • 2.2 Irreversibility and Entropy Production • 2.3 Large Deviations and Fluctuation Theorem
Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Mads Chr Hansen,Carsten Wiuf,Chuang Xu

2023-12-11

Abstract:We study continuous-time Markov chains on the non-negative integers under mild regularity conditions (in particular, the set of jump vectors is finite and both forward and backward jumps are possible). Based on the so-called flux balance equation, we derive an iterative formula for calculating stationary measures. Specifically, a stationary measure $\pi(x)$ evaluated at $x\in\mathbb{N}_0$ is represented as a linear combination of a few generating terms, similarly to the characterization of a stationary measure of a birth-death process, where there is only one generating term, $\pi(0)$. The coefficients of the linear combination are recursively determined in terms of the transition rates of the Markov chain. For the class of Markov chains we consider, there is always at least one stationary measure (up to a scaling constant). We give various results pertaining to uniqueness and non-uniqueness of stationary measures, and show that the dimension of the linear space of signed invariant measures is equal to the number of generating terms. A minimization problem is constructed in order to compute stationary measures numerically. Moreover, a heuristic linear approximation scheme is suggested for the same purpose by first approximating the generating terms. The correctness of the linear approximation scheme is justified in some special cases. Furthermore, a decomposition of the state space into different types of states (open and closed irreducible classes, and trapping, escaping and neutral states) is presented. Applications to stochastic reaction networks are well illustrated.

Probability
Invariant Measures for the Stochastic One-Dimensional Compressible Navier-Stokes Equations

Michele Coti Zelati,Nathan Glatt-Holtz,Konstantina Trivisa

DOI: https://doi.org/10.1007/s00245-019-09594-x

Abstract:We investigate the long-time behavior of solutions to a stochastically forced one-dimensional Navier-Stokes system, describing the motion of a compressible viscous fluid, in the case of linear pressure law. We prove existence of an invariant measure for the Markov process generated by strong solutions. We overcome the difficulties of working with non-Feller Markov semigroups on non-complete metric spaces by generalizing the classical Krylov-Bogoliubov method, and by providing suitable polynomial and exponential moment bounds on the solution, together with pathwise estimates.
Non-equilibrium Stochastic Dynamics

QIAN MinPing,JIANG DaQuan

DOI: https://doi.org/10.1360/n012017-00178

2017-01-01

Abstract:In this paper,we mainly review the basic concepts in statistical mechanics of stochastic processes,including entropy production,flux,potential,equilibrium state,temperature in stochastic processes and their mathematical definitions.Moreover,we review some basic properties of the processes derived from these concepts,including fluctuation theorems,Green-Kubo formula,and the monotonicity of power spectrum density.Especially,we point out that we can introduce the temperature parameter in a Markov process to get the multi-layer clustering of the system modeled by the process.This multi-layer clustering shows the interaction network structure among the states.Finally,we give some examples of application problems,in which one can model by stochastic processes to get the answer,explanation,and understanding of concerned problems in natural sciences.
One-dimensional Continuous-Time Quantum Markov Chains: qubit probabilities and measures

Manuel D. De la Iglesia,Carlos F. Lardizabal

2024-02-25

Abstract:Quantum Markov chains (QMCs) are positive maps on a trace-class space describing open quantum dynamics on graphs. Such objects have a statistical resemblance with classical random walks, while at the same time it allows for internal (quantum) degrees of freedom. In this work we study continuous-time QMCs on the integer line, half-line and finite segments, so that we are able to obtain exact probability calculations in terms of the associated matrix-valued orthogonal polynomials and measures. The methods employed here are applicable to a wide range of settings, but we will restrict to classes of examples for which the Lindblad generators are induced by a single positive map, and such that the Stieltjes transforms of the measures and their inverses can be calculated explicitly.

Quantum Physics,Mathematical Physics,Classical Analysis and ODEs
On a class of stochastic partial differential equations with multiple invariant measures

Bálint Farkas,Martin Friesen,Barbara Rüdiger,Dennis Schroers

DOI: https://doi.org/10.1007/s00030-021-00691-x

2021-04-07

Nonlinear Differential Equations and Applications NoDEA

Abstract:Abstract In this work we investigate the long-time behavior for Markov processes obtained as the unique mild solution to stochastic partial differential equations in a Hilbert space. We analyze the existence and characterization of invariant measures as well as convergence of transition probabilities. While in the existing literature typically uniqueness of invariant measures is studied, we focus on the case where the uniqueness of invariant measures fails to hold. Namely, introducing a generalized dissipativity condition combined with a decomposition of the Hilbert space, we prove the existence of multiple limiting distributions in dependence of the initial state of the process and study the convergence of transition probabilities in the Wasserstein 2-distance. Finally, we apply our results to Lévy driven Ornstein–Uhlenbeck processes, the Heath–Jarrow–Morton–Musiela equation as well as to stochastic partial differential equations with delay.

mathematics, applied
Studies on invariant measures of fractional stochastic delay Ginzburg-Landau equations on $ \mathbb{R}^n $

Hong Lu,Linlin Wang,Mingji Zhang

DOI: https://doi.org/10.3934/mbe.2024241

2024-01-01

Mathematical Biosciences and Engineering

Abstract:This paper is concerned with invariant measures of fractional stochastic delay Ginzburg-Landau equations on the entire space $ \mathbb{R}^n $. We first derive the uniform estimates and the mean-square uniform smallness of the tails of solutions in corresponding space. Then we deduce the weak compactness of a set of probability distributions of the solutions applying the Ascoli-Arzel$ \grave{a} $. We finally prove the existence of invariant measures by applying Krylov-Bogolyubov's method.

mathematical & computational biology
Invariant Measures of Stochastic Lattice Plate Equations: Stability, Ergodicity and Mixing

Yu Wang,Congli Yang,Renhai Wang

DOI: https://doi.org/10.1007/s40840-024-01685-5

2024-04-05

Bulletin of the Malaysian Mathematical Sciences Society

Abstract:This article is concerned with the stability, ergodicity and mixing of invariant measures of a class of stochastic lattice plate equations with nonlinear damping driven by a family of nonlinear white noise. The polynomial growth drift term has an arbitrary order growth rate, and the diffusion term is a family of locally Lipschitz continuous functions. By modifying and improving several energy estimates of the solutions uniformly for initial data when time is large enough, we prove that the noise intensity union of all invariant measures of the stochastic equation is tight on . Then, we show that the weak limit of every sequence of invariant measures in this union must be an invariant measure of the corresponding limiting equation under the locally Lipschitz assumptions on the drift and diffusion terms. Under some globally Lipschitz conditions on the drift and diffusion terms, we also prove that every invariant measure of the stochastic equation must be ergodic and exponentially mixing in the pointwise and Wasserstein metric sense.

mathematics
Approximation for the invariant measure with applications for jump processes (convergence in total variation distance)

Vlad Bally,Yifeng Qin

2023-06-01

Abstract:In this paper, we establish an abstract framework for the approximation of the invariant probability measure for a Markov semigroup. Following Pag{è}s and Panloup [40] we use an Euler scheme with decreasing step (unadjusted Langevin algorithm). Under some contraction property with exponential rate and some regularization properties, we give an estimate of the error in total variation distance. This abstract framework covers the main results in [40] and [14]. As a specific application we study the convergence in total variation distance to the invariant measure for jump type equations. The main technical difficulty consists in proving the regularzation properties-this is done under an ellipticity condition, using Malliavin calculus for jump processes.

Probability
Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

MP QIAN,M QIAN,C QIAN

1984-01-01

Abstract:In this paper, the relation between the irreversibility and circulation of a Markov chainwith continuous time parameter is considered. By the calculation of determinants, it showshow the probability approach in[1] is related to T. Hill's results.
Invariant Measures And Kyapunov Exponents For Stochastic Mathieu System

Hw Rong,G Meng,Xd Wang,W Xu,T Fang

DOI: https://doi.org/10.1023/A:1021208631414

IF: 5.741

2002-01-01

Nonlinear Dynamics

Abstract:The principal resonance of the stochastic Mathieu oscillator to random parametric excitation is investigated. The method of multiple scales is used to determine the equations of modulation of amplitude and phase. The behavior, stability and bifurcation of steady state response are studied by means of qualitative analyses. The effects of damping, detuning, bandwidth, and magnitudes of random excitation are analyzed. The explicit asymptotic formulas for the maximum Lyapunov exponent are obtained. The almost-sure stability or instability of the stochastic Mathieu system depends on the sign of the maximum Lyapunov exponent.
Invariant Measures and Lyapunov Exponents for Stochastic Mathieu System

Haiwu Rong,Guang Meng,Xiangdong Wang,Wei Xu,Tong Fang

DOI: https://doi.org/10.1023/A:1021208631414

IF: 5.741

2002-01-01

Nonlinear Dynamics

Abstract:The principal resonance of the stochastic Mathieu oscillator to randomparametric excitation is investigated. The method of multiple scales isused to determine the equations of modulation of amplitude and phase.The behavior, stability and bifurcation of steady state response arestudied by means of qualitative analyses. The effects of damping,detuning, bandwidth, and magnitudes of random excitation are analyzed.The explicit asymptotic formulas for the maximum Lyapunov exponent areobtained. The almost-sure stability or instability of the stochasticMathieu system depends on the sign of the maximum Lyapunov exponent.
Markov Processes and Stochastic Extrinsic Derivative Flows on the Space of Absolutely Continuous Measures

Panpan Ren,Feng-Yu Wang,Simon Wittmann

2024-09-15

Abstract:Let $E$ be the class of finite (resp. probability) measures absolutely continuous with respect to a $\sigma$-finite Radon measure on a Polish space. We present a criterion on the quasi-regularity of Dirichlet forms on $E$ in terms of upper bound conditions given by the uniform $(L^1+L^\infty)$-norm of the extrinsic derivative. As applications, we construct a class of general type Markov processes on $E$ via quasi-regular Dirichlet forms containing the diffusion, jump and killing terms. Moreover, stochastic extrinsic derivative flows on $E$ are studied by using quasi-regular Dirichlet forms, which in particular provide martingale solutions to SDEs on these two spaces, with drifts given by the extrinsic derivative of entropy functionals.

Probability
Stationary measures for the Porous Medium Model

Oriane Blondel

2024-11-26

Abstract:We study the stationary measures for variants of the Porous Medium Model in dimension 1. These are exclusion processes that belong to the class of kinetically constrained models, in which an exchange can occur between $x$ and $x+1$ only if there is a particle either at $x-1$ or $x+2$. We show that any stationary probability measure can be decomposed into a frozen part and a mixture of product measures (although there exist invariant sets which have zero probability under these measures).

Probability
Invariant measures and their limiting behavior of the Landau-Lifshitz-Bloch equation in unbounded domains

Daiwen Huang,Zhaoyang Qiu,Bixiang Wang

2024-10-08

Abstract:This paper deals with the existence and limiting behavior of invariant measures of the stochastic Landau-Lifshitz-Bloch equation driven by linear multiplicative noise and additive noise defined in the entire space $\mathbb{R}^d$ for $d=1,2$, which describes the phase spins in ferromagnetic materials around the Curie temperature. We first establish the existence and uniqueness of solutions by a domain expansion method. We then prove the existence of invariant measures by the weak Feller argument. In the case $d=1$, we show the uniform tightness of the set of all invariant measures of the stochastic equation, and prove any limit of a sequence of invariant measures of the perturbed equation must be an invariant measure of the limiting system. The cut-off arguments, stopping time techniques and uniform tail-ends estimates of solutions are developed to overcome the difficulty caused by the high-order nonlinearity and the non-compactness of Sobolev embeddings in unbounded domains.

Analysis of PDEs,Probability
Invariant measures of stochastic delay complex Ginzburg-Landau equations

Die Ren,Ji Shu,Aili Liu,Yanyan Zou

DOI: https://doi.org/10.1080/17442508.2024.2347849

2024-05-06

Stochastics

Abstract:This paper is concerned with the existence of invariant measures for stochastic delay complex Ginzburg-Landau equations defined on the entire integer set. When the nonlinear drift and diffusion terms are globally Lipschitz continous, the existence of invariant measures of the equation is proved by estiblishing the tightness of probability distributions of solutions in the space of continuous functions from a finite interval to an infinite-dimensional space, based on the idea of uniform tail-estimates, the technique of diadic division and the Arzela-Ascoli theorem.

statistics & probability,mathematics, applied
Circulation Distribution, Entropy Production And Irreversibility Of Denumerable Markov Chains

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_2

2004-01-01

Abstract: • 1.1 Directed Circuits, Cycles and Passage Functions • 1.2 The Derived Chain • 1.3 Circulation Distribution of Recurrent Markov Chains • 1.4 Irreversibility and Entropy Production • 1.5 Large Deviations and Fluctuation Theorem • 1.6 Appendix

The invariant meauures, probability flux and circulations of one-dimensional Markov processes

On Central Limit Theorems for Vector Random Measures and Measure-Valued Processes

The Invariance Principle for Some Class of Markov Chains

2 Circulation Distribution, Entropy Production and Irreversibility of Finite Markov Chains with Continuous Parameter

Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Invariant Measures for the Stochastic One-Dimensional Compressible Navier-Stokes Equations

Non-equilibrium Stochastic Dynamics

One-dimensional Continuous-Time Quantum Markov Chains: qubit probabilities and measures

On a class of stochastic partial differential equations with multiple invariant measures

Studies on invariant measures of fractional stochastic delay Ginzburg-Landau equations on $ \mathbb{R}^n $

Invariant Measures of Stochastic Lattice Plate Equations: Stability, Ergodicity and Mixing

Approximation for the invariant measure with applications for jump processes (convergence in total variation distance)

Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

Invariant Measures And Kyapunov Exponents For Stochastic Mathieu System

Invariant Measures and Lyapunov Exponents for Stochastic Mathieu System

Markov Processes and Stochastic Extrinsic Derivative Flows on the Space of Absolutely Continuous Measures

Stationary measures for the Porous Medium Model

Invariant measures and their limiting behavior of the Landau-Lifshitz-Bloch equation in unbounded domains

Invariant measures of stochastic delay complex Ginzburg-Landau equations

Circulation Distribution, Entropy Production And Irreversibility Of Denumerable Markov Chains