Circulation Distribution, Entropy Production And Irreversibility Of Denumerable Markov Chains

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_2

2004-01-01

Abstract: • 1.1 Directed Circuits, Cycles and Passage Functions • 1.2 The Derived Chain • 1.3 Circulation Distribution of Recurrent Markov Chains • 1.4 Irreversibility and Entropy Production • 1.5 Large Deviations and Fluctuation Theorem • 1.6 Appendix

What problem does this paper attempt to address?

2 Circulation Distribution, Entropy Production and Irreversibility of Finite Markov Chains with Continuous Parameter

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_3

2004-01-01

Abstract: • 2.1 Circulation Distribution • 2.2 Irreversibility and Entropy Production • 2.3 Large Deviations and Fluctuation Theorem
5 Entropy Production, Rotation Numbers and Irreversibility of Diffusion Processes on Manifolds

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_6

2004-01-01

Abstract: • 5.1 A Simple Example: Diffusion Processes on a Circle • 5.2 Lifted Processes and Cameron-Martin-Girsanov Formula • 5.3 Irreversibility and Entropy Production • 5.4 Rotation Numbers and Circulation Decomposition
Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

MP QIAN,M QIAN,C QIAN

1984-01-01

Abstract:In this paper, the relation between the irreversibility and circulation of a Markov chainwith continuous time parameter is considered. By the calculation of determinants, it showshow the probability approach in[1] is related to T. Hill's results.
Higher Order Ergodic Markov Chains and First Passage Times

Lixing Han,Kelun Wang,Jianhong Xu

DOI: https://doi.org/10.1080/03081087.2021.1968782

2022-01-01

Abstract:We study the relationship between ergodicity and irreducibility of transition probability tensors. We then introduce the notions of first passage times and mean first passage times, both in the tensor form, for higher order Markov chains and prove some properties of these quantities. Numerical examples are also given to illustrate our results.
Cycle Symmetries and Circulation Fluctuations for Discrete-Time and Continuous-Time Markov Chains

Chen Jia,Da-Quan Jiang,Min-Ping Qian

DOI: https://doi.org/10.1214/15-aap1152

2016-01-01

The Annals of Applied Probability

Abstract:In probability theory, equalities are much less than inequalities. In this paper, we find a series of equalities which characterize the symmetry of the forming times of a family of similar cycles for discrete-time and continuous-time Markov chains. Moreover, we use these cycle symmetries to study the circulation fluctuations for Markov chains. We prove that the empirical circulations of a family of cycles passing through a common state satisfy a large deviation principle with a rate function which has an highly non-obvious symmetry. Finally, we discuss the applications of our work in statistical physics and biochemistry.
Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy

Liangrong Peng,Hong Qian,Liu Hong

DOI: https://doi.org/10.1103/PhysRevE.101.022114

2020-03-31

Abstract:Statistical thermodynamics of small systems shows dramatic differences from normal systems. Parallel to the recently presented steady-state thermodynamic formalism for master equation and Fokker-Planck equation, we show that a ``thermodynamic'' theory can also be developed based on Tsallis' generalized entropy $S^{(q)}=\sum_{i=1}^N(p_i-p_i^q)/[q(q-1)]$ and Shiino's generalized free energy $F^{(q)}=[\sum_{i=1}^Np_i(p_i/\pi_i)^{q-1}-1]/[q(q-1)]$, where $\pi_i$ is the stationary distribution. $dF^{(q)}/dt=-f_d^{(q)}\le 0$ and it is zero iff the system is in its stationary state. $dS^{(q)}/dt-Q_{ex}^{(q)} = f_d^{(q)}$ where $Q_{ex}^{(q)}$ characterizes the heat exchange. For systems approaching equilibrium with detailed balance, $f_d^{(q)}$ is the product of Onsager's thermodynamic flux and force. However, it is discovered that the Onsager's force is non-local. This is a consequence of the particular transformation invariance for zero energy of Tsallis' statistics.

Mathematical Physics
Reversibility and Entropy Production of Inhomogeneous Markov Chains

Hao Ge,Da-Quan Jiang,Min Qian

DOI: https://doi.org/10.1239/jap/1165505205

2006-01-01

Abstract:In this paper we introduce the concepts of instantaneous reversibility and instantaneous entropy production rate for inhomogeneous Markov chains with denumerable state spaces. The following statements are proved to be equivalent: the inhomogeneous Markov chain is instantaneously reversible; it is in detailed balance; its entropy production rate vanishes. In particular, for a time-periodic birth-death chain, which can be regarded as a simple version of a physical model (Brownian motors), we prove that its rotation number is 0 when it is instantaneously reversible or periodically reversible. Hence, in our model of Markov chains, the directed transport phenomenon of Brownian motors can occur only in nonequilibrium and irreversible systems.
A Simple Discrete Model of Brownian Motors: Time-periodic Markov Chains

Hao Ge,Da-Quan Jiang,Min Qian

DOI: https://doi.org/10.1007/s10955-006-9099-6

2006-01-01

Journal of Statistical Physics

Abstract:In this paper, we consider periodically inhomogeneous Markov chains, which can be regarded as a simple version of physical model—Brownian motors. We introduce for them the concepts of periodical reversibility, detailed balance, entropy production rate and circulation distribution. We prove the equivalence of the following statements: The time-periodic Markov chain is periodically reversible; It is in detailed balance; Kolmogorov's cycle condition is satisfied; Its entropy production rate vanishes; Every circuit and its reversed circuit have the same circulation weight. Hence, in our model of Markov chains, the directed transport phenomenon of Brownian motors, i.e. the existence of net circulation, can occur only in nonequilibrium and irreversible systems. Moreover, we verify the large deviation property and the Gallavotti-Cohen fluctuation theorem of sample entropy production rates of the Markov chain.
Advanced method and application on Markov state transfer chain

Xi Li,Xiaoning Zhu,Guoqiang Cai,Yuan Sun

2008-01-01

Abstract:This paper advanced the solution of Markov state transfer chain to analyze the system reliability. According to the conversion of mutual relations, the paper put forward a method to calculate the life expectancy of top events in Markov quantitative analysis. Afterwards the paper presented the failure mode, failure rate and life expectancy of the top events. Meanwhile, the paper presented the method to calculate probability of important bottom events to top events. Finally the research is verified in the analysis of a city rail traffic automatic train super-vision system.
Minimal entropy production under thermodynamic constraints: An application of cycle decomposition for Markov chain design

David Andrieux

2023-03-10

Abstract:We propose to construct Markov dynamics with specified characteristics using a cycle decomposition of the space of Markov chains introduced by Cohen and Alpern. As an application of this approach, we derive the minimal entropy production required to generate prescribed thermodynamic currents.

Statistical Mechanics
General Minimal Diffusion Process: its Construction, Invariant Measure, Entropy Production and Irreversibility

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_4

2004-01-01

Abstract: • 3.1 Construction of the Minimal Semigroup 3.1.1 Resolvent Operators and Minimal Semigroup in a Bounded Domain 3.1.2 Resolvent Operators 3.1.3 Banach Space and the Minimal Semigroup • 3.2 Ergodic Stationary Diffusion Process 3.2.1 Transition Functions 3.2.2 Invariant Functional and Invariant Measure 3.2.3 Uniqueness of Invariant Probability Measure 3.2.4 Foguel Alternatives and Ergodicity • 3.3 Irreversibility and Entropy Production 3.3.1 Heuristic Derivation for Entropy Production Rate 3.3.2 Reversibility, Symmetry and Zero Entropy Production
Distributional Chaos in Multifractal Analysis, Recurrence and Transitivity

An Chen,Xueting Tian

DOI: https://doi.org/10.1017/etds.2019.57

2019-01-01

Abstract:There is much research on the dynamical complexity on irregular sets and level sets of ergodic average from the perspective of density in base space, the Hausdorff dimension, Lebesgue positive measure, positive or full topological entropy (and topological pressure), etc. However, this is not the case from the viewpoint of chaos. There are many results on the relationship of positive topological entropy and various chaos. However, positive topological entropy does not imply a strong version of chaos, called DC1. Therefore, it is non-trivial to study DC1 on irregular sets and level sets. In this paper, we will show that, for dynamical systems with specification properties, there exist uncountable DC1-scrambled subsets in irregular sets and level sets. Meanwhile, we prove that several recurrent level sets of points with different recurrent frequency have uncountable DC1-scrambled subsets. The major argument in proving the above results is that there exists uncountable DC1-scrambled subsets in saturated sets.
Markov chains: Structure and applications

R.L. Tweedie

DOI: https://doi.org/10.1016/s0169-7161(01)19025-5

2001-01-01

Handbook of Statistics

Abstract:Publisher The classical theory of Markov chains originally dealt only with chains on finite or countable spaces. In order to establish the fundamental aspects of Markov chain theory on more general spaces, the chapter presents an overview of results on countable spaces, including some recent and less familiar aspects even on these spaces. Although many real systems can be described in such a framework, many other applications require continuous or even more general spaces, and there has been a flourishing of work on non-countable spaces. This chapter integrates the general state space results with topological conditions, which guarantee that the obvious (but not always true) probabilistic properties are preserved when the space has topological features.
Markov chains and mappings of distributions on compact spaces II: Numerics and Conjectures

David J. Aldous,Madelyn Cruz,Shi Feng

2024-03-27

Abstract:Consider a compact metric space $S$ and a pair $(j,k)$ with $k \ge 2$ and $1 \le j \le k$. For any probability distribution $\theta \in P(S)$, define a Markov chain on $S$ by: from state $s$, take $k$ i.i.d. ($\theta$) samples, and jump to the $j$'th closest. Such a chain converges in distribution to a unique stationary distribution, say $\pi_{j,k}(\theta)$. This defines a mapping $\pi_{j,k}: P(S) \to P(S)$. What happens when we iterate this mapping? In particular, what are the fixed points of this mapping? A few results are proved in a companion article; this article, not intended for formal publication, records numerical studies and conjectures.

Probability
Markov chains and mappings of distributions on compact spaces

David J. Aldous,Shi Feng

2024-04-01

Abstract:Consider a compact metric space $S$ and a pair $(j,k)$ with $k \ge 2$ and $1 \le j \le k$. For any probability distribution $\theta \in P(S)$, define a Markov chain on $S$ by: from state $s$, take $k$ i.i.d. ($\theta$) samples, and jump to the $j$'th closest. Such a chain converges in distribution to a unique stationary distribution, say $\pi_{j,k}(\theta)$. So this defines a mapping $\pi_{j,k}: P(S) \to P(S)$. What happens when we iterate this mapping? In particular, what are the fixed points of this mapping? We present a few rigorous results, to complement our extensive simulation study elsewhere.

Probability,Metric Geometry
Large deviations and related problems for absorbing Markov chains

Jinwen Chen,Xiaoxue Deng

DOI: https://doi.org/10.1016/j.spa.2013.02.014

IF: 1.43

2013-01-01

Stochastic Processes and their Applications

Abstract:In this paper, large deviations and their connections with several other fundamental topics are investigated for absorbing Markov chains. A variational representation for the Dirichlet principal eigenvalues is given by the large deviation approach. Kingman’s decay parameters and mean ratio quasi-stationary distributions of the chains are also characterized by the large deviation rate function. As an application of these results, we interpret the “stationarity” of mean ratio quasi-stationary distributions via a concrete example. An application to quasi-ergodicity is also discussed.
Decomposition of Quantum Markov Chains and Its Applications

Ji Guan,Yuan Feng,Mingsheng Ying

DOI: https://doi.org/10.1016/j.jcss.2018.01.005

IF: 1.043

2018-01-01

Journal of Computer and System Sciences

Abstract:Markov chains have been widely employed as a fundamental model in the studies of probabilistic and stochastic communicating and concurrent systems. It is well-understood that decomposition techniques play a key role in reachability analysis and model-checking of Markov chains. (Discrete-time) quantum Markov chains have been introduced as a model of quantum communicating systems [1] and also a semantic model of quantum programs [2]. The BSCC (Bottom Strongly Connected Component) and stationary coherence decompositions of quantum Markov chains were introduced in [3, 4, 5]. This paper presents a new decomposition technique, namely periodic decomposition, for quantum Markov chains. We further establish a limit theorem for them. As an application, an algorithm to find a maximum dimensional noiseless subsystem of a quantum communicating system is given using decomposition techniques of quantum Markov chains.
Reversible Markov chains: variational representations and ordering

Chris Sherlock

DOI: https://doi.org/10.48550/arXiv.1809.01903

2018-09-06

Abstract:This pedagogical document explains three variational representations that are useful when comparing the efficiencies of reversible Markov chains: (i) the Dirichlet form and the associated variational representations of the spectral gaps; (ii) a variational representation of the asymptotic variance of an ergodic average; and (iii) the conductance, and the equivalence of a non-zero conductance to a non-zero right spectral gap.

Statistics Theory,Computation
Cycle Symmetry, Limit Theorems, and Fluctuation Theorems for Diffusion Processes on the Circle

Hao Ge,Chen Jia,Da-Quan Jiang

DOI: https://doi.org/10.1016/j.spa.2016.09.011

IF: 1.43

2016-01-01

Stochastic Processes and their Applications

Abstract:Cyclic structure and dynamics are of great interest in both the fields of stochastic processes and nonequilibrium statistical physics. In this paper, we find a new symmetry of the Brownian motion named as the quasi-time-reversal invariance. It turns out that such an invariance of the Brownian motion is the key to prove the cycle symmetry for diffusion processes on the circle, which says that the distributions of the forming times of the forward and backward cycles, given that the corresponding cycle is formed earlier than the other, are exactly the same. With the aid of the cycle symmetry, we prove the strong law of large numbers, functional central limit theorem, and large deviation principle for the sample circulations and net circulations of diffusion processes on the circle. The cycle symmetry is further applied to obtain various types of fluctuation theorems for the sample circulations, net circulation, and entropy production rate.
The invariant meauures, probability flux and circulations of one-dimensional Markov processes

Gong Guang,Qian Minping

DOI: https://doi.org/10.1007/BFb0093042

1982-01-01

Abstract:Without Abstract

Circulation Distribution, Entropy Production And Irreversibility Of Denumerable Markov Chains

2 Circulation Distribution, Entropy Production and Irreversibility of Finite Markov Chains with Continuous Parameter

5 Entropy Production, Rotation Numbers and Irreversibility of Diffusion Processes on Manifolds

Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

Higher Order Ergodic Markov Chains and First Passage Times

Cycle Symmetries and Circulation Fluctuations for Discrete-Time and Continuous-Time Markov Chains

Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy

Reversibility and Entropy Production of Inhomogeneous Markov Chains

A Simple Discrete Model of Brownian Motors: Time-periodic Markov Chains

Advanced method and application on Markov state transfer chain

Minimal entropy production under thermodynamic constraints: An application of cycle decomposition for Markov chain design

General Minimal Diffusion Process: its Construction, Invariant Measure, Entropy Production and Irreversibility

Distributional Chaos in Multifractal Analysis, Recurrence and Transitivity

Markov chains: Structure and applications

Markov chains and mappings of distributions on compact spaces II: Numerics and Conjectures

Markov chains and mappings of distributions on compact spaces

Large deviations and related problems for absorbing Markov chains

Decomposition of Quantum Markov Chains and Its Applications

Reversible Markov chains: variational representations and ordering

Cycle Symmetry, Limit Theorems, and Fluctuation Theorems for Diffusion Processes on the Circle

The invariant meauures, probability flux and circulations of one-dimensional Markov processes