Stability Of Circulation Decompositions And Self-Organization Phenomena

Sj Yan,Mf Chen

DOI: https://doi.org/10.1016/s0252-9602(18)30638-6

1984-01-01

Acta Mathematica Scientia

Abstract:The circulation decomposition for a Markov chain with discrete parameteir was introduced in 1979 by Qian Min-ping. However, from physical and mathematical point of view, the analogue for a Markov chain with continuous parameter may be more interesting.

What problem does this paper attempt to address?

2 Circulation Distribution, Entropy Production and Irreversibility of Finite Markov Chains with Continuous Parameter

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_3

2004-01-01

Abstract: • 2.1 Circulation Distribution • 2.2 Irreversibility and Entropy Production • 2.3 Large Deviations and Fluctuation Theorem
Circulation Distribution, Entropy Production And Irreversibility Of Denumerable Markov Chains

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_2

2004-01-01

Abstract: • 1.1 Directed Circuits, Cycles and Passage Functions • 1.2 The Derived Chain • 1.3 Circulation Distribution of Recurrent Markov Chains • 1.4 Irreversibility and Entropy Production • 1.5 Large Deviations and Fluctuation Theorem • 1.6 Appendix
Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy

Liangrong Peng,Hong Qian,Liu Hong

DOI: https://doi.org/10.1103/PhysRevE.101.022114

2020-03-31

Abstract:Statistical thermodynamics of small systems shows dramatic differences from normal systems. Parallel to the recently presented steady-state thermodynamic formalism for master equation and Fokker-Planck equation, we show that a ``thermodynamic'' theory can also be developed based on Tsallis' generalized entropy $S^{(q)}=\sum_{i=1}^N(p_i-p_i^q)/[q(q-1)]$ and Shiino's generalized free energy $F^{(q)}=[\sum_{i=1}^Np_i(p_i/\pi_i)^{q-1}-1]/[q(q-1)]$, where $\pi_i$ is the stationary distribution. $dF^{(q)}/dt=-f_d^{(q)}\le 0$ and it is zero iff the system is in its stationary state. $dS^{(q)}/dt-Q_{ex}^{(q)} = f_d^{(q)}$ where $Q_{ex}^{(q)}$ characterizes the heat exchange. For systems approaching equilibrium with detailed balance, $f_d^{(q)}$ is the product of Onsager's thermodynamic flux and force. However, it is discovered that the Onsager's force is non-local. This is a consequence of the particular transformation invariance for zero energy of Tsallis' statistics.

Mathematical Physics
Cycle Symmetries and Circulation Fluctuations for Discrete-Time and Continuous-Time Markov Chains

Chen Jia,Da-Quan Jiang,Min-Ping Qian

DOI: https://doi.org/10.1214/15-aap1152

2016-01-01

The Annals of Applied Probability

Abstract:In probability theory, equalities are much less than inequalities. In this paper, we find a series of equalities which characterize the symmetry of the forming times of a family of similar cycles for discrete-time and continuous-time Markov chains. Moreover, we use these cycle symmetries to study the circulation fluctuations for Markov chains. We prove that the empirical circulations of a family of cycles passing through a common state satisfy a large deviation principle with a rate function which has an highly non-obvious symmetry. Finally, we discuss the applications of our work in statistical physics and biochemistry.
Dynamical Decomposition of Markov Processes Without Detailed Balance

Ao Ping,Chen Tian-Qi,Shi Jiang-Hong

DOI: https://doi.org/10.1088/0256-307x/30/7/070201

2013-01-01

Abstract:We introduce a dynamical decomposition view in dealing with Markov processes without detailed balance. This work generalizes a previous decomposition framework on continuous-state Markov processes and explicitly gives its correspondence in discrete-state case. We investigate the dynamical roles of decomposed parts by studying the evolution of relative-entropy-like functions. We find a special definition of relative entropy to unify the dynamical roles played by the detailed balance part and the breaking detailed balance part. The evolution of the relative entropy naturally bounds the convergence of the process.
Flow Decomposition Reveals Dynamical Structure of Markov Process

Jianghong Shi,Tianqi Chen,Bo Yuan,Ping Ao

DOI: https://doi.org/10.48550/arxiv.1206.2189

2012-01-01

Abstract:Markov process is widely applied in almost all aspects of literature, especially important for understanding non-equilibrium processes. We introduce a decomposition to general Markov process in this paper. This decomposition decomposes the process into 3 independent parts: stationary distribution, symmetric detailed-balance part and anti-symmetric breaking detailed-balance part. This complete decomposition captures the steady state as well as the dynamics of the process, providing an elegant perspective for construction or analyzing problems. In light of the decomposition, a unique definition of relative entropy is found to formally separate the effect of detailed-balance part and breaking detailed-balance part. We find that the relative Gini entropy production introduced in the paper is not affected by the non-detailed balance part of the process. This property do not holds for other entropy definition in general discrete case.
Decomposition of Quantum Markov Chains and Its Applications

Ji Guan,Yuan Feng,Mingsheng Ying

DOI: https://doi.org/10.1016/j.jcss.2018.01.005

IF: 1.043

2018-01-01

Journal of Computer and System Sciences

Abstract:Markov chains have been widely employed as a fundamental model in the studies of probabilistic and stochastic communicating and concurrent systems. It is well-understood that decomposition techniques play a key role in reachability analysis and model-checking of Markov chains. (Discrete-time) quantum Markov chains have been introduced as a model of quantum communicating systems [1] and also a semantic model of quantum programs [2]. The BSCC (Bottom Strongly Connected Component) and stationary coherence decompositions of quantum Markov chains were introduced in [3, 4, 5]. This paper presents a new decomposition technique, namely periodic decomposition, for quantum Markov chains. We further establish a limit theorem for them. As an application, an algorithm to find a maximum dimensional noiseless subsystem of a quantum communicating system is given using decomposition techniques of quantum Markov chains.
Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

MP QIAN,M QIAN,C QIAN

1984-01-01

Abstract:In this paper, the relation between the irreversibility and circulation of a Markov chainwith continuous time parameter is considered. By the calculation of determinants, it showshow the probability approach in[1] is related to T. Hill's results.
A Simple Discrete Model of Brownian Motors: Time-periodic Markov Chains

Hao Ge,Da-Quan Jiang,Min Qian

DOI: https://doi.org/10.1007/s10955-006-9099-6

2006-01-01

Journal of Statistical Physics

Abstract:In this paper, we consider periodically inhomogeneous Markov chains, which can be regarded as a simple version of physical model—Brownian motors. We introduce for them the concepts of periodical reversibility, detailed balance, entropy production rate and circulation distribution. We prove the equivalence of the following statements: The time-periodic Markov chain is periodically reversible; It is in detailed balance; Kolmogorov's cycle condition is satisfied; Its entropy production rate vanishes; Every circuit and its reversed circuit have the same circulation weight. Hence, in our model of Markov chains, the directed transport phenomenon of Brownian motors, i.e. the existence of net circulation, can occur only in nonequilibrium and irreversible systems. Moreover, we verify the large deviation property and the Gallavotti-Cohen fluctuation theorem of sample entropy production rates of the Markov chain.
Mixed Monotone Decomposition of Dynamical Systems with Application

Tianguang Chu,Lin Huang

DOI: https://doi.org/10.1007/bf02883218

1998-01-01

Abstract:The notions of mixed monotone decomposition of dynamical systems are introduced. The fundamental idea is to make an elaborate use of the natural growth and decay mechanism inherent in the structure of a dynamical systems to decompose its dynamics into increase and decrease parts, and thereby to constitute an augmented dynamical system as the secalled “two-sided comparison system” of the original one. The corresponding two-sided comparison theorems show that the solution of the comparison system gives lower and upper bounds of that of the original system. Therefore, the properties of a dynamical system can be obtained through the study of its two-sided comparison system. Compared with the conventional comparison method in literature, the mixed monotone decomposition method developed herein takes in a natural way structural properties of dynamical systems into account instead of requiring strict conditions of (quasi-)monotonicity on them, and could yields refined, usually nonsymmetrical, state estimates, and thus is more suitable for systems with nonsymmetrical state constraints. As an application of the method, a sufficient condition is established for the global asymptotic stability of the trivial solution of a class of continuous-time systems with nonsymmetrical state saturation. The condition is given in terms of coefficients and state saturation levels of such systems, and contains as a special case a recent result on systems with symmetric state saturation in literature.
Markov Chain Hidden behind Power Law Mechanism of Self-organized Criticality

De Tao Mao,Yisheng Zhong

2007-01-01

Abstract:To describe and analyze the dynamics of Self-Organized Criticality (SOC) systems, a four-state continuous-time Markov model is proposed in this paper. Different to computer simulation or numeric experimental approaches commonly employed for explaining the power law in SOC, in this paper, based on this Markov model, using E.T.Jayness' Maximum Entropy method, we have derived a mathematical proof on the power law distribution for the size of these events. Both this Makov model and the mathematical proof on power law present a new angle on the universality of power law distributions, they also show that the scale free property exists not necessary only in SOC system, but in a class of dynamical systems which can be modelled by the proposed Markov model.
Decomposition Scheme In Continuous Dissipative Chaotic Systems And Role Of Strange Attractors

Yian Ma,Qijun Tan,Ruoshi Yuan,Bo Yuan,Ping Ao

DOI: https://doi.org/10.1109/ICNF.2013.6578915

2013-01-01

Abstract:An energy potential function is constructed for a Lorenz-like piecewise continuous dissipative system. Using this nonincreasing potential function, the system's dynamics is decomposed into a gradient component, accounting for energy dissipation; and a rotation component, facilitating energy conserved motion. Each part has an individual role of determining the strangeness or chaoticness of the attractor.
SDE Decomposition and A-type Stochastic Interpretation in Nonequilibrium Processes

Ruoshi Yuan,Ying Tang,Ping Ao

DOI: https://doi.org/10.1007/s11467-017-0718-2

2017-01-01

Frontiers of Physics

Abstract:An innovative theoretical framework for stochastic dynamics based on the decomposition of a stochastic differential equation (SDE) into a dissipative component, a detailed-balance-breaking component, and a dual-role potential landscape has been developed, which has fruitful applications in physics, engineering, chemistry, and biology. It introduces the A-type stochastic interpretation of the SDE beyond the traditional Ito or Stratonovich interpretation or even the α-type interpretation for multidimensional systems. The potential landscape serves as a Hamiltonian-like function in nonequilibrium processes without detailed balance, which extends this important concept from equilibrium statistical physics to the nonequilibrium region. A question on the uniqueness of the SDE decomposition was recently raised. Our review of both the mathematical and physical aspects shows that uniqueness is guaranteed. The demonstration leads to a better understanding of the robustness of the novel framework. In addition, we discuss related issues including the limitations of an approach to obtaining the potential function from a steady-state distribution.
Stochastic Thermodynamics Across Scales: Emergent Inter-attractoral Discrete Markov Jump Process and Its Underlying Continuous Diffusion

Moises Santillan,Hong Qian

DOI: https://doi.org/10.1016/j.physa.2012.08.019

2012-05-16

Abstract:The consistency across scales of a recently developed mathematical thermodynamic structure, between a continuous stochastic nonlinear dynamical system (diffusion process with Langevin or Fokker-Planck equations) and its emergent discrete, inter-attractoral Markov jump process, is investigated. We analyze how the system's thermodynamic state functions, e.g. free energy $F$, entropy $S$, entropy production $e_p$, and free energy dissipation $\dot{F}$, etc., are related when the continuous system is describe with a coarse-grained discrete variable. We show that the thermodynamics derived from the underlying detailed continuous dynamics is exact in the Helmholtz free-energy representation. That is, the system thermodynamic structure is the same as if one only takes a middle-road and starts with the "natural" discrete description, with the corresponding transition rates empirically determined. By "natural", we mean in the thermodynamic limit of large systems in which there is an inherent separation of time scales between inter- and intra-attractoral dynamics. This result generalizes a fundamental idea from chemistry and the theory of Kramers by including thermodynamics: while a mechanical description of a molecule is in terms of continuous bond lengths and angles, chemical reactions are phenomenologically described by the Law of Mass Action with rate constants, and a stochastic thermodynamics.

Statistical Mechanics,Mesoscale and Nanoscale Physics,Mathematical Physics,Quantitative Methods
Almost sure stability criteria for linear Markovian switching systems

Shen Cong

DOI: https://doi.org/10.1016/j.isatra.2023.12.041

IF: 7.3

2024-01-05

ISA Transactions

Abstract:We present some stability criteria mainly for continuous-time Markovian switching systems, which can provide us with an insight into the mechanism that drives the subsystems to interact with each other so as to achieve stability. On the one hand, directly computing the Lyapunov exponent through the state-transition matrix of the system under consideration allows us to capture the interaction of subsystems by using the method developed in discrete-time setting. On the other hand, we can make sense of how the subsystems are orchestrated by the statistical property of switching signal through a family of coupled Lyapunov inequalities, which naturally covers the stability in the mean-square sense as a special case. Three examples are included to illustrate the theoretical results.

automation & control systems,instruments & instrumentation,engineering, multidisciplinary
Relating dynamics and structure of discrete and continuous time systems

Shuyun Jiao,David Waxman

2024-11-18

Abstract:There are many instances, in subjects such as biology, where a population number, or related quantity, changes in discrete time. For the population number at time $n=0,1,2,\ldots$, written $x_{n}$, we show that some exactly soluble cases of $x_{n}$ can be related to a different problem, where the number of individuals changes in continuous time. With $x(t)$ the population number at continuous time $t\geq0$, the relation is that $x(t=n)$ precisely coincides with $x_{n}$. In such a case, we call the two models 'equivalent', even though $x_{n}$ obeys a difference equation and $x(t)$ obeys a differential equation. Cases of equivalence can be found for both time homogeneous and time inhomogeneous equations. A comparison of the difference equation and the differential equation of the equivalent problem, allows us to make a correspondence between coefficients in these equations, thereby exposing structural similarities and differences of the two problems. When the equation that $x_{n}$ obeys is modified, e.g., by the introduction of time inhomogeneity, so $x_{n}$ has no exact solution, we show how to construct an approximate equivalent continuous time solution, $x^{(\mathrm{app})}(t)$. We find that $x^{(\mathrm{app})}(t=n)$ can yield a good approximation to $x_{n}$ because $x^{(\mathrm{app})}(t)$ encapsulates much of the behaviour of $x_{n}$. We note that some discrete time problems may have solutions with an oscillatory component that changes sign as $n\rightarrow n+1$. This occurs with the Fibonacci numbers. We find that the way an equivalent continuous time solution replicates this oscillatory behaviour is by becoming complex; it no longer represents a simple interpolation.

Populations and Evolution,Exactly Solvable and Integrable Systems,Quantitative Methods
Discontinuous Instabilities in Disordered Solids.

Ding Xu,Shiyun Zhang,Andrea J. Liu,Sidney R. Nagel,Ning Xu

DOI: https://doi.org/10.1073/pnas.2304974120

IF: 11.1

2023-01-01

Proceedings of the National Academy of Sciences

Abstract:Under a sufficiently large load, a solid material will flow via rearrangements, where particles change neighbors. Such plasticity is most easily described in the athermal, quasistatic limit of zero temperature and infinitesimal loading rate, where rearrangements occur only when the system becomes mechanically unstable. For disordered solids, the instabilities marking the onset of rearrangements have long been believed to be fold instabilities, in which an energy barrier disappears and the frequency of a normal mode of vibration vanishes continuously. Here, we report that there exists another, anomalous, type of instability caused by the breaking of a "stabilizing bond," whose removal creates an unstable vibrational mode. For commonly studied systems, such as those with harmonic finite-range interparticle interactions, such "discontinuous instabilities" are not only inevitable, they often dominate the modes of failure. Stabilizing bonds are a subset of all the bonds in the system and are prevalent in disordered solids generally. Although they do not trigger discontinuous instabilities in systems with vanishing stiffness at the interaction cutoff, they are, even in those cases, local indicators of incipient mechanical failure. They therefore provide an accurate structural predictor of instabilities not only of the discontinuous type but of the fold type as well.
Explosion, implosion, and moments of passage times for continuous-time Markov chains: a semimartingale approach

Mikhail Menshikov,Dimitri Petritis

DOI: https://doi.org/10.1016/j.spa.2014.03.001

2012-06-14

Abstract:We establish general theorems quantifying the notion of recurrence --- through an estimation of the moments of passage times --- for irreducible continuous-time Markov chains on countably infinite state spaces. Sharp conditions of occurrence of the phenomenon of explosion are also obtained. A new phenomenon of implosion is introduced and sharp conditions for its occurrence are proven. The general results are illustrated by treating models having a difficult behaviour even in discrete time.

Probability,Mathematical Physics
A Mesoscopic Approach on Stability and Phase Transition Between Different Traffic Flow States

Wei-Liang Qian,Bin Wang,Kai Lin,Romuel F. Machado,Yogiro Hama

DOI: https://doi.org/10.1016/j.ijnonlinmec.2016.11.010

IF: 3.336

2016-01-01

International Journal of Non-Linear Mechanics

Abstract:It is understood that congestion in traffic can be interpreted in terms of the instability of the equation of dynamic motion. The evolution of a traffic system from an unstable or metastable state to a globally stable state bears a strong resemblance to the phase transition in thermodynamics. In this work, we explore the underlying physics of the traffic system, by examining closely the physical properties and mathematical constraints of the phase transitions therein. By using a mesoscopic approach, one entitles the catastrophe model the same physical content as in the Landau's theory, and uncovers its close connections to the instability of the equation of motion and to the transition between different traffic states. In addition to the one-dimensional configuration space, we generalize our discussions to the higher-dimensional case, where the observed temporal oscillation in traffic flow data is attributed to the curl of a vector field. We exhibit that our model can reproduce the main features of the observed fundamental diagram including the inverse-λ shape and the wide scattering of congested traffic data. When properly parameterized, the main feature of the data can be reproduced reasonably well either in terms of the oscillating congested traffic or in terms of the synchronized flow.
Compressibility and Stochastic Stability of Monotone Markov Chain

Sergey Foss,Michael Scheutzow

2024-03-22

Abstract:For a stochastically monotone Markov chain taking values in a Polish space, we present a number of conditions for existence and for uniqueness of its stationary regime, as well as for closeness of its transient trajectories. In particular, we generalise a basic result by Bhattacharya and Majumdar (2007) where a certain form of mixing, or swap condition was assumed uniformly over the state space. We do not rely on continuity properties of transition probabilities.

Probability

Stability Of Circulation Decompositions And Self-Organization Phenomena

2 Circulation Distribution, Entropy Production and Irreversibility of Finite Markov Chains with Continuous Parameter

Circulation Distribution, Entropy Production And Irreversibility Of Denumerable Markov Chains

Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy

Cycle Symmetries and Circulation Fluctuations for Discrete-Time and Continuous-Time Markov Chains

Dynamical Decomposition of Markov Processes Without Detailed Balance

Flow Decomposition Reveals Dynamical Structure of Markov Process

Decomposition of Quantum Markov Chains and Its Applications

Circulations of Markov-Chains with Continuous-Time and the Probability Interpretation of Some Determinants

A Simple Discrete Model of Brownian Motors: Time-periodic Markov Chains

Mixed Monotone Decomposition of Dynamical Systems with Application

Markov Chain Hidden behind Power Law Mechanism of Self-organized Criticality

Decomposition Scheme In Continuous Dissipative Chaotic Systems And Role Of Strange Attractors

SDE Decomposition and A-type Stochastic Interpretation in Nonequilibrium Processes

Stochastic Thermodynamics Across Scales: Emergent Inter-attractoral Discrete Markov Jump Process and Its Underlying Continuous Diffusion

Almost sure stability criteria for linear Markovian switching systems

Relating dynamics and structure of discrete and continuous time systems

Discontinuous Instabilities in Disordered Solids.

Explosion, implosion, and moments of passage times for continuous-time Markov chains: a semimartingale approach

A Mesoscopic Approach on Stability and Phase Transition Between Different Traffic Flow States

Compressibility and Stochastic Stability of Monotone Markov Chain