Entropy production of stationary diffusions on non-compact Riemannian manifolds

Guanglu Gong,Minping Qian

DOI: https://doi.org/10.1007/BF02878672

1997-01-01

Abstract:The closed form of the entropy production of stationary diffusion processes with bounded Nelson’s current velocity is given. The limit of the entropy productions of a sequence of reflecting diffusions is also discussed.

What problem does this paper attempt to address?

The entropy production of stationary diffusions

Lancelot Da Costa,Grigorios A. Pavliotis

2023-06-17

Abstract:The entropy production rate is a central quantity in non-equilibrium statistical physics, scoring how far a stochastic process is from being time-reversible. In this paper, we compute the entropy production of diffusion processes at non-equilibrium steady-state under the condition that the time-reversal of the diffusion remains a diffusion. We start by characterising the entropy production of both discrete and continuous-time Markov processes. We investigate the time-reversal of time-homogeneous stationary diffusions and recall the most general conditions for the reversibility of the diffusion property, which includes hypoelliptic and degenerate diffusions, and locally Lipschitz vector fields. We decompose the drift into its time-reversible and irreversible parts, or equivalently, the generator into symmetric and antisymmetric operators. We show the equivalence with a decomposition of the backward Kolmogorov equation considered in hypocoercivity theory, and a decomposition of the Fokker-Planck equation in GENERIC form. The main result shows that when the time-irreversible part of the drift is in the range of the volatility matrix (almost everywhere) the forward and time-reversed path space measures of the process are mutually equivalent, and evaluates the entropy production. When this does not hold, the measures are mutually singular and the entropy production is infinite. We verify these results using exact numerical simulations of linear diffusions. We illustrate the discrepancy between the entropy production of non-linear diffusions and their numerical simulations in several examples and illustrate how the entropy production can be used for accurate numerical simulation. Finally, we discuss the relationship between time-irreversibility and sampling efficiency, and how we can modify the definition of entropy production to score how far a process is from being generalised reversible.

Statistical Mechanics,Mathematical Physics,Numerical Analysis,Probability
5 Entropy Production, Rotation Numbers and Irreversibility of Diffusion Processes on Manifolds

Da-Quan Jiang,Min Qian,Min-Ping Qian

DOI: https://doi.org/10.1007/978-3-540-40957-1_6

2004-01-01

Abstract: • 5.1 A Simple Example: Diffusion Processes on a Circle • 5.2 Lifted Processes and Cameron-Martin-Girsanov Formula • 5.3 Irreversibility and Entropy Production • 5.4 Rotation Numbers and Circulation Decomposition
Ruelle’s Inequality for the Entropy of Diffusion Processes

Liu Peidong,Qian Min

DOI: https://doi.org/10.1007/bf02560052

1993-01-01

Acta Mathematica Sinica English Series

Abstract:In this paper Ruelle’s inequality for the entropy of diffusion processes and, moregenerally, for the entropy of random diffeomorphisms is proved.
On the Extreme of Internal Entropy Production

Jiangnan Li

DOI: https://doi.org/10.1088/1751-8113/42/3/035002

2008-01-01

Journal of Physics A Mathematical and Theoretical

Abstract:Using the one-dimensional diffusion equation the extrema of internal entropy production are investigated. It is shown that the internal entropy production is essentially a convex function, with only a minimum in Euler variation with respect to temperature, regardless of if the system is open or closed. The maximum internal entropy production can only occur in variation with respect to a physical coefficient. It is found that either a maximum or a minimum internal entropy production can occur with variation with respect to a diffusivity coefficient. The maximum tends to occur for the closed boundary condition while the minimum tends to occur for the open boundary condition. For a non-steady state, the study indicates that the extreme results shown in the steady state are not guaranteed to occur under the non-steady condition. The work highlights that the physics behind determining extrema of internal entropy production is still not fully understood.
Entropy production for diffusion processes across a semipermeable interface

Paul C Bressloff

2024-02-26

Abstract:The emerging field of stochastic thermodynamics extends classical ideas of entropy, heat and work to non-equilibrium systems. One notable finding is that the second law of thermodynamics typically only holds after taking appropriate averages with respect to an ensemble of stochastic trajectories. The resulting average rate of entropy production then quantifies the degree of departure from thermodynamic equilibrium. In this paper we investigate how the presence of a semipermeable interface increases the average entropy production of a single diffusing particle. Starting from the Gibbs-Shannon entropy for the particle probability density, we show that a semipermeable interface or membrane $\calS$ increases the average rate of entropy production by an amount that is equal to the product of the flux through the interface and the logarithm of the ratio of the probability density on either side of the interface, integrated along $\calS$. The entropy production rate thus vanishes at thermodynamic equilibrium, but can be nonzero during the relaxation to equilibrium, or if there exists a nonzero stationary equilibrium state (NESS). We illustrate the latter using the example of diffusion with stochastic resetting on a circle, and show that the average rate of interfacial entropy production is a nonmonotonic function of the resetting rate and the permeability. Finally, we give a probabilistic interpretation of the interfacial entropy production rate using so-called snapping out Brownian motion. This also allows us to construct a stochastic version of entropy production.

Statistical Mechanics,Quantitative Methods
Entropy and Entropy Production in Some Applications

Yong-Jun Zhang

DOI: https://doi.org/10.1016/j.physa.2013.11.011

2013-11-26

Abstract:By using entropy and entropy production, we calculate the steady flux of some phenomena. The method we use is a competition method, $S_S/\tau+\sigma={\it maximum}$, where $S_S$ is system entropy, $\sigma$ is entropy production and $\tau$ is microscopic interaction time. System entropy is calculated from the equilibrium state by studying the flux fluctuations. The phenomena we study include ionic conduction, atomic diffusion, thermal conduction and viscosity of a dilute gas.

Statistical Mechanics,Mathematical Physics,Quantum Physics
General Entropy Production Based On Dynamical Analysis

Zengyuan Guo

DOI: https://doi.org/10.1007/978-3-662-48485-2_3

2016-01-01

Abstract:The classical expression for entropy production is a bilinear product of generalized forces and fluxes. The combination of the Cattaneo-Vernotte model with the classical entropy expression gives a non-quadratic form, which needs to be mended to avoid the paradox of negative entropy production. Based on the thermomass theory, it is shown that the entropy production corresponds to the dissipation of the mechanical energy of thermomass flow. Therefore, the generalized forces in the entropy production should be the friction force rather than the driving force. The friction force is proportional to the heat flux. The general entropy production is thus derived as a quadratic form of heat flux, avoiding the paradox of the negative entropy production. The generalized forces and fluxes in other irreversible transport processes are investigated following the similar framework. The friction forces, driving forces and drift velocities are clarified for these transports and the general entropy production for various transport processes are derived.
Upper bounds on entropy production in diffusive dynamics

Andreas Dechant

2023-10-27

Abstract:Based on a variational expression for the steady-state entropy production rate in overdamped Langevin dynamics, we derive concrete upper bounds on the entropy production rate in various physical settings. For particles in a thermal environment and driven by non-conservative forces, we show that the entropy production rate can be upper bounded by considering only the statistics of the driven particles. We use this finding to argue that the presence of non-driven, passive degrees of freedom generally leads to decreased dissipation. Another upper bound can be obtained only in terms of the variance of the non-conservative force, which leads to a universal upper bound for particles that are driven by a constant force that is applied in a certain region of space. Extending our results to systems attached to multiple heat baths or with spatially varying temperature and/or mobility, we show that the temperature difference between the heat baths or the gradient of the temperature can be used to upper bound the entropy production rate. We show that most of these results extend in a straightforward way to underdamped Langevin dynamics and demonstrate them in three concrete examples.

Statistical Mechanics
Entropy Solutions to the Dirichlet Problem for Nonlinear Diffusion Equations with Conservative Noise

Kai Du,Ruoyang Liu,Yuxing Wang

DOI: https://doi.org/10.1137/22m1537667

IF: 2.071

2024-01-13

SIAM Journal on Mathematical Analysis

Abstract:SIAM Journal on Mathematical Analysis, Volume 56, Issue 1, Page 637-675, February 2024. Motivated by porous medium equations with a randomly perturbed velocity field, this paper considers a class of nonlinear degenerate diffusion equations with nonlinear conservative noise in bounded domains. The existence, uniqueness, and [math]-stability of nonnegative entropy solutions under the homogeneous Dirichlet boundary condition are proved. The approach combines Kruzhkov's doubling variables technique with a revised strong entropy condition that is automatically satisfied by the solutions of approximate equations.

mathematics, applied
Some new results on relative entropy production, time reversal, and optimal control of time-inhomogeneous diffusion processes

Wei Zhang

DOI: https://doi.org/10.1063/5.0038740

2021-04-17

Abstract:This paper studies time-inhomogeneous nonequilibrium diffusion processes, including both Brownian dynamics and Langevin dynamics. We derive upper bounds of the relative entropy production of the time-inhomogeneous process with respect to the transient invariant probability measures. We also study the time reversal of the reverse process in Crooks' fluctuation theorem. We show that the time reversal of the reverse process coincides with the optimally controlled forward process that leads to zero variance importance sampling estimator based on Jarzynski's equality.

Probability,Mathematical Physics
On the Renyi entropy power and the Gagliardo-Nirenberg-Sobolev inequality on Riemannian manifolds

Li Songzi,Li Xiang-Dong

DOI: https://doi.org/10.48550/arxiv.2001.11184

2020-01-01

Abstract: In this paper, we prove the concavity of the Renyi entropy power for nonlinear diffusion equation (NLDE) associated with the Laplacian and the Witten Laplacian on compact Riemannian manifolds with non-negative Ricci curvature or $CD(0,m)$-condition and on compact manifolds equipped with time dependent metrics and potentials. Our results can be regarded as natural extensions of a result due to Savar\'e and Toscani \cite{ST} on the concavity of the Renyi entropy for NLDE on Euclidean spaces. Moreover, we prove that the rigidity models for the Renyi entropy power are the Einstein or quasi-Einstein manifolds and a special $(K,m)$-Ricci flow with Hessian solitons. Inspired by Lu-Ni-Vazquez-Villani \cite{LNVV}, we prove the Aronson-Benilan estimates for NLDE on compact Riemannian manifolds with $CD(0,m)$-condition. We also prove the NIW formula which indicates an intrinsic relationship between the second order derivative of the Renyi entropy power $N_p$, the $p$-th Fisher information $I_p$ and the time derivative of the $W$-entropy associated with NLDE. Finally, we prove the entropy isoperimetric inequality for the Renyi entropy power and the Gagliardo-Nirenberg-Sobolev inequality on complete Riemannian manifolds with non-negative Ricci curvature or $CD(0, m)$-condition and maximal volume growth condition.
Mesoscopic and Macroscopic Entropy Balance Equations in a Stochastic Dynamics and Its Deterministic Limit

Hong Qian,Zhongwei Shen

2024-06-01

Abstract:Entropy, its production, and its change in a dynamical system can be understood from either a fully stochastic dynamic description or from a deterministic dynamics exhibiting chaotic behavior. By taking the former approach based on the general diffusion process with diffusion $\tfrac{1}{\alpha}{\bf D}(\bf x)$ and drift $\bf b(\bf x)$, where $\alpha$ represents the ``size parameter'' of a system, we show that there are two distinctly different entropy balance equations. One reads ${\rm d} S^{(\alpha)}/{\rm d} t = e^{(\alpha)}_p + Q^{(\alpha)}_{ex}$ for all $\alpha$. However, the leading $\alpha$-order, ``extensive'', terms of the entropy production rate $e^{(\alpha)}_p$ and heat exchange rate $Q^{(\alpha)}_{ex}$ are exactly cancelled. Therefore, in the asymptotic limit of $\alpha\to\infty$, there is a second, local ${\rm d} S/{\rm d} t = \nabla\cdot{\bf b}({\bf x}(t))+\left({\bf D}:{\bf \Sigma}^{-1}\right)({\bf x}(t))$ on the order of $O(1)$, where $\tfrac{1}{\alpha}{\bf D}(\bf x(t))$ represents the randomness generated in the dynamics usually represented by metric entropy, and $\tfrac{1}{\alpha}{\bf \Sigma}({\bf x}(t))$ is the covariance matrix of the local Gaussian description at ${\bf x}(t)$, which is a solution to the ordinary differential equation $\dot{\bf x}={\bf b}(\bf x)$ at time $t$. This latter equation is akin to the notions of volume-preserving conservative dynamics and entropy production in the deterministic dynamic approach to nonequilibrium thermodynamics {\it à la} D. Ruelle. As a continuation of [17], mathematical details with sufficient care are given in four Appendices.

Mathematical Physics,Dynamical Systems,Probability
Entropy production of the contact model

Tânia Tome,Mário J. de Oliveira

2024-08-21

Abstract:We propose an expression for the production of entropy for system described by a stochastic dynamics which is appropriate for the case where the reverse transition rate vanishes but the forward transition is nonzero. The expression is positive defined and based on the inequality $x\ln x-(x-1)\ge0$. The corresponding entropy flux is linear in the probability distribution allowing its calculation as an average. The expression is applied to the one-dimensional contact process at the stationary state. We found that the rate of entropy production per site is finite with a singularity at the critical point with diverging slope.

Statistical Mechanics
Entropy-minimizing dynamical transport on Riemannian manifolds

Gabriele Bocchi,Alessio Porretta

2024-01-04

Abstract:Given a smooth Riemannian manifold $(M,g)$, compact and without boundary, we analyze the dynamical optimal mass transport problem where the cost is given by the sum of the kinetic energy and the relative entropy with respect to a reference volume measure $e^{-V}dx$. Under the only assumption that the prescribed marginals lie in $L^1(M)$, and a lower bound on the Ricci curvature, we characterize the minimal curves as unique weak solutions of the optimality system coupling the continuity equation with a backward Hamilton-Jacobi equation (with source given by $\log (m)$). We give evidence that the entropic cost enhances diffusive effects in the evolution of the optimal densities, proving $L^1\to L^\infty$ regularization in time for any initial-terminal data, and smoothness of the solutions whenever the marginals are positive and smooth. We use displacement convexity arguments (in the Eulerian approach) and gradient bounds from quasilinear elliptic equations. We also prove the convergence of optimal curves towards the classical Wasserstein geodesics, as the entropic term is multiplied by a vanishing parameter, showing that this kind of functionals can be used to build a smoothing approximation of the standard optimal transport problem.

Analysis of PDEs
Stochastic entropy production for dynamical systems with restricted diffusion

Jonathan Dexter,Ian J. Ford

DOI: https://doi.org/10.48550/arXiv.2302.01882

2023-02-04

Abstract:Modelling the evolution of a system using stochastic dynamics typically implies a greater subjective uncertainty in the adopted system coordinates as time progresses, and stochastic entropy production has been developed as a measure of this change. In some situations the evolution of stochastic entropy production can be described using an Itô process, but mathematical difficulties can emerge if diffusion in the system phase space is restricted to a subspace of lower dimension. This can arise if there are constants of the motion, for example, or more generally when there are functions of the coordinates that evolve without noise. We discuss such a case for an open three-level quantum system modelled within a framework of Markovian quantum state diffusion and show how the problem of computing the stochastic entropy production in such a situation can be overcome. We go on to illustrate how a nonequilibrium stationary state of the three-level system, with a constant mean production rate of stochastic entropy, can be established under suitable environmental couplings.

Statistical Mechanics,Quantum Physics
Entropy production and the geometry of dissipative evolution equations

Celia Reina,Johannes Zimmer

DOI: https://doi.org/10.1103/PhysRevE.92.052117

Abstract:Purely dissipative evolution equations are often cast as gradient flow structures, z ̇=K(z)DS(z), where the variable z of interest evolves towards the maximum of a functional S according to a metric defined by an operator K. While the functional often follows immediately from physical considerations (e.g., the thermodynamic entropy), the operator K and the associated geometry does not necessarily do so (e.g., Wasserstein geometry for diffusion). In this paper, we present a variational statement in the sense of maximum entropy production that directly delivers a relationship between the operator K and the constraints of the system. In particular, the Wasserstein metric naturally arises here from the conservation of mass or energy, and depends on the Onsager resistivity tensor, which, itself, may be understood as another metric, as in the steepest entropy ascent formalism. This variational principle is exemplified here for the simultaneous evolution of conserved and nonconserved quantities in open systems. It thus extends the classical Onsager flux-force relationships and the associated variational statement to variables that do not have a flux associated to them. We further show that the metric structure K is intimately linked to the celebrated Freidlin-Wentzell theory of stochastically perturbed gradient flows, and that the proposed variational principle encloses an infinite-dimensional fluctuation-dissipation statement.
Entropy solutions to the fully non-local diffusion equations

Ying Li,Chao Zhang

2023-11-01

Abstract:We consider the fully non-local diffusion equations with non-negative $L^1$-data. Based on the approximation and energy methods, we prove the existence and uniqueness of non-negative entropy solutions for such problems. In particular, our results are valid for the time-space fractional Laplacian equations.

Analysis of PDEs
Gradient Estimates and Entropy Formulae of Porous Medium and Fast Diffusion Equations for the Witten Laplacian

Guangyue Huang,Haizhong Li

DOI: https://doi.org/10.2140/pjm.2014.268.47

2014-01-01

Pacific Journal of Mathematics

Abstract:We consider gradient estimates to positive solutions of porous medium equations and fast diffusion equations: $$u_t=\Delta_\phi(u^p)$$ associated with the Witten Laplacian on Riemannian manifolds. Under the assumption that the $m$-dimensional Bakry-Emery Ricci curvature is bounded from below, we obtain gradient estimates which generalize the results in [20] and [13]. Moreover, inspired by X. -D. Li's work in [19] we also study the entropy formulae introduced in [20] for porous medium equations and fast diffusion equations associated with the Witten Laplacian. We prove monotonicity theorems for such entropy formulae on compact Riemannian manifolds with non-negative $m$-dimensional Bakry-Emery Ricci curvature
Diffusion Processes: entropy, Gibbs states and the continuous time Ruelle operator

A. O. Lopes,G. Muller,A. Neumann

2024-07-16

Abstract:We consider a Riemmaniann compact manifold $M$, the associated Laplacian $\Delta$ and the corresponding Brownian motion $X_t$, $t\geq 0.$ Given a Lipschitz function $V:M\to\mathbb R$ we consider the operator $\frac{1}{2}\Delta+V$, which acts on differentiable functions $f: M\to\mathbb R$ via the operator $$\frac{1}{2} \Delta f(x)+\,V(x)f(x) ,$$ for all $x\in M$. Denote by $P_t^V$, $t \geq 0,$ the semigroup acting on functions $f: M\to\mathbb R$ given by $$P_{t}^V (f)(x)\,:=\, \mathbb E_{x} \big[e^{\int_0^{t} V(X_r)\,dr} f(X_t)\big].\,$$ We will show that this semigroup is a continuous-time version of the discrete-time Ruelle operator. Consider the positive differentiable eigenfunction $F: M \to \mathbb{R}$ associated to the main eigenvalue $\lambda$ for the semigroup $P_t^V$, $t \geq 0$. From the function $F$, in a procedure similar to the one used in the case of discrete-time Thermodynamic Formalism, we can associate via a coboundary procedure a certain stationary Markov semigroup. The probability on the Skhorohod space obtained from this new stationary Markov semigroup can be seen as a stationary Gibbs state associated with the potential $V$. We define entropy, pressure, the continuous-time Ruelle operator and we present a variational principle of pressure for such a setting.

Probability,Statistical Mechanics,Mathematical Physics,Dynamical Systems
Large deviation function for the entropy production: Optimal trajectory and role of fluctuations

Thomas Speck,Andreas Engel,Udo Seifert

DOI: https://doi.org/10.1088/1742-5468/2012/12/P12001

2012-10-11

Abstract:We study the large deviation function for the entropy production rate in two driven one-dimensional systems: the asymmetric random walk on a discrete lattice and Brownian motion in a continuous periodic potential. We compare two approaches: the Donsker-Varadhan theory and the Freidlin-Wentzell theory. We show that the wings of the large deviation function are dominated by a single optimal trajectory: either in forward (positive rate) or in backward direction (negative rate). The joining of both branches at zero entropy production implies a non-differentiability and thus the appearance of a "kink". However, around zero entropy production many trajectories contribute and thus the kink is smeared out.

Statistical Mechanics

Entropy production of stationary diffusions on non-compact Riemannian manifolds

The entropy production of stationary diffusions

5 Entropy Production, Rotation Numbers and Irreversibility of Diffusion Processes on Manifolds

Ruelle’s Inequality for the Entropy of Diffusion Processes

On the Extreme of Internal Entropy Production

Entropy production for diffusion processes across a semipermeable interface

Entropy and Entropy Production in Some Applications

General Entropy Production Based On Dynamical Analysis

Upper bounds on entropy production in diffusive dynamics

Entropy Solutions to the Dirichlet Problem for Nonlinear Diffusion Equations with Conservative Noise

Some new results on relative entropy production, time reversal, and optimal control of time-inhomogeneous diffusion processes

On the Renyi entropy power and the Gagliardo-Nirenberg-Sobolev inequality on Riemannian manifolds

Mesoscopic and Macroscopic Entropy Balance Equations in a Stochastic Dynamics and Its Deterministic Limit

Entropy production of the contact model

Entropy-minimizing dynamical transport on Riemannian manifolds

Stochastic entropy production for dynamical systems with restricted diffusion

Entropy production and the geometry of dissipative evolution equations

Entropy solutions to the fully non-local diffusion equations

Gradient Estimates and Entropy Formulae of Porous Medium and Fast Diffusion Equations for the Witten Laplacian

Diffusion Processes: entropy, Gibbs states and the continuous time Ruelle operator

Large deviation function for the entropy production: Optimal trajectory and role of fluctuations