Abstract:The entropy production rate is a central quantity in non-equilibrium statistical physics, scoring how far a stochastic process is from being time-reversible. In this paper, we compute the entropy production of diffusion processes at non-equilibrium steady-state under the condition that the time-reversal of the diffusion remains a diffusion. We start by characterising the entropy production of both discrete and continuous-time Markov processes. We investigate the time-reversal of time-homogeneous stationary diffusions and recall the most general conditions for the reversibility of the diffusion property, which includes hypoelliptic and degenerate diffusions, and locally Lipschitz vector fields. We decompose the drift into its time-reversible and irreversible parts, or equivalently, the generator into symmetric and antisymmetric operators. We show the equivalence with a decomposition of the backward Kolmogorov equation considered in hypocoercivity theory, and a decomposition of the Fokker-Planck equation in GENERIC form. The main result shows that when the time-irreversible part of the drift is in the range of the volatility matrix (almost everywhere) the forward and time-reversed path space measures of the process are mutually equivalent, and evaluates the entropy production. When this does not hold, the measures are mutually singular and the entropy production is infinite. We verify these results using exact numerical simulations of linear diffusions. We illustrate the discrepancy between the entropy production of non-linear diffusions and their numerical simulations in several examples and illustrate how the entropy production can be used for accurate numerical simulation. Finally, we discuss the relationship between time-irreversibility and sampling efficiency, and how we can modify the definition of entropy production to score how far a process is from being generalised reversible.

-divergence improves the entropy production estimation via machine learning

$α$-divergence Improves the Entropy Production Estimation via Machine Learning

Entropy Production by Underdamped Langevin Dynamics

Erratum: “Variational inference of the drift function for stochastic differential equations driven by Lévy processes” [Chaos 32, 061103 (2022)]

$α$-Divergence Loss Function for Neural Density Ratio Estimation

Effective estimation of entropy production with lacking data

Energy-entropy competition and the effectiveness of stochastic gradient descent in machine learning

Variational inference of the drift function for stochastic differential equations driven by Lévy processes

Mean Exit Time and Escape Probability for Dynamical Systems Driven by Lévy Noises

Global optimization and monotonicity in entropy production of weak drivings

The entropy production of stationary diffusions

Output-weighted and relative entropy loss functions for deep learning precursors of extreme events

Minimal Kullback–Leibler Divergence for Constrained Lévy–Itô Processes

Thermodynamic uncertainty relations for steady-state thermodynamics

Nonparametric inference of stochastic differential equations based on the relative entropy rate

Local Optimality and Generalization Guarantees for the Langevin Algorithm via Empirical Metastability

Inferring entropy production rate from partially observed Langevin dynamics under coarse-graining

Improving estimation of entropy production rate for run-and-tumble particle systems by high-order thermodynamic uncertainty relation

Measures of path-based nonlinear expansion rates and Lagrangian uncertainty in stochastic flows

Jensen bound for the entropy production rate in stochastic thermodynamics