Abstract:This paper presents a comprehensive introduction and systematic derivation of the evolutionary equations for absolute entropy H and relative entropy D, some of which exist sporadically in the literature in different forms under different subjects, within the framework of dynamical systems. In general, both H and D are dissipated, and the dissipation bears a form reminiscent of the Fisher information; in the absence of stochasticity, dH/dt is connected to the rate of phase space expansion, and D stays invariant, i.e., the separation of two probability density functions is always conserved. These formulas are validated with linear systems, and put to application with the Lorenz system and a large-dimensional stochastic quasi-geostrophic flow problem. In the Lorenz case, H falls at a constant rate with time, implying that H will eventually become negative, a situation beyond the capability of the commonly used computational technique like coarse-graining and bin counting. For the stochastic flow problem, it is first reduced to a computationally tractable low-dimensional system, using a reduced model approach, and then handled through ensemble prediction. Both the Lorenz system and the stochastic flow system are examples of self-organization in the light of uncertainty reduction. The latter particularly shows that, sometimes stochasticity may actually enhance the self-organization process.

Hypoelliptic entropy dissipation for stochastic differential equations

Fisher information dissipation for time inhomogeneous stochastic differential equations

Entropy Estimate for Degenerate SDEs with Applications to Nonlinear Kinetic Fokker–Planck Equations

Entropy Estimate for Degenerate SDEs with Applications to Nonlinear Kinetic Fokker-Planck Equations

Exponential Entropy Dissipation for Weakly Self-Consistent Vlasov–Fokker–Planck Equations

A hypocoercivity related ergodicity method with rate of convergence for singularly distorted degenerate Kolmogorov equations and applications

Long-time dynamics of stochastic wave equation with dissipative damping and its full discretization: exponential ergodicity and strong law of large numbers

Exponential Stability and Hypoelliptic Regularization for the Kinetic Fokker–Planck Equation with Confining Potential

Exponential decay of Rényi divergence under Fokker-Planck equations

Exponential stability and hypoelliptic regularization for the kinetic Fokker-Planck equation with confining potential

On ergodic properties of stochastic PDEs

Asymptotic Behaviors for Nonlinear Dispersive Equations with Damping or Dissipative Terms

Error estimates of the Euler's method for stochastic differential equations with multiplicative noise via relative entropy

Entropy-dissipating semi-discrete Runge-Kutta schemes for nonlinear diffusion equations

Nonlinear Fokker-Planck equations with reaction as gradient flows of the free energy

Entropy Evolution and Uncertainty Estimation with Dynamical Systems

Position-momentum conditioning, relative entropy decomposition and convergence to equilibrium in stochastic Hamiltonian systems

Continuity of Lyapunov exponents for stochastic differential equations

$W_{\bf d}$-convergence rate of EM schemes for invariant measures of supercritical stable SDEs

Exit time and principal eigenvalue of non-reversible elliptic diffusions

Limit theorems for SDEs with irregular drifts