Entropy, Thermostats and Chaotic Hypothesis

Giovanni Gallavotti

DOI: https://doi.org/10.1063/1.2372713

2006-07-07

Abstract:The chaotic hypothesis is proposed as a basis for a general theory of nonequilibrium stationary states. Version 2: new comments added after presenting this talk at the Meeting mentioned in the Acknowledgement. One typo corrected.

Statistical Mechanics

What problem does this paper attempt to address?

Non equilibrium in statistical and fluid mechanics. Ensembles and their equivalence. Entropy driven intermittency

Giovanni Gallavotti

DOI: https://doi.org/10.1063/1.533335

2000-01-31

Abstract:We present a review of the chaotic hypothesis and discuss its applications to intermittency in statistical mechanics and fluid mechanics proposing a quantitative definition. Entropy creation rate is interpreted in terms of certain intermittency phenomena. An attempt to a theory of the experiment of Ciliberto-Laroche on the fluctuation law is presented.

Fluid Dynamics,Chaotic Dynamics,Classical Physics
Non-additive entropies and statistical mechanics at the edge of chaos: a bridge between natural and social sciences

Constantino Tsallis

DOI: https://doi.org/10.1098/rsta.2022.0293

2023-10-02

Abstract:The Boltzmann-Gibbs (BG) statistical mechanics constitutes one of the pillars of contemporary theoretical physics. It is constructed upon the other pillars-classical, quantum, relativistic mechanics and Maxwell equations for electromagnetism-and its foundations are grounded on the optimization of the BG (additive) entropic functional [Formula: see text]. Its use in the realm of classical mechanics is legitimate for vast classes of nonlinear dynamical systems under the assumption that the maximal Lyapunov exponent is positive (currently referred to as strong chaos), and its validity has been experimentally verified in countless situations. It fails however when the maximal Lyapunov exponent vanishes (referred to as weak chaos), which is virtually always the case with complex natural, artificial and social systems. To overcome this type of weakness of the BG theory, a generalization was proposed in 1988 grounded on the non-additive entropic functional [Formula: see text]. The index [Formula: see text] and related ones are to be calculated, whenever mathematically tractable, from first principles and reflect the specific class of weak chaos. We review here the basics of this generalization and illustrate its validity with selected examples aiming to bridge natural and social sciences. This article is part of the theme issue 'Thermodynamics 2.0: Bridging the natural and social sciences (Part 2)'.
The Physical Origins of Entropy Production, Free Energy Dissipation and their Mathematical Representations

Hao Ge,Hong Qian

DOI: https://doi.org/10.1103/PhysRevE.81.051133

2009-11-23

Abstract:A complete mathematical theory of nonequilibrium thermodynamics of stochastic systems in terms of master equations is presented. As generalizations of isothermal entropy and free energy, two functions of states play central roles: the Gibbs entropy $S$ and the relative entropy $F$, which are related via the stationary distribution of the stochastic dynamics. $S$ satisfies the fundamental entropy balance equation $dS/dt=e_p-h_d/T$ with entropy production rate $e_p\ge 0$ and heat dissipation rate $h_d$, while $dF/dt=-f_d\le 0$. For closed systems that satisfy detailed balance: $Te_p(t)=f_d(t)$. For open system one has $Te_p(t)=f_d(t)+Q_{hk}(t)$ where the housekeeping heat $Q_{hk}\ge 0$ was first introduced in the phenomenological nonequilibrium steady state thermodynamics. Entropy production $e_p$ consists of free energy dissipation associated with spontaneous relaxation, $f_d$, and active energy pumping that sustains the open system $Q_{hk}$. The amount of excess heat involved in the relaxation $Q_{ex}=h_d-Q_{hk} = f_d-T(dS/dt)$.

Statistical Mechanics
Thermodynamics of chaotic relaxation processes

Domenico Lippolis

2024-06-30

Abstract:The established thermodynamic formalism of chaotic dynamics, valid at statistical equilibrium, is here generalized to systems out of equilibrium, that have yet to relax to a steady state. A relation between information, escape rate, and the phase-space average of an integrated observable (e.g. Lyapunov exponent, diffusion coefficient) is obtained for finite time. Most notably, the thermodynamic treatment may predict the phase-space profile of any finite-time integrated observable from the leading and subleading eigenfunctions of the Perron-Frobenius/Koopman transfer operator. Examples of that equivalence are shown, and the theory is tested analytically on the Bernoulli map, while numerically on the perturbed cat map, the Hénon map, and the Ikeda map, all paradigms of chaos.

Chaotic Dynamics,Statistical Mechanics
Where Has Entropy Gone: Theory of General System (II)

Wang Zhen

DOI: https://doi.org/10.48550/arXiv.quant-ph/9605018

1996-05-16

Abstract:A pair of symmetric expressions for the second law of thermodynamics is put forward. The conservation and transfer of entropy is discussed and applied to problems like biology, culture and life itself. A new explanation is given to the cosmic expansion with the concept of diversity in this theory. The problem of contingency and necessity is also discussed.

Quantum Physics,General Relativity and Quantum Cosmology
Generalized thermodynamics and kinetic equations: Boltzmann, Landau, Kramers and Smoluchowski

Pierre-Henri Chavanis

DOI: https://doi.org/10.1016/j.physa.2003.09.061

2003-04-03

Abstract:We propose a formal extension of thermodynamics and kinetic theories to a larger class of entropy functionals. Kinetic equations associated to Boltzmann, Fermi, Bose and Tsallis entropies are recovered as a special case. This formalism first provides a unifying description of classical and quantum kinetic theories. On the other hand, a generalized thermodynamical framework is justified to describe complex systems exhibiting anomalous diffusion. Finally, a notion of generalized thermodynamics emerges in the context of the the violent relaxation of collisionless stellar systems and two-dimensional vortices due to the existence of Casimir invariants and incomplete relaxation. A thermodynamical analogy can also be developed to analyze the nonlinear dynamical stability of stationary solutions of the Vlasov and 2D Euler-Poisson systems. On general grounds, we suggest that generalized entropies arise due to the existence of ``hidden constraints'' that modify the form of entropy that we would naively expect. Generalized kinetic equations are therefore ``effective'' equations that are introduced heuristically to describe complex systems.

Statistical Mechanics
On Clausius' approach to entropy and analogies in non-equilibrium

Giovanni Jona-Lasinio

2023-06-07

Abstract:In his ninth memoir Clausius summarizes the two principles of thermodynamics as follows: "The whole mechanical theory of heat rests on two fundamental theorems: that of equivalence of heat and work, and that of equivalence of transformations." This paper contains an introduction to Clausius' approach to entropy as illustrated in his original articles and describes an analogy in the macroscopic fluctuation theory of non-equilibrium diffusive systems.

Statistical Mechanics
Entropy Evolution and Uncertainty Estimation with Dynamical Systems

X. San Liang

DOI: https://doi.org/10.3390/e16073605

IF: 2.738

2014-01-01

Entropy

Abstract:This paper presents a comprehensive introduction and systematic derivation of the evolutionary equations for absolute entropy H and relative entropy D, some of which exist sporadically in the literature in different forms under different subjects, within the framework of dynamical systems. In general, both H and D are dissipated, and the dissipation bears a form reminiscent of the Fisher information; in the absence of stochasticity, dH/dt is connected to the rate of phase space expansion, and D stays invariant, i.e., the separation of two probability density functions is always conserved. These formulas are validated with linear systems, and put to application with the Lorenz system and a large-dimensional stochastic quasi-geostrophic flow problem. In the Lorenz case, H falls at a constant rate with time, implying that H will eventually become negative, a situation beyond the capability of the commonly used computational technique like coarse-graining and bin counting. For the stochastic flow problem, it is first reduced to a computationally tractable low-dimensional system, using a reduced model approach, and then handled through ensemble prediction. Both the Lorenz system and the stochastic flow system are examples of self-organization in the light of uncertainty reduction. The latter particularly shows that, sometimes stochasticity may actually enhance the self-organization process.
A Strategy for Proving the Strong Eigenstate Thermalization Hypothesis : Chaotic Systems and Holography

Taishi Kawamoto

2024-11-15

Abstract:The strong eigenstate thermalization hypothesis (ETH) provides a sufficient condition for thermalization and equilibration. Although it is expected to hold in a wide class of highly chaotic theories, there are only a few analytic examples demonstrating the strong ETH in special cases, often through methods related to integrability. In this paper, we explore sufficient conditions for the strong ETH that may apply to a broad range of chaotic theories. These conditions are expressed as inequalities involving the long-time averages of real-time thermal correlators. Specifically, as an illustration, we consider simple toy examples which satisfy these conditions under certain technical assumptions. This toy models have same properties as holographic theories at least in the perturbation in large $N$. We give a few comments for more realistic holographic models.

High Energy Physics - Theory,Statistical Mechanics,Quantum Physics
Mesoscopic and Macroscopic Entropy Balance Equations in a Stochastic Dynamics and Its Deterministic Limit

Hong Qian,Zhongwei Shen

2024-06-01

Abstract:Entropy, its production, and its change in a dynamical system can be understood from either a fully stochastic dynamic description or from a deterministic dynamics exhibiting chaotic behavior. By taking the former approach based on the general diffusion process with diffusion $\tfrac{1}{\alpha}{\bf D}(\bf x)$ and drift $\bf b(\bf x)$, where $\alpha$ represents the ``size parameter'' of a system, we show that there are two distinctly different entropy balance equations. One reads ${\rm d} S^{(\alpha)}/{\rm d} t = e^{(\alpha)}_p + Q^{(\alpha)}_{ex}$ for all $\alpha$. However, the leading $\alpha$-order, ``extensive'', terms of the entropy production rate $e^{(\alpha)}_p$ and heat exchange rate $Q^{(\alpha)}_{ex}$ are exactly cancelled. Therefore, in the asymptotic limit of $\alpha\to\infty$, there is a second, local ${\rm d} S/{\rm d} t = \nabla\cdot{\bf b}({\bf x}(t))+\left({\bf D}:{\bf \Sigma}^{-1}\right)({\bf x}(t))$ on the order of $O(1)$, where $\tfrac{1}{\alpha}{\bf D}(\bf x(t))$ represents the randomness generated in the dynamics usually represented by metric entropy, and $\tfrac{1}{\alpha}{\bf \Sigma}({\bf x}(t))$ is the covariance matrix of the local Gaussian description at ${\bf x}(t)$, which is a solution to the ordinary differential equation $\dot{\bf x}={\bf b}(\bf x)$ at time $t$. This latter equation is akin to the notions of volume-preserving conservative dynamics and entropy production in the deterministic dynamic approach to nonequilibrium thermodynamics {\it à la} D. Ruelle. As a continuation of [17], mathematical details with sufficient care are given in four Appendices.

Mathematical Physics,Dynamical Systems,Probability
Thermodynamics and the Evolution of Stochastic Populations

Themis Matsoukas

DOI: https://doi.org/10.48550/arXiv.2007.01362

2020-07-02

Statistical Mechanics

Abstract:The appeal of thermodynamics to problems outside physics is undeniable, as is the growing recognition of its apparent universality, yet in the absence of a rigorous formalism divorced from the peculiarities of molecular systems all attempts to generalize thermodynamics remain qualitative and heuristic at best. In this paper we formulate a probabilistic theory of thermodynamics and and set the basis for its application to generic stochastic populations.
Entropy and the Typicality of Universes

Julian Barbour,Tim Koslowski,Flavio Mercati

DOI: https://doi.org/10.48550/arXiv.1507.06498

2015-07-24

Abstract:The universal validity of the second law of thermodynamics is widely attributed to a finely tuned initial condition of the universe. This creates a problem: why is the universe atypical? We suggest that the problem is an artefact created by inappropriate transfer of the traditional concept of entropy to the whole universe. Use of what we call the relational $N$-body problem as a model indicates the need to employ two distinct entropy-type concepts to describe the universe. One, which we call entaxy, is novel. It is scale-invariant and decreases as the observable universe evolves. The other is the algebraic sum of the dimensionful entropies of branch systems (isolated subsystems of the universe). This conventional additive entropy increases. In our model, the decrease of entaxy is fundamental and makes possible the emergence of branch systems and their increasing entropy. We have previously shown that all solutions of our model divide into two halves at a unique `Janus point' of maximum disorder. This constitutes a common past for two futures each with its own gravitational arrow of time. We now show that these arrows are expressed through the formation of branch systems within which conventional entropy increases. On either side of the Janus point, this increase is in the same direction in every branch system. We also show that it is only possible to specify unbiased solution-determining data at the Janus point. Special properties of these `mid-point data' make it possible to develop a rational theory of the typicality of universes whose governing law, as in our model, dictates the presence of a Janus point in every solution. If our self-gravitating universe is governed by such a law, then the second law of thermodynamics is a necessary direct consequence of it and does not need any special initial condition.

General Relativity and Quantum Cosmology
Compatibility of linear-response theory with the Second Law of Thermodynamics and the emergence of negative entropy production rates

Pierre Nazé,Marcus V. S. Bonança

DOI: https://doi.org/10.1088/1742-5468/ab54ba

2020-01-14

Abstract:The reliability of physical theories depends on whether they agree with well established physical laws. In this work, we address the compatibility of the Hamiltonian formulation of linear-response theory with the Second Law of Thermodynamics. In order to do so, we verify three complementary aspects often understood as statements of the Second Law: 1. No dissipation for quasistatic process; 2. Dissipation for finite-time processes; 3. Positive entropy production rate. Our analysis focus on two classes of nonequilibrium isothermal processes: slowly-varying and finite-time but weak ones. For the former, we show that these aspects are easily verified. For the later, we present conditions for the achievement of the first two aspects. We also show that the third one is not always verified, presenting an example based on Brownian motion in which we observe negative values in the entropy production rate. In particular, we compare linear-response and exact results for this example.

Physics
Entropy methods in random motion

Piotr Garbaczewski

DOI: https://doi.org/10.48550/arXiv.cond-mat/0510533

2005-10-20

Statistical Mechanics

Abstract:We analyze a contrasting dynamical behavior of Gibbs-Shannon and conditional Kullback-Leibler entropies, induced by time-evolution of continuous probability distributions. The question of predominantly purpose-dependent entropy definition for non-equilibrium model systems is addressed. The conditional Kullback-Leibler entropy is often believed to properly capture physical features of an asymptotic approach towards equilibrium. We give arguments in favor of the usefulness of the standard Gibbs-type entropy and indicate that its dynamics gives an insight into physically relevant, but generally ignored in the literature, non-equilibrium phenomena. The role of physical units in the Gibbs-Shannon entropy definition is iscussed.
Macroscopic Stochastic Thermodynamics

Gianmaria Falasco,Massimiliano Esposito

2024-02-03

Abstract:Starting at the mesoscopic level with a general formulation of stochastic thermodynamics in terms of Markov jump processes, we identify the scaling conditions that ensure the emergence of a (typically nonlinear) deterministic dynamics and an extensive thermodynamics at the macroscopic level. We then use large deviations theory to build a macroscopic fluctuation theory around this deterministic behavior, which we show preserves the fluctuation theorem. For many systems (e.g. chemical reaction networks, electronic circuits, Potts models), this theory does not coincide with Langevin-equation approaches (obtained by adding Gaussian white noise to the deterministic dynamics) which, if used, are thermodynamically inconsistent. Einstein-Onsager theory of Gaussian fluctuations and irreversible thermodynamics are recovered at equilibrium and close to it, respectively. Far from equilibirum, the free energy is replaced by the dynamically generated quasi-potential (or self-information) which is a Lyapunov function for the macroscopic dynamics. Remarkably, thermodynamics connects the dissipation along deterministic and escape trajectories to the Freidlin-Wentzell quasi-potential, thus constraining the transition rates between attractors induced by rare fluctuations. A coherent perspective on minimum and maximum entropy production principles is also provided. For systems that admit a continuous-space limit, we derive a nonequilibrium fluctuating field theory with its associated thermodynamics. Finally, we coarse grain the macroscopic stochastic dynamics into a Markov jump process describing transitions among deterministic attractors and formulate the stochastic thermodynamics emerging from it.

Statistical Mechanics,Soft Condensed Matter,Mathematical Physics
Stochastic thermodynamics, fluctuation theorems and molecular machines

Udo Seifert

DOI: https://doi.org/10.1088/0034-4885/75/12/126001

2012-11-20

Reports on Progress in Physics

Abstract:Stochastic thermodynamics as reviewed here systematically provides a framework for extending the notions of classical thermodynamics such as work, heat and entropy production to the level of individual trajectories of well-defined non-equilibrium ensembles. It applies whenever a non-equilibrium process is still coupled to one (or several) heat bath(s) of constant temperature. Paradigmatic systems are single colloidal particles in time-dependent laser traps, polymers in external flow, enzymes and molecular motors in single molecule assays, small biochemical networks and thermoelectric devices involving single electron transport. For such systems, a first-law like energy balance can be identified along fluctuating trajectories. For a basic Markovian dynamics implemented either on the continuum level with Langevin equations or on a discrete set of states as a master equation, thermodynamic consistency imposes a local-detailed balance constraint on noise and rates, respectively. Various integral and detailed fluctuation theorems, which are derived here in a unifying approach from one master theorem, constrain the probability distributions for work, heat and entropy production depending on the nature of the system and the choice of non-equilibrium conditions. For non-equilibrium steady states, particularly strong results hold like a generalized fluctuation-dissipation theorem involving entropy production. Ramifications and applications of these concepts include optimal driving between specified states in finite time, the role of measurement-based feedback processes and the relation between dissipation and irreversibility. Efficiency and, in particular, efficiency at maximum power can be discussed systematically beyond the linear response regime for two classes of molecular machines, isothermal ones such as molecular motors, and heat engines such as thermoelectric devices, using a common framework based on a cycle decomposition of entropy production.

physics, multidisciplinary
The Second Law and Entropy Misconceptions Demystified

Milivoje M. Kostic

DOI: https://doi.org/10.3390/e22060648

IF: 2.738

2020-06-11

Entropy

Abstract:The challenges and claims of hypothetical violations of the Second Law of thermodynamics have been a topic of many scientific, philosophical and social publications, even in the most prestigious scientific journals. Fascination with challenging the Second Law has further accelerated throughout the development of statistical and quantum physics, and information theory. It is phenomenologically reasoned here that non-equilibrium, useful work-energy potential is always dissipated to heat, and thus thermodynamic entropy (a measure of thermal disorder, not any other disorder) is generated always and everywhere, at any scale without exception, including life processes, open systems, micro-fluctuations, gravity or entanglement. Furthermore, entropy cannot be destroyed by any means at any scale (entropy is conserved in ideal, reversible processes and irreversibly generated in real processes), and thus, entropy cannot overall decrease, but only overall increase. Creation of ordered structures or live species always dissipate useful energy and generate entropy, without exception, and thus without Second Law violation. Entropy destruction would imply spontaneous increase in non-equilibrium, with mass-energy flux displacement against cause-and-effect, natural forces, as well as negate the reversible existence of the very equilibrium. In fact, all resolved challengers’ paradoxes and misleading violations of the Second Law to date have been resolved in favor of the Second Law and never against. We are still to witness a single, still open Second Law violation, to be confirmed.

physics, multidisciplinary
On the entropy inequality and its exploitation in continuum physics

Angelo Morro

DOI: https://doi.org/10.1007/s11012-024-01804-3

IF: 2.7

2024-05-15

Meccanica

Abstract:The paper deals with the statement and the application of the entropy principle, through the Clausius–Duhem inequality, in continuum physics. The conceptual role is taken from the Coleman–Noll paper of 1963 thus leading to the physical admissibility of constitutive equations. The statement is generalized by letting the rate of entropy production be a constitutive property per se. This generalization proves essential in connection with the modelling of hysteretic phenomena. As to the application, the view of the Coleman–Noll procedure is maintained but a representation formula is shown to generalize the consequences of the entropy principle; as an example the modelling of heat conduction is investigated. Furthermore, while applying the entropy principle to magnetic materials, it is shown an interesting connection between the balance of angular momentum and the thermodynamic restrictions. Also, the modelling through rate-type equations shows the need of Lagrangian fields to obey objectivity and that of the entropy production as a constitutive function to account for the difference between loading and unloading processes.

mechanics
Recent Progress in the Definition of Thermodynamic Entropy

Enzo Zanchini,Gian Paolo Beretta

DOI: https://doi.org/10.3390/e16031547

2014-03-24

Abstract:The principal methods for the definition of thermodynamic entropy are discussed with special reference to those developed by Carathéodory, the Keenan School, Lieb and Yngvason, and the present authors. An improvement of the latter method is then presented. Seven basic axioms are employed: three Postulates, which are considered as having a quite general validity, and four Assumptions, which identify the domains of validity of the definitions of energy (Assumption 1) and entropy (Assumptions 2, 3, 4). The domain of validity of the present definition of entropy is not restricted to stable equilibrium states. For collections of simple systems, it coincides with that of the proof of existence and uniqueness of an entropy function which characterizes the relation of adiabatic accessibility proposed by Lieb and Yngvason. However, our treatment does not require the formation of scaled copies so that it applies not only to collections of simple systems, but also to systems contained in electric or magnetic fields and to small and few-particle systems.

Mathematical Physics,Statistical Mechanics

Entropy, Thermostats and Chaotic Hypothesis

Non equilibrium in statistical and fluid mechanics. Ensembles and their equivalence. Entropy driven intermittency

Non-additive entropies and statistical mechanics at the edge of chaos: a bridge between natural and social sciences

The Physical Origins of Entropy Production, Free Energy Dissipation and their Mathematical Representations

Thermodynamics of chaotic relaxation processes

Where Has Entropy Gone: Theory of General System (II)

Generalized thermodynamics and kinetic equations: Boltzmann, Landau, Kramers and Smoluchowski

On Clausius' approach to entropy and analogies in non-equilibrium

Entropy Evolution and Uncertainty Estimation with Dynamical Systems

A Strategy for Proving the Strong Eigenstate Thermalization Hypothesis : Chaotic Systems and Holography

Mesoscopic and Macroscopic Entropy Balance Equations in a Stochastic Dynamics and Its Deterministic Limit

Thermodynamics and the Evolution of Stochastic Populations

Entropy and the Typicality of Universes

Compatibility of linear-response theory with the Second Law of Thermodynamics and the emergence of negative entropy production rates

Entropy methods in random motion

Macroscopic Stochastic Thermodynamics

Stochastic thermodynamics, fluctuation theorems and molecular machines

The Second Law and Entropy Misconceptions Demystified

On the entropy inequality and its exploitation in continuum physics

Recent Progress in the Definition of Thermodynamic Entropy