Nonequilibrium work relations for energy and information

Felix Ritort

2024-04-06

Abstract:I review basic concepts in the nonequilibrium physics of small systems, emphasizing single molecule experiments and how they contribute to expanding our current understanding of energy and information.

Biological Physics

What problem does this paper attempt to address?

Nonequilibrium fluctuations in small systems: From physics to biology

F. Ritort

DOI: https://doi.org/10.48550/arXiv.0705.0455

2007-05-03

Abstract:In this paper I am presenting an overview on several topics related to nonequilibrium fluctuations in small systems. I start with a general discussion about fluctuation theorems and applications to physical examples extracted from physics and biology: a bead in an optical trap and single molecule force experiments. Next I present a general discussion on path thermodynamics and consider distributions of work/heat fluctuations as large deviation functions. Then I address the topic of glassy dynamics from the perspective of nonequilibrium fluctuations due to small cooperatively rearranging regions. Finally, I conclude with a brief digression on future perspectives.

Statistical Mechanics,Disordered Systems and Neural Networks
Nonequilibrium thermodynamics and information theory: Basic concepts and relaxing dynamics

Bernhard Altaner

DOI: https://doi.org/10.1088/1751-8121/aa841d

2017-07-06

Abstract:Thermodynamics is based on the notions of energy and entropy. While energy is the elementary quantity governing physical dynamics, entropy is the fundamental concept in information theory. In this work, starting from first principles, we give a detailed didactic account on the relations between energy and entropy and thus physics and information theory. We show that thermodynamic process inequalities, like the Second Law, are equivalent to the requirement that an effective description for physical dynamics is strongly relaxing. From the perspective of information theory, strongly relaxing dynamics govern the irreversible convergence of a statistical ensemble towards the maximally non-commital probability distribution that is compatible with thermodynamic equilibrium parameters. In particular, Markov processes that converge to a thermodynamic equilibrium state are strongly relaxing. Our framework generalizes previous results to arbitrary open and driven systems, yielding novel thermodynamic bounds for idealized and real processes.

Statistical Mechanics
Free energy inference from partial work measurements in small systems

Marco Ribezzi-Crivellari,Felix Ritort

DOI: https://doi.org/10.48550/arXiv.1509.07310

2015-09-24

Statistical Mechanics

Abstract:Fluctuation relations (FRs) are among the few existing general results in non-equilibrium systems. Their verification requires the measurement of the total work (or entropy production) performed on a system. Nevertheless in many cases only a partial measurement of the work is possible. Here we consider FRs in dual-trap optical tweezers where two different forces (one per trap) are measured. With this setup we perform pulling experiments on single molecules by moving one trap relative to the other. We demonstrate that work should be measured using the force exerted by the trap that is moved. The force that is measured in the trap at rest fails to provide the full dissipation in the system leading to a (incorrect) work definition that does not satisfy the FR. The implications to single-molecule experiments and free energy measurements are discussed. In the case of symmetric setups a new work definition, based on differential force measurements, is introduced. This definition is best suited to measure free energies as it shows faster convergence of estimators. We discuss measurements using the (incorrect) work definition as an example of partial work measurement. We show how to infer the full work distribution from the partial one via the FR. The inference process does also yield quantitative information, e.g. the hydrodynamic drag on the dumbbell. Results are also obtained for asymmetric dual-trap setups. We suggest that this kind of inference could represent a new and general application of FRs to extract information about irreversible processes in small systems.
The unreasonable effectiveness of equilibrium-like theory for interpreting non-equilibrium experiments

R. Dean Astumian

DOI: https://doi.org/10.1119/1.2205883

2005-12-02

Abstract:There has been great interest in applying the results of statistical mechanics to single molecule experiements. Recent work has highlighted so-called non-equilibrium work-energy relations and Fluctuation Theorems which take on an equilibrium-like (time independent) form. Here I give a very simple heuristic example where an equilibrium result (the barometric law for colloidal particles) arises from theory describing the {\em thermodynamically} non-equilibrium phenomenon of a single colloidal particle falling through solution due to gravity. This simple result arises from the fact that the particle, even while falling, is in {\em mechanical} equilibrium (gravitational force equal the viscous drag force) at every instant. The results are generalized by appeal to the central limit theorem. The resulting time independent equations that hold for thermodynamically non-equilibrium (and even non-stationary) processes offer great possibilities for rapid determination of thermodynamic parameters from single molecule experiments.

Soft Condensed Matter
Unifying Theories for Nonequilibrium Statistical Mechanics

David M. Rogers

DOI: https://doi.org/10.48550/arXiv.1701.01466

2019-02-01

Abstract:The question of deriving general force/flux relationships that apply out of the linear response regime is a central topic of theories for nonequilibrium statistical mechanics. This work applies an information theory perspective to compute approximate force/flux relations and compares the result with traditional alternatives. If it can be said that there is a consensus on the form of response theories in driven, nonequilibrium transient dynamics, then that consensus is consistent with maximizing the entropy of a distribution over transition space. This agreement requires the problem of force/flux relationships to be described entirely in terms of such transition distributions, rather than steady-state properties (such as near-equilibrium works) or distributions over trajectory space (such as maximum caliber). Within the transition space paradigm, it is actually simpler to work in the fully nonlinear regime without relying on any assumptions about the steady-state or long-time properties. Our results are compared to extensive numerical simulations of two very different systems. The first is a the periodic Lorentz gas under constant external force, extended with angular velocity and physically realistic inelastic scattering. The second is an $\alpha$-Fermi-Pasta-Ulam chain, extended with a Langevin thermostat that couples only to individual harmonic modes. Although we simulate both starting from transient initial conditions, the maximum entropy structure of the transition distribution is clearly evident on both atomistic and intermediate size scales. The result encourages further development of empirical laws for nonequilibrium statistical mechanics by employing analogies with standard maximum entropy techniques -- even in cases where large deviation principles cannot be rigorously proven.

Statistical Mechanics
Nonequilibrium thermodynamics of quantum coherence beyond linear response

Franklin L. S. Rodrigues,Eric Lutz

DOI: https://doi.org/10.1038/s42005-024-01548-2

2024-02-24

Communications Physics

Abstract:Quantum thermodynamics allows for the interconversion of quantum coherence and mechanical work. Quantum coherence is thus a potential physical resource for quantum machines. However, formulating a general nonequilibrium thermodynamics of quantum coherence has turned out to be challenging. In particular, precise conditions under which coherence is beneficial to or, on the contrary, detrimental for work extraction from a system have remained elusive. We here develop a generic dynamic-Bayesian-network approach to the far-from-equilibrium thermodynamics of coherence. We concretely derive generalized fluctuation relations and a maximum-work theorem that fully account for quantum coherence at all times, for both closed and open dynamics. We obtain criteria for successful coherence-to-work conversion, and identify a nonequilibrium regime where maximum work extraction is increased by quantum coherence for fast processes beyond linear response.

physics, multidisciplinary
Energy and information flows in autonomous systems

Jannik Ehrich,David A. Sivak

DOI: https://doi.org/10.3389/fphy.2023.1108357

2023-04-07

Abstract:Multi-component molecular machines are ubiquitous in biology. We review recent progress on describing their thermodynamic properties using autonomous bipartite Markovian dynamics. The first and second laws can be split into local versions applicable to each subsystem of a two-component system, illustrating that one can not only resolve energy flows between the subsystems but also information flows quantifying how each subsystem's dynamics influence the joint system's entropy balance. Applying the framework to molecular-scale sensors allows one to derive tighter bounds on their energy requirement. Two-component strongly coupled machines can be studied from a unifying perspective quantifying to what extent they operate conventionally by transducing power or like an information engine by generating information flow to rectify thermal fluctuations into output power.

Statistical Mechanics
Stochastic thermodynamics, fluctuation theorems and molecular machines

Udo Seifert

DOI: https://doi.org/10.1088/0034-4885/75/12/126001

2012-11-20

Reports on Progress in Physics

Abstract:Stochastic thermodynamics as reviewed here systematically provides a framework for extending the notions of classical thermodynamics such as work, heat and entropy production to the level of individual trajectories of well-defined non-equilibrium ensembles. It applies whenever a non-equilibrium process is still coupled to one (or several) heat bath(s) of constant temperature. Paradigmatic systems are single colloidal particles in time-dependent laser traps, polymers in external flow, enzymes and molecular motors in single molecule assays, small biochemical networks and thermoelectric devices involving single electron transport. For such systems, a first-law like energy balance can be identified along fluctuating trajectories. For a basic Markovian dynamics implemented either on the continuum level with Langevin equations or on a discrete set of states as a master equation, thermodynamic consistency imposes a local-detailed balance constraint on noise and rates, respectively. Various integral and detailed fluctuation theorems, which are derived here in a unifying approach from one master theorem, constrain the probability distributions for work, heat and entropy production depending on the nature of the system and the choice of non-equilibrium conditions. For non-equilibrium steady states, particularly strong results hold like a generalized fluctuation-dissipation theorem involving entropy production. Ramifications and applications of these concepts include optimal driving between specified states in finite time, the role of measurement-based feedback processes and the relation between dissipation and irreversibility. Efficiency and, in particular, efficiency at maximum power can be discussed systematically beyond the linear response regime for two classes of molecular machines, isothermal ones such as molecular motors, and heat engines such as thermoelectric devices, using a common framework based on a cycle decomposition of entropy production.

physics, multidisciplinary
Nonequilibrium Physics in Biology

Xiaona Fang,Karsten Kruse,Ting Lu,Jin Wang

DOI: https://doi.org/10.1103/RevModPhys.91.045004

2020-12-09

Abstract:Life is characterized by a myriad of complex dynamic processes allowing organisms to grow, reproduce, and evolve. Physical approaches for describing systems out of thermodynamic equilibrium have been increasingly applied to living systems, which often exhibit phenomena unknown from those traditionally studied in physics. Spectacular advances in experimentation during the last decade or two, for example, in microscopy, single cell dynamics, in the reconstruction of sub- and multicellular systems outside of living organisms, or in high throughput data acquisition have yielded an unprecedented wealth of data about cell dynamics, genetic regulation, and organismal development. These data have motivated the development and refinement of concepts and tools to dissect the physical mechanisms underlying biological processes. Notably, the landscape and flux theory as well as active hydrodynamic gel theory have proven very useful in this endeavour. Together with concepts and tools developed in other areas of nonequilibrium physics, significant progresses have been made in unraveling the principles underlying efficient energy transport in photosynthesis, cellular regulatory networks, cellular movements and organization, embryonic development and cancer, neural network dynamics, population dynamics and ecology, as well as ageing, immune responses and evolution. Here, we review recent advances in nonequilibrium physics and survey their application to biological systems. We expect many of these results to be important cornerstones as the field continues to build our understanding of life.

Biological Physics
Non-equilibrium thermodynamics and the free energy principle in biology

Matteo Colombo,Patricia Palacios

DOI: https://doi.org/10.1007/s10539-021-09818-x

2021-08-23

Abstract:Abstract According to the free energy principle, life is an “inevitable and emergent property of any (ergodic) random dynamical system at non-equilibrium steady state that possesses a Markov blanket” (Friston in J R Soc Interface 10(86):20130475, 2013). Formulating a principle for the life sciences in terms of concepts from statistical physics, such as random dynamical system , non-equilibrium steady state and ergodicity , places substantial constraints on the theoretical and empirical study of biological systems. Thus far, however, the physics foundations of the free energy principle have received hardly any attention. Here, we start to fill this gap and analyse some of the challenges raised by applications of statistical physics for modelling biological targets. Based on our analysis, we conclude that model-building grounded in the free energy principle exacerbates a trade-off between generality and realism, because of a fundamental mismatch between its physics assumptions and the properties of actual biological targets.

biology
The Dynamical Resource Theory of Informational Non-Equilibrium

Benjamin Stratton,Chung-Yun Hsieh,Paul Skrzypczyk

DOI: https://doi.org/10.1103/PhysRevLett.132.110202

2024-02-01

Abstract:Information is instrumental in our understanding of thermodynamics. Their interplay has been studied through completely degenerate Hamiltonians whereby the informational contributions to thermodynamic transformations can be isolated. In this setting, all states other then the maximally mixed state are considered to be in informational non-equilibrium. An important yet still open question is: how to characterise the ability of quantum dynamics to maintain informational non-equilibrium? Here, the dynamical resource theory of informational non-equilibrium preservability is introduced to begin providing an answer to this question. A characterisation of the allowed operations is given for qubit channels and the n dimensional Weyl-covariant channels - a physically relevant subset of the general channels. An operational interpretation of a state discrimination game with Bell state measurements is given. Finally, an explicit link between a channels classical capacity and its ability to maintain informational non-equilibrium is made.

Quantum Physics
Extended local ergotropy

Riccardo Castellano,Donato Farina,Vittorio Giovannetti,Antonio Acin

DOI: https://doi.org/10.1103/PhysRevLett.133.150402

2024-10-21

Abstract:A fundamental problem in quantum thermodynamics is to properly quantify the work extractable from out-of-equilibrium systems. While for closed systems, maximum quantum work extraction is defined in terms of the ergotropy functional, this question is unclear in open systems interacting with an environment. The concept of local ergotropy has been proposed, but it presents several problems, such as it is not guaranteed to be non-increasing in time. Here we introduce the concept of extended local ergotropy by exploiting the free evolution of the system-environment compound. At variance with the local ergotropy, the extended local ergotropy is greater, is non-increasing in time, and activates the potential of work extraction in many cases. We then concentrate on specific schemes in which we alternate repeated local unitaries and free system-environment evolution. We provide examples based on the Jaynes-Cummings model, presenting practical protocols and analytic results that serve as proof of principle for the aforementioned advantages.

Quantum Physics,Statistical Mechanics
Entropy balance and Information processing in bipartite and non-bipartite composite systems

Richard E. Spinney,Joseph T. Lizier,Mikhail Prokopenko

DOI: https://doi.org/10.48550/arXiv.1712.09715

2017-12-28

Statistical Mechanics

Abstract:Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper we make a formal analogy between information dynamics and stochastic thermodynamics which describes the thermal behaviour of small irreversible systems. As stochastic dynamics is increasingly being utilized to quantify the thermodynamics associated with the processing of information we suggest such an analogy is instructive, highlighting that existing thermodynamic quantities can be described solely in terms of extant information theoretic measures related to information processing. In this contribution we construct irreversibility measures in terms of these quantities and relate them to the physical entropy productions that characterise the behaviour of single and composite systems in stochastic thermodynamics illustrating them with simple examples. Moreover, we can apply such a formalism to systems which do not have a bipartite structure. In particular we demonstrate that, given suitable non-bipartite processes, the heat flow in a subsystem can still be identified and one requires the present formalism to recover generalizations of the second law. In these systems residual irreversibility is associated with neither subsystem and this must be included in the these generalised second laws. This opens up the possibility of describing all physical systems in terms of computation allowing us to propose a framework for discussing the reversibility of systems traditionally out of scope of stochastic thermodynamics.
Work and heat fluctuations in two-state systems: a trajectory thermodynamics formalism

F. Ritort

DOI: https://doi.org/10.1088/1742-5468/2004/10/P10016

2004-05-31

Abstract:Two-state models provide phenomenological descriptions of many different systems, ranging from physics to chemistry and biology. We investigate work fluctuations in an ensemble of two-state systems driven out of equilibrium under the action of an external perturbation. We calculate the probability density P(W) that a work equal to W is exerted upon the system along a given non-equilibrium trajectory and introduce a trajectory thermodynamics formalism to quantify work fluctuations in the large-size limit. We then define a trajectory entropy S(W) that counts the number of non-equilibrium trajectories P(W)=exp(S(W)/kT) with work equal to W. A trajectory free-energy F(W) can also be defined, which has a minimum at a value of the work that has to be efficiently sampled to quantitatively test the Jarzynski equality. Within this formalism a Lagrange multiplier is also introduced, the inverse of which plays the role of a trajectory temperature. Our solution for P(W) exactly satisfies the fluctuation theorem by Crooks and allows us to investigate heat-fluctuations for a protocol that is invariant under time reversal. The heat distribution is then characterized by a Gaussian component (describing small and frequent heat exchange events) and exponential tails (describing the statistics of large deviations and rare events). For the latter, the width of the exponential tails is related to the aforementioned trajectory temperature. Finite-size effects to the large-N theory and the recovery of work distributions for finite N are also discussed. Finally, we pay particular attention to the case of magnetic nanoparticle systems under the action of a magnetic field H where work and heat fluctuations are predicted to be observable in ramping experiments in micro-SQUIDs.

Statistical Mechanics,Materials Science
Uncovering nonequilibrium from unresolved events

Pedro E. Harunari

2024-07-22

Abstract:Closely related to the laws of thermodynamics, the detection and quantification of disequilibria are crucial in unraveling the complexities of nature, particularly those beneath observable layers. Theoretical developments in nonequilibrium thermodynamics employ coarse-graining methods to consider a diversity of partial information scenarios that mimic experimental limitations, allowing the inference of properties such as the entropy production rate. A ubiquitous but rather unexplored scenario involves observing events that can possibly arise from many transitions in the underlying Markov process--which we dub $\textit{multifilar events}$--as in the cases of exchanges measured at particle reservoirs, hidden Markov models, mixed chemical and mechanical transformations in biological function, composite systems, and more. We relax one of the main assumptions in a previously developed framework, based on first-passage problems, to assess the non-Markovian statistics of mutifilar events. By using the asymmetry of event distributions and their waiting-times, we put forward model-free tools to detect nonequilibrium behavior and estimate entropy production, while discussing their suitability for different classes of systems and regimes where they provide no new information, evidence of nonequilibrium, a lower bound for entropy production, or even its exact value. The results are illustrated in reference models through analytics and numerics.

Statistical Mechanics
The work value of information

Oscar C. O. Dahlsten,Renato Renner,Elisabeth Rieper,Vlatko Vedral

DOI: https://doi.org/10.1088/1367-2630/13/5/053015

2009-08-04

Abstract:We present quantitative relations between work and information that are valid both for finite sized and internally correlated systems as well in the thermodynamical limit. We suggest work extraction should be viewed as a game where the amount of work an agent can extract depends on how well it can guess the micro-state of the system. In general it depends both on the agent's knowledge and risk-tolerance, because the agent can bet on facts that are not certain and thereby risk failure of the work extraction. We derive strikingly simple expressions for the extractable work in the extreme cases of effectively zero- and arbitrary risk tolerance respectively, thereby enveloping all cases. Our derivation makes a connection between heat engines and the smooth entropy approach. The latter has recently extended Shannon theory to encompass finite sized and internally correlated bit strings, and our analysis points the way to an analogous extension of statistical mechanics.

Quantum Physics
Stochastic energetics and thermodynamics at small scales

Sourabh Lahiri,Arun M Jayannavar

DOI: https://doi.org/10.48550/arXiv.1906.00159

2019-06-24

Abstract:At very small scales, thermodynamic energy exchanges like work and heat become comparable to thermal energy of the system, which leads to unusual phenomena like the transient violations of Second Law. We explore the generic characters of such systems using the framework of Stochastic Thermodynamics and provide a preliminary overview of the basic concepts. Here we have attempted to put into simple terms some actively pursued topics like the arrow of time, effect of information gain on Second Law, explanation of origin of life using Crooks theorem and the thermodynamic uncertainty relations.

Statistical Mechanics
Shortcuts to Isothermality and Nonequilibrium Work Relations

Geng Li,H. T. Quan,Z. C. Tu

DOI: https://doi.org/10.1103/physreve.96.012144

IF: 2.707

2017-01-01

Physical Review E

Abstract:In conventional thermodynamics, it is widely acknowledged that the realization of an isothermal process for a system requires a quasistatic controlling protocol. Here we propose and design a strategy to realize a finite-rate isothermal transition from an equilibrium state to another one at the same temperature, which is named the "shortcut to isothermality." By using shortcuts to isothermality, we derive three nonequilibrium work relations, including an identity between the free-energy difference and the mean work due to the potential of the original system, a Jarzynski-like equality, and the inverse relationship between the dissipated work and the total driving time. We numerically test these three relations by considering the motion of a Brownian particle trapped in a harmonic potential and dragged by a time-dependent force.
Nonequilibrium Thermodynamics of Non-Ideal Reaction-Diffusion Systems: Implications for Active Self-Organization

Francesco Avanzini,Timur Aslyamov,Étienne Fodor,Massimiliano Esposito

2024-10-15

Abstract:We develop a framework describing the dynamics and thermodynamics of open non-ideal reaction-diffusion systems, which embodies Flory-Huggins theories of mixtures and chemical reaction network theories. Our theory elucidates the mechanisms underpinning the emergence of self-organized dissipative structures in these systems. It evaluates the dissipation needed to sustain and control them, discriminating the contributions from each reaction and diffusion process with spatial resolution. It also reveals the role of the reaction network in powering and shaping these structures. We identify particular classes of networks in which diffusion processes always equilibrate within the structures, while dissipation occurs solely due to chemical reactions. The spatial configurations resulting from these processes can be derived by minimizing a kinetic potential, contrasting with the minimization of the thermodynamic free energy in passive systems. This framework opens the way to investigating the energetic cost of phenomena such as liquid-liquid phase separation, coacervation, and the formation of biomolecular condensates.

Molecular Networks,Statistical Mechanics
Thermodynamics of Information

Juan M. R. Parrondo

2023-06-21

Abstract:As early as 1867, two years after the introduction of the concept of entropy by Clausius, Maxwell showed that the limitations imposed by the second law of thermodynamics depend on the information that one possesses about the state of a physical system. A "very observant and neat-fingered being", later on named Maxwell demon by Kelvin, could arrange the molecules of a gas and induce a temperature or pressure gradient without performing work, in apparent contradiction to the second law. One century later, Landauer claimed that "information is physical", and showed that certain processes involving information, like overwriting a memory, need work to be completed and are unavoidably accompanied by heat dissipation. Thermodynamics of information analyzes this bidirectional influence between thermodynamics and information processing. The seminal ideas that Landauer and Bennett devised in the 1970s have been recently reformulated in a more precise and general way by realizing that informational states are out of equilibrium and applying new tools from non-equilibrium statistical mechanics.

Statistical Mechanics,History and Philosophy of Physics

Nonequilibrium work relations for energy and information

Nonequilibrium fluctuations in small systems: From physics to biology

Nonequilibrium thermodynamics and information theory: Basic concepts and relaxing dynamics

Free energy inference from partial work measurements in small systems

The unreasonable effectiveness of equilibrium-like theory for interpreting non-equilibrium experiments

Unifying Theories for Nonequilibrium Statistical Mechanics

Nonequilibrium thermodynamics of quantum coherence beyond linear response

Energy and information flows in autonomous systems

Stochastic thermodynamics, fluctuation theorems and molecular machines

Nonequilibrium Physics in Biology

Non-equilibrium thermodynamics and the free energy principle in biology

The Dynamical Resource Theory of Informational Non-Equilibrium

Extended local ergotropy

Entropy balance and Information processing in bipartite and non-bipartite composite systems

Work and heat fluctuations in two-state systems: a trajectory thermodynamics formalism

Uncovering nonequilibrium from unresolved events

The work value of information

Stochastic energetics and thermodynamics at small scales

Shortcuts to Isothermality and Nonequilibrium Work Relations

Nonequilibrium Thermodynamics of Non-Ideal Reaction-Diffusion Systems: Implications for Active Self-Organization

Thermodynamics of Information