[Has troponin I its role in the early screening of myocardial necrosis?].

V. Callec,M. Barrière,D. Coisne,Y. Vali,P. Raud-Raynier,D. Reiss

1996-02-17

Presse Medicale

Abstract:

What problem does this paper attempt to address?

Entropy production in communication channels

Farita Tasnim,Nahuel Freitas,David H. Wolpert

2024-02-09

Abstract:In many complex systems, whether biological or artificial, the thermodynamic costs of communication among their components are large. These systems also tend to split information transmitted between any two components across multiple channels. A common hypothesis is that such inverse multiplexing strategies reduce total thermodynamic costs. So far, however, there have been no physics-based results supporting this hypothesis. This gap existed partially because we have lacked a theoretical framework that addresses the interplay of thermodynamics and information in off-equilibrium systems. Here we present the first study that rigorously combines such a framework, stochastic thermodynamics, with Shannon information theory. We develop a minimal model that captures the fundamental features common to a wide variety of communication systems, and study the relationship between the entropy production of the communication process and the channel capacity, the canonical measure of the communication capability of a channel. In contrast to what is assumed in previous works not based on first principles, we show that the entropy production is not always a convex and monotonically increasing function of the channel capacity. However, those two properties are recovered for sufficiently high channel capacity. These results clarify when and how to split a single communication stream across multiple channels.

Statistical Mechanics,Information Theory
Entropy Production-Based Energy Efficiency Optimization for Wireless Communication Systems

Litao Yan,Xiao Ge

DOI: https://doi.org/10.1109/OJCOMS.2024.3476454

IEEE Open Journal of the Communications Society

Abstract:The relationship between energy dissipation and information has been extensively studied in the emerging field of stochastic thermodynamics, where entropy production plays a core role in measuring the energy loss of irreversible processes. To analyze and optimize the energy efficiency of wireless communication systems from a fundamental and unified perspective, an entropy production model of a binary wireless communication systems is proposed in this paper for the first time. The proposed model serves as a minimal yet comprehensive model incorporating two key nonequilibrium processes in a wireless communication system: wireless information transmission and information processing. The entropy production of wireless information transmission is derived using tools from stochastic thermodynamics, and it is found that there is a specified transmission rate that minimizes the entropy production. For the information processing, the influence of error rate and parallel number of information processing on entropy production is analyzed, and a serial or parallel processing selection criterion is proposed to minimizes the entropy production. To minimize the total entropy production of wireless communication systems, we propose an optimal channel number algorithm and an optimal time allocation scheme. Simulation results show that the entropy production of the wireless communication system using the optimal time allocation scheme can be reduced by up to 20.2% compared to the traditional approach where the time allocated for wireless information transmission and information processing is equal. The proposed model and optimization method provide a novel perspective on analyzing and enhancing energy efficiency in wireless communication systems.

Engineering,Computer Science,Physics
Minimal thermodynamic cost of communication

Abhishek Yadav,David Wolpert

2024-10-19

Abstract:Thermodynamic cost of communication is a major factor in the thermodynamic cost of real world computers, both biological and digital. However, little is known about the fundamental features of this cost. Addressing this hole in the literature, our first major contribution is a strictly positive lower bound on on the unavoidable entropy production (EP) in any physical system that implements a communication channel. Specifically, we derive a relationship between the rate of information transmission across a channel and the minimal thermodynamic cost incurred by any physical systems that implements that transmission. We use this relationship to show that under certain conditions, transmitting information through multiple, high-noise channels (reverse multiplexing) can be thermodynamically more efficient than using a single, low noise channel. We then address the thermodynamic costs inherent in the computational front-ends and back ends to communication channels, which are used to implement error correcting codes over those channels an essential component of modern communication systems. Our second major contribution is a strictly positive lower bound on the minimal EP of any physical system that implements those encoding and decoding algorithms. We use this bound to make a detailed comparison of the minimal thermodynamic costs across various linear codes and error rates. Because our results are like the second law, applying independently of the physical details of the system, they provide valuable insights into the trade offs between decoding error and thermodynamic efficiency. This gives a deeper understanding of the interplay between algorithmic design of error-correcting codes and physical constraints in communication systems.

Statistical Mechanics
Thermodynamics of Information

Juan M. R. Parrondo

2023-06-21

Abstract:As early as 1867, two years after the introduction of the concept of entropy by Clausius, Maxwell showed that the limitations imposed by the second law of thermodynamics depend on the information that one possesses about the state of a physical system. A "very observant and neat-fingered being", later on named Maxwell demon by Kelvin, could arrange the molecules of a gas and induce a temperature or pressure gradient without performing work, in apparent contradiction to the second law. One century later, Landauer claimed that "information is physical", and showed that certain processes involving information, like overwriting a memory, need work to be completed and are unavoidably accompanied by heat dissipation. Thermodynamics of information analyzes this bidirectional influence between thermodynamics and information processing. The seminal ideas that Landauer and Bennett devised in the 1970s have been recently reformulated in a more precise and general way by realizing that informational states are out of equilibrium and applying new tools from non-equilibrium statistical mechanics.

Statistical Mechanics,History and Philosophy of Physics
Thermodynamic efficiency of information and heat flow

Armen E Allahverdyan,Dominik Janzing,Guenter Mahler

DOI: https://doi.org/10.1088/1742-5468/2009/09/p09011

2009-09-21

Abstract:A basic task of information processing is information transfer (flow). Here we study a pair of Brownian particles each coupled to a thermal bath at temperatures T1 and T2. The information flow in such a system is defined via the time-shifted mutual information. The information flow nullifies at equilibrium, and its efficiency is defined as the ratio of the flow to the total entropy production in the system. For a stationary state the information flows from higher to lower temperatures, and its efficiency is bounded from above by (max[T1,T2])/(|T1−T2|). This upper bound is imposed by the second law and it quantifies the thermodynamic cost for information flow in the present class of systems. It can be reached in the adiabatic situation, where the particles have widely different characteristic times. The efficiency of heat flow—defined as the heat flow over the total amount of dissipated heat—is limited from above by the same factor. There is a complementarity between heat and information flow: the set-up which is most efficient for the former is the least efficient for the latter and vice versa. The above bound for the efficiency can be (transiently) overcome in certain non-stationary situations, but the efficiency is still limited from above. We study yet another measure of information processing (transfer entropy) proposed in the literature. Though this measure does not require any thermodynamic cost, the information flow and transfer entropy are shown to be intimately related for stationary states.

physics, mathematical,mechanics
Information Thermodynamics of Encoding and Encoders

Yang Tian,Pei Sun

DOI: https://doi.org/10.1063/5.0068115

2022-01-01

Abstract:Non-isolated systems have diverse coupling relations with the external environment. These relations generate complex thermodynamics and information transmission between the system and its environment. The framework depicted in the current research attempts to glance at the critical role of the internal orders inside the non-isolated system in shaping the information thermodynamics coupling. We characterize the coupling as a generalized encoding process, where the system acts as an information thermodynamics encoder to encode the external information based on thermodynamics. We formalize the encoding process in the context of the nonequilibrium second law of thermodynamics, revealing an intrinsic difference in information thermodynamics characteristics between information thermodynamics encoders with and without internal correlations. During the information encoding process of an external source Y, specific sub-systems in an encoder X with internal correlations can exceed the information thermodynamics bound on (X, Y) and encode more information than system X works as a whole. We computationally verify this theoretical finding in an Ising model with a random external field and a neural data set of the human brain during visual perception and recognition. Our analysis demonstrates that the stronger internal correlation inside these systems implies a higher possibility for specific sub-systems to encode more information than the global one. These findings may suggest a new perspective in studying information thermodynamics in diverse physical and biological systems. (C) 2022 Author(s).
Universal bounds on the performance of information-thermodynamic engine

Tomohiro Tanogami,Tan Van Vu,Keiji Saito

DOI: https://doi.org/10.1103/PhysRevResearch.5.043280

2023-10-17

Abstract:We investigate fundamental limits on the performance of information processing systems from the perspective of information thermodynamics. We first extend the thermodynamic uncertainty relation (TUR) to a subsystem. Specifically, for a bipartite composite system consisting of a system of interest X and an auxiliary system Y, we show that the relative fluctuation of an arbitrary current for X is lower bounded not only by the entropy production associated with X but also by the information flow between X and Y. As a direct consequence of this bipartite TUR, we prove universal trade-off relations between the output power and efficiency of an information-thermodynamic engine in the fast relaxation limit of the auxiliary system. In this limit, we further show that the Gallavotti-Cohen symmetry is satisfied even in the presence of information flow. This symmetry leads to universal relations between the fluctuations of information flow and entropy production in the linear response regime. We illustrate these results with simple examples: coupled quantum dots and coupled linear overdamped Langevin equations. Interestingly, in the latter case, the equality of the bipartite TUR is achieved even far from equilibrium, which is a very different property from the standard TUR. Our results will be applicable to a wide range of systems, including biological systems, and thus provide insight into the design principles of biological systems.

Statistical Mechanics
Interrelatedness of thermodynamics and information: transformation of heat as a measurable information process and quantity, an overview

B. Hejna,J. Šesták,Hejna, B.,Šesták, J.

DOI: https://doi.org/10.1007/s10973-023-12833-7

IF: 4.755

2024-03-05

Journal of Thermal Analysis and Calorimetry

Abstract:No one has yet investigated the information reach and influence of thermal analysis. Even so the heat and entropy are bound closely. The very problem of the term entropy is that it was defined specifically within the classical, equilibrium Thermodynamics like Clausius entropy, while its meaning is more general. It is usable in all areas of physics, in the communication theory and technology, and also, in social sciences, just as an universal quantitative model. The bridge to this wider world is in Boltzmann's statistical point of view used in the Shannon's information point of view. The difference is that the Shannon entropy is defined more generally, both for the uniform and for the not uniform probability distributions. But with renormalization and with the Boltzmann constant we can speak, using the Clausius entropy, about a certain thermodynamic system considered as a heat model of the area of our wider interests. So we will to deal with the heat and its entropy embodied to a wider consideration. In addition to the standard physical meaning, another thermodynamic realization in the form of a message is derived from Shannon's information theory, where the sample carries a measure of Shannon's information given by its structure or internal organization. This is also a contribution to improving the approach to thinking about the importance of observation and measurement, reflecting at the same time the costs and influence of the measurement itself and its organization on the measured object or, on its environment or, even on the environment of the measuring itself generally. Statistical sorting also carries with it the internal movement of individual elementary particles, the value of which indicates the resulting state of heat transfer and dissipation to and from the system providing a state of called equilibrium. It is statistically described by a weighted quantity called temperature, the changes of which via momentum alteration satisfy Newton's laws of inertia allowing enumeration of the related heat information processing. The terminology used is still non-institutional.

chemistry, physical, analytical,thermodynamics
Landauer principle and the second law in a relativistic communication scenario

Yuri J. Alvim,Lucas C. Céleri

DOI: https://doi.org/10.3390/e26070613

2024-07-22

Abstract:The problem of formulating thermodynamics in a relativistic scenario remains unresolved, although many proposals exist in the literature. The challenge arises due to the intrinsic dynamic structure of spacetime as established by the general theory of relativity. With the discovery of the physical nature of information, which underpins Landauer's principle, we believe that information theory should play a role in understanding this problem. In this work, we contribute to this endeavor by considering a relativistic communication task between two partners, Alice and Bob, in a general Lorentzian spacetime. We then assume that the receiver, Bob, reversibly operates a local heat engine powered by information, and seek to determine the maximum amount of work he can extract from this device. Since Bob cannot extract work for free, by applying both Landauer's principle and the second law of thermodynamics, we establish a bound on the energy Bob must spend to acquire the information in the first place. This bound is a function of the spacetime metric and the properties of the communication channel.

Quantum Physics
Power system information theory

Hongbin Sun,Boming Zhang,Lei Tang,Feng Gao

DOI: https://doi.org/10.1049/cp:20030624

2003-01-01

Abstract:Despite the successful application of information technology to power system, there is still a lack of some application of information theory to power system. In the paper, a new concept named power system information theory is proposed to answer how to apply information theory to power system systematically. Here, decision-making for power system is treated as an information reconstructing process firstly. Then a generalized information channel model for decision-making is built, the uncertainty of probability-type information of power system is quantified, and based on a new principle for the minimization of information loss (MIL), a decision-making method in power system is proposed. The new method is applied to online topology error identification. Based upon information theory, topology error identification can be modeled by a novel optimization problem, which is much different from the traditional rule based methods. This quantified result will benefit topology error identification. Case study has been done to show the validity and efficiency of the principle and method proposed in this paper.
Finite-time thermodynamic bounds and tradeoff relations for information processing

Takuya Kamijima,Ken Funo,Takahiro Sagawa

2024-09-13

Abstract:In thermal environments, information processing requires thermodynamic costs determined by the second law of thermodynamics. Information processing within finite time is particularly important, since fast information processing has practical significance but is inevitably accompanied by additional dissipation. In this paper, we reveal the fundamental thermodynamic costs and the tradeoff relations between incompatible information processing such as measurement and feedback in the finite-time regime. To this end, we generalize optimal transport theory so as to be applicable to subsystems such as the memory and the engine in Maxwell's demon setups. Specifically, we propose a general framework to derive the Pareto fronts of entropy productions and thermodynamic activities, and provide a geometrical perspective on their structure. In an illustrative example, we find that even in situations where naive optimization of total dissipation cannot realize the function of Maxwell's demon, reduction of the dissipation in the feedback system according to the tradeoff relation enables the realization of the demon. We also show that an optimal Maxwell's demon can be implemented by using double quantum dots. Our results would serve as a designing principle of efficient thermodynamic machines performing information processing, from single electron devices to biochemical signal transduction.

Statistical Mechanics
"Information-Friction" and its implications on minimum energy required for communication

Pulkit Grover

DOI: https://doi.org/10.1109/TIT.2014.2365777

2014-09-01

Abstract:Just as there are frictional losses associated with moving masses on a surface, what if there were frictional losses associated with moving information on a substrate? Indeed, many modes of communication suffer from such frictional losses. We propose to model these losses as proportional to "bit-meters," i.e., the product of mass of information (i.e., the number of bits) and the distance of information transport. We use this "information- friction" model to understand fundamental energy requirements on encoding and decoding in communication circuitry. First, for communication across a binary input AWGN channel, we arrive at fundamental limits on bit-meters (and thus energy consumption) for decoding implementations that have a predetermined input-independent length of messages. For encoding, we relax the fixed-length assumption and derive bounds for flexible-message- length implementations. Using these lower bounds we show that the total (transmit + encoding + decoding) energy-per-bit must diverge to infinity as the target error probability is lowered to zero. Further, the closer the communication rate is maintained to the channel capacity (as the target error-probability is lowered to zero), the faster the required decoding energy diverges to infinity.

Information Theory,Computational Complexity,Mathematical Physics
Revisiting thermodynamics in computation and information theory

Pritam Chattopadhyay,Goutam Paul

2024-08-27

Abstract:One of the primary motivations of the research in the field of computation is to optimize the cost of computation. The major ingredient that a computer needs is the energy to run a process, i.e., the thermodynamic cost. The analysis of the thermodynamic cost of computation is one of the prime focuses of research. It started back since the seminal work of Landauer where it was commented that the computer spends kB T ln2 amount of energy to erase a bit of information (here T is the temperature of the system and kB represents the Boltzmann's constant). The advancement of statistical mechanics has provided us the necessary tool to understand and analyze the thermodynamic cost for the complicated processes that exist in nature, even the computation of modern computers. The advancement of physics has helped us to understand the connection of the statistical mechanics (the thermodynamics cost) with computation. Another important factor that remains a matter of concern in the field of computer science is the error correction of the error that occurs while transmitting the information through a communication channel. Here in this article, we have reviewed the progress of the thermodynamics of computation starting from Landauer's principle to the latest model, which simulates the modern complex computation mechanism. After exploring the salient parts of computation in computer science theory and information theory, we have reviewed the thermodynamic cost of computation and error correction. We have also discussed about the alternative computation models that have been proposed with thermodynamically cost-efficient.

Quantum Physics,Statistical Mechanics
On Thermodynamic Information

Bing Miao,Hong Qian,Yong-Shi Wu

2023-12-06

Abstract:Information based thermodynamic logic is revisited. It consists of two parts: Part A applies the modern theory of probability in which an arbitrary convex function \phi is employed as an analytic "device" to express information as statistical dependency contained in the topological sub-\sigma-algebra structure. Via thermo-doubling, Fenchel-Young equality (FYE) that consists of \phi(x) and its conjugate \psi(y) establishes the notion of equilibrium between x and y through duality symmetry and the principle of maximum entropy/minimum free energy. Part B deals with a given set of repetitive measurements, where an inherent convex function emerges via the mathematics of large deviations. Logarithm-based Shannon entropy with \phi(x)=-\log x figures prominently for i.i.d. sample statistics. Information can be a measure of the agreement between a statistical observation and its theoretical models. Maximum likelihood principle arises here and FYE provides a thermodynamic energetic narrative of recurrent data.

Statistical Mechanics,Mathematical Physics
Thermodynamics of Information Processing Based on Enzyme Kinetics: an Exactly Solvable Model of Information Pump

Yuansheng Cao,Zongping Gong,H.T.Quan

DOI: https://doi.org/10.1103/PhysRevE.91.062117

2015-03-05

Abstract:Motivated by the recent proposed models of the information engine [D. Mandal and C. Jarzynski, Proc. Natl. Acad. Sci. 109, 11641 (2012)] and the information refrigerator [D. Mandal, H. T. Quan, and C. Jarzynski, Phys. Rev. Lett. 111, 030602 (2013)], we propose a minimal model of the information pump and the information eraser based on enzyme kinetics. This device can either pump molecules against the chemical potential gradient by consuming the information encoded in the bit stream or (partially) erase the information encoded in the bit stream by consuming the Gibbs free energy. The dynamics of this model is solved exactly, and the "phase diagram" of the operation regimes is determined. The efficiency and the power of the information machine is analyzed. The validity of the second law of thermodynamics within our model is clarified. Our model offers a simple paradigm for the investigating of the thermodynamics of information processing involving the chemical potential in small systems.

Statistical Mechanics
Thermodynamic Properties of Molecular Communication

Andrew W. Eckford,Benjamin Kuznets-Speck,Michael Hinczewski,Peter J. Thomas

DOI: https://doi.org/10.1109/isit.2018.8437793

2018-06-01

Abstract:In this paper, we consider the energy cost of communicating using molecular communication. In a simplified scenario, we show that the energy bound in Landauer's principle can be achieved, implying that molecular communication can approach fundamental thermodynamic limits.
Information-Theoretic Approach to Strategic Communication as a Hierarchical Game

Emrah Akyol,Cedric Langbort,Tamer Basar

DOI: https://doi.org/10.1109/JPROC.2016.2575858

2016-07-11

Abstract:This paper analyzes the information disclosure problems originated in economics through the lens of information theory. Such problems are radically different from the conventional communication paradigms in information theory since they involve different objectives for the encoder and the decoder, which are aware of this mismatch and act accordingly. This leads, in our setting, to a hierarchical communication game, where the transmitter announces an encoding strategy with full commitment, and its distortion measure depends on a private information sequence whose realization is available at the transmitter. The receiver decides on its decoding strategy that minimizes its own distortion based on the announced encoding map and the statistics. Three problem settings are considered, focusing on the quadratic distortion measures, and jointly Gaussian source and private information: compression, communication, and the simple equilibrium conditions without any compression or communication. The equilibrium strategies and associated costs are characterized. The analysis is then extended to the receiver side information setting and the major changes in the structure of optimal strategies are identified. Finally, an extension of the results to the broader context of decentralized stochastic control is presented.

Information Theory,Computer Science and Game Theory,Optimization and Control
Information Thermodynamics of Non-Hermitian Quantum Systems

Kui Cao,Qian Du,Su-Peng Kou

2024-08-08

Abstract:In this study, we uncover the intrinsic information processes in non-Hermitian quantum systems and their thermodynamic effects. We demonstrate that these systems can exhibit negative entropy production, making them potential candidates for information engines. We also identify a key informational quantity that can characterize phase transitions beyond the reach of traditional partition functions. This work enhances our understanding of the interplay between information and thermodynamics, providing a new perspective on non-Hermitian quantum systems.

Quantum Physics,Statistical Mechanics
The Dynamical Resource Theory of Informational Non-Equilibrium

Benjamin Stratton,Chung-Yun Hsieh,Paul Skrzypczyk

DOI: https://doi.org/10.1103/PhysRevLett.132.110202

2024-02-01

Abstract:Information is instrumental in our understanding of thermodynamics. Their interplay has been studied through completely degenerate Hamiltonians whereby the informational contributions to thermodynamic transformations can be isolated. In this setting, all states other then the maximally mixed state are considered to be in informational non-equilibrium. An important yet still open question is: how to characterise the ability of quantum dynamics to maintain informational non-equilibrium? Here, the dynamical resource theory of informational non-equilibrium preservability is introduced to begin providing an answer to this question. A characterisation of the allowed operations is given for qubit channels and the n dimensional Weyl-covariant channels - a physically relevant subset of the general channels. An operational interpretation of a state discrimination game with Bell state measurements is given. Finally, an explicit link between a channels classical capacity and its ability to maintain informational non-equilibrium is made.

Quantum Physics
Total cost of operating an information engine

Jaegon Um,Haye Hinrichsen,Chulan Kwon,Hyunggyu Park

DOI: https://doi.org/10.1088/1367-2630/17/8/085001

2015-01-16

Abstract:We study a two-level system controlled in a discrete feedback loop, modeling both the system and the controller in terms of stochastic Markov processes. We find that the extracted work, which is known to be bounded from above by the mutual information acquired during measurement, has to be compensated by an additional energy supply during the measurement process itself, which is bounded by the same mutual information from below. Our results confirm that the total cost of operating an information engine is in full agreement with the conventional second law of thermodynamics. We also consider the efficiency of the information engine as function of the cycle time and discuss the operating condition for maximal power generation. Moreover, we find that the entropy production of our information engine is maximal for maximal efficiency, in sharp contrast to conventional reversible heat engines.

Statistical Mechanics

[Has troponin I its role in the early screening of myocardial necrosis?].

Entropy production in communication channels

Entropy Production-Based Energy Efficiency Optimization for Wireless Communication Systems

Minimal thermodynamic cost of communication

Thermodynamics of Information

Thermodynamic efficiency of information and heat flow

Information Thermodynamics of Encoding and Encoders

Universal bounds on the performance of information-thermodynamic engine

Interrelatedness of thermodynamics and information: transformation of heat as a measurable information process and quantity, an overview

Landauer principle and the second law in a relativistic communication scenario

Power system information theory

Finite-time thermodynamic bounds and tradeoff relations for information processing

"Information-Friction" and its implications on minimum energy required for communication

Revisiting thermodynamics in computation and information theory

On Thermodynamic Information

Thermodynamics of Information Processing Based on Enzyme Kinetics: an Exactly Solvable Model of Information Pump

Thermodynamic Properties of Molecular Communication

Information-Theoretic Approach to Strategic Communication as a Hierarchical Game

Information Thermodynamics of Non-Hermitian Quantum Systems

The Dynamical Resource Theory of Informational Non-Equilibrium

Total cost of operating an information engine