Abstract:Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper we make a formal analogy between information dynamics and stochastic thermodynamics which describes the thermal behaviour of small irreversible systems. As stochastic dynamics is increasingly being utilized to quantify the thermodynamics associated with the processing of information we suggest such an analogy is instructive, highlighting that existing thermodynamic quantities can be described solely in terms of extant information theoretic measures related to information processing. In this contribution we construct irreversibility measures in terms of these quantities and relate them to the physical entropy productions that characterise the behaviour of single and composite systems in stochastic thermodynamics illustrating them with simple examples. Moreover, we can apply such a formalism to systems which do not have a bipartite structure. In particular we demonstrate that, given suitable non-bipartite processes, the heat flow in a subsystem can still be identified and one requires the present formalism to recover generalizations of the second law. In these systems residual irreversibility is associated with neither subsystem and this must be included in the these generalised second laws. This opens up the possibility of describing all physical systems in terms of computation allowing us to propose a framework for discussing the reversibility of systems traditionally out of scope of stochastic thermodynamics.

Information Entropy in Chemistry: An Overview

Chemical information theory: Structural aspects

From Local Atomic Environments to Molecular Information Entropy

Information Entropy of Catalytic Reaction

Information Entropy As a Basic Building Block of Complexity Theory.

Hess' law requires modified mathematical rules for information entropy of interdependent chemical reactions

Foundations of Quantum Information for Physical Chemistry

Information entropy in excited states in confined quantum systems

Gibbs Paradox and the Concepts of Information, Symmetry, Similarity and Their Relationship

Can the electron density be interpreted information-theoretically? A critical analysis using quantum information theory

Information theory in molecular biology

Entropy balance and Information processing in bipartite and non-bipartite composite systems

Entropic Dynamics: Quantum Mechanics from Entropy and Information Geometry

On Thermodynamic Information

The Computational Theory of Intelligence: Information Entropy

Chemical Information Theory--One of the Important Topics in the 21st Century Chemistry

Understanding Shannon's Entropy metric for Information

Information Entropy Algorithms for Image, Video, and Signal Processing

Generalized information entropy and generalized information dimension