Abstract:Information theoretic measures have helped to sharpen our understanding of many-body quantum states. As perhaps the most well-known example, the entanglement entropy (or more generally, the bipartite mutual information) has become a powerful tool for characterizing the dynamical growth of quantum correlations. By contrast, although computable, the bipartite mutual information (MI) is almost never explored in classical many particle systems; this owes in part to the fact that computing the MI requires keeping track of the evolution of the full probability distribution, a feat which is rarely done (or thought to be needed) in classical many-body simulations. Here, we utilize the MI to analyze the spreading of information in 1D elementary cellular automata (CA). Broadly speaking, we find that the behavior of the MI in these dynamical systems exhibits a few different types of scaling that roughly correspond to known CA universality classes. Of particular note is that we observe a set of automata for which the MI converges parametrically slowly to its thermodynamic value. We develop a microscopic understanding of this behavior by analyzing a two-species model of annihilating particles moving in opposite directions. Our work suggests the possibility that information theoretic tools such as the MI might enable a more fine-grained characterization of classical many-body states and dynamics.

Mutual Information Analysis for Digital Circuits}{mutual Information Analysis for Digital Circuits

Disturbance propagation analysis of complex chemical process based on directional mutual information

On Mutual Information, Mmse And H-Infinity Entropy In Stochastic Linear Feedback Systems

Directed Information and Mutual Information in Linear Feedback Tracking Systems

Mutual Information Rate and Analytic Constraint in Linear Time Invariant Control Systems

Information Theoretic Interpretation for H∞ Entropy in SISO Linear Control Systems

Mutual information analysis on non-stationary neuron importance for brain machine interfaces.

Mutual information fluctuations and non-stabilizerness in random circuits

On the Mutual Information of Vlc Systems Employing Color-Shift Keying

Selection of Coded Modulation Scheme Based on Mutual Information Analysis

Big Data Viewpoint on Channel Information Measures Based on ACE Algorithm.

On Finite-Time Mutual Information

Power system information theory

Universal Spreading of Conditional Mutual Information in Noisy Random Circuits

The Mutual Information In The Vicinity of Capacity-Achieving Input Distributions

Performance assessment of non-Gaussian MIMO system based on entropy and mutual information<sup>1</sup>

Analog-Digital Power System State Estimation Based on Information Theory - Part I: Theory.

Measuring the couplings of MIMO dynamic systems: An information-theoretic approach

Subsystem Information Capacity in Random Circuits and Hamiltonian Dynamics

Mutual Information, Information-Theoretic Thresholds and the Condensation Phenomenon at Positive Temperature

Bipartite mutual information in classical many-body dynamics