Abstract:The relationship between time irreversibility in neuronal dynamics and cognitive effort is a subject of growing interest in the scientific literature. Although correlations between proxies of both concepts have been experimentally observed, the underlying precise linkage between them remains elusive. Here we investigate the case of learning in decision-making tasks; we do so by introducing a thermodynamically grounded metric-inspired by Landauer's principle-which connects time-irreversible information processing to energy consumption. Equipped with this metric, we investigate the role of macroscopic time-reversal symmetry breaking in belief dynamics for the case of an agent with finite sensitivity while performing a static two-armed bandit task-a standard setup in cognitive neuroscience. To gain insights into the belief dynamics, we analogize it to the dynamics of an active particle subject to state-dependent noise and living in a two-dimensional space. This mapping allows an analytical description of learning-induced biases. We deeply explore the case of Q-learning with forgetting the nonchosen option. In this case, learning-induced risk aversion is formally equivalent to standard thermophoresis, i.e., the net motion towards low-temperature regions. Finally, we quantify the irreversibility of belief dynamics in the steady state for different bandit configurations, sensitivity levels, and exploitative behavior. We found a strong correlation in high-sensitivity learning between heightened irreversibility in belief dynamics and improved decision-making outcomes. Notably, as the task's difficulty increases, a greater degree of irreversibility in belief dynamics becomes necessary for having superior performances; this explicitly unravels a plausible connection between time irreversibility and cognitive effort. In conclusion, our investigation reveals that irreversibility in belief dynamics bridges out-of-equilibrium statistical physics concepts and cognitive neuroscience. In decision-making contexts, this perspective offers insights into the notion of cognitive effort, suggesting a potential mechanism driving the evolution of living systems toward out-of-equilibrium structures.

Sorting ECGs by lag irreversibility

Assessment of time irreversibility in a time series using visibility graphs

Time irreversibility and its application in epileptic brain electrical activities

Permutation-based time irreversibility in epileptic electroencephalograms

High-dimensional time irreversibility analysis of human interbeat intervals

Functional Decomposition and Estimation of Irreversibility in Time Series via Machine Learning

IR-ECG: Invertible Reconstruction of ECG

Information decomposition reveals hidden high-order contributions to temporal irreversibility

Evaluating Time Irreversibility Tests Using Geometric Brownian Motions with Stochastic Resetting

Multilevel irreversibility reveals higher-order organisation of non-equilibrium interactions in human brain dynamics

Measuring irreversibility from learned representations of biological patterns

Analysis of heartbeat asymmetry based on multi-scale time irreversibility test

Reversal No Longer Matters: Attention-Based Arrhythmia Detection with Lead-Reversal ECG Data

Multi-Scale Strategy and Data Surrogating Test: Two Elements for the Detection of Time Irreversibility in Heart Rate Variability

Comparative analysis of time irreversibility and amplitude irreversibility based on joint permutation

Time reversibility from visibility graphs of non-stationary processes

Time irreversibility of resting brain activity in the healthy brain and pathology

Equal heartbeat intervals and their effects on the nonlinearity of permutation-based time irreversibility in heart rate

Irreversibility in belief dynamics: Unraveling the link to cognitive effort

Non-Invasive Locating of Premature Ventricular Contraction Origin with Low Rank/Tv Regularization

Irreversibility of financial time series: A graph-theoretical approach