Abstract:The relationship between time irreversibility in neuronal dynamics and cognitive effort is a subject of growing interest in the scientific literature. Although correlations between proxies of both concepts have been experimentally observed, the underlying precise linkage between them remains elusive. Here we investigate the case of learning in decision-making tasks; we do so by introducing a thermodynamically grounded metric-inspired by Landauer's principle-which connects time-irreversible information processing to energy consumption. Equipped with this metric, we investigate the role of macroscopic time-reversal symmetry breaking in belief dynamics for the case of an agent with finite sensitivity while performing a static two-armed bandit task-a standard setup in cognitive neuroscience. To gain insights into the belief dynamics, we analogize it to the dynamics of an active particle subject to state-dependent noise and living in a two-dimensional space. This mapping allows an analytical description of learning-induced biases. We deeply explore the case of Q-learning with forgetting the nonchosen option. In this case, learning-induced risk aversion is formally equivalent to standard thermophoresis, i.e., the net motion towards low-temperature regions. Finally, we quantify the irreversibility of belief dynamics in the steady state for different bandit configurations, sensitivity levels, and exploitative behavior. We found a strong correlation in high-sensitivity learning between heightened irreversibility in belief dynamics and improved decision-making outcomes. Notably, as the task's difficulty increases, a greater degree of irreversibility in belief dynamics becomes necessary for having superior performances; this explicitly unravels a plausible connection between time irreversibility and cognitive effort. In conclusion, our investigation reveals that irreversibility in belief dynamics bridges out-of-equilibrium statistical physics concepts and cognitive neuroscience. In decision-making contexts, this perspective offers insights into the notion of cognitive effort, suggesting a potential mechanism driving the evolution of living systems toward out-of-equilibrium structures.

Functional Decomposition and Estimation of Irreversibility in Time Series via Machine Learning

Irreversibility of financial time series: A graph-theoretical approach

An Improvement of the Measurement of Time Series Irreversibility with Visibility Graph Approach

Information decomposition reveals hidden high-order contributions to temporal irreversibility

Multiscale Analysis of Time Irreversibility Based on Phase-Space Reconstruction and Horizontal Visibility Graph Approach

Direct estimates of irreversibility from time series

Multiscale Time Irreversibility Analysis of Financial Time Series Based on Segmentation

Evaluating Time Irreversibility Tests Using Geometric Brownian Motions with Stochastic Resetting

The novel multi-scale local irreversibility analysis method based on segmentation about time series

A New Measurement of Financial Time Irreversibility Based on Information Measures Method

The Detection of Local Irreversibility in Time Series Based on Segmentation

Time Irreversibility of Financial Time Series Based on Higher Moments and Multiscale Kullback–Leibler Divergence

Directed Vector Visibility Graph from Multivariate Time Series: a New Method to Measure Time Series Irreversibility

Measuring irreversibility from learned representations of biological patterns

Time irreversibility analysis and abnormality detection based on Riemannian geometry for complex time series

Relative Asynchronous Index: a New Measure for Time Series Irreversibility

Classifying of financial time series based on multiscale entropy and multiscale time irreversibility

New Irreversibility Measure and Complexity Analysis Based on Singular Value Decomposition

Trend patterns statistics for assessing irreversibility in cryptocurrencies: time-asymmetry versus inefficiency

Irreversibility in belief dynamics: Unraveling the link to cognitive effort

Dissipative timescales from coarse-graining irreversibility