Abstract:According to the free energy principle biological agents resist a tendency to disorder in their interactions with a dynamically changing environment by keeping themselves in sensory and physiological states that are expected given their embodiment and the niche they inhabit (Friston in Nat Rev Neurosci 11(2):127–138, <a href="#CR14">2010</a>. doi:). Why would a biological agent that aims at minimising uncertainty in its encounters with the world ever be motivated to seek out novelty? Novelty for such an agent would arrive in the form of sensory and physiological states that are unexpected. Such an agent ought therefore to avoid novel and surprising interactions with the world one might think. Yet humans and many other animals find play and other forms of novelty-seeking and exploration hugely rewarding. How can this be understood in frameworks for studying the mind that emphasise prediction error minimisation? This problem has been taken up in recent research concerned with epistemic action—actions an agent engages in to reduce uncertainty. However that work leaves two questions unanswered, which it is the aim of our paper to address. First, no account has been given yet of why it should feel good to the agent to engage the world playfully and with curiosity. Second an appeal is made to precision-estimation to explain epistemic action, yet it remains unclear how precision-weighting works in action more generally, or active inference. We argue that an answer to both questions may lie in the bodily states of an agent that track the rate at which free energy is being reduced. The recent literature on the predictive brain has connected the valence of emotional experiences to the rate of change in the reduction of prediction error (Joffily and Coricelli in PLoS Comput Biol 9(6):e1003094, <a href="#CR24">2013</a>. doi: <a href="https://doi.org/10.1371/journal.pcbi.1003094">10.1371/journal.pcbi.1003094</a>; Van de Cruys, in Metzinger and Wiese (eds) Philosophy and predictive processing, vol 24, MIND Group, Frankfurt am Main, <a href="#CR59">2017</a>. doi: <a href="https://doi.org/10.15502/9783958573253">10.15502/9783958573253</a>). In this literature valenced emotional experiences are hypothesised to be identical with changes in the rate at which prediction error is reduced. Experiences are negatively valenced when overall prediction error increases and are positively valenced when the sum of prediction errors decrease. We offer an ecological-enactive interpretation of the concept of valence and its connection to rate of change of prediction error. We show how rate of change should be understood in terms of embodied states of affordance-related action readiness. We then go on to apply this ecological-enactive account of error dynamics to provide an answer to the first question we have raised: It may explain why it should feel good to an agent to be curious and playful. Our ecological-enactive account also allows us to show how error dynamics may provide an answer to the second question we have raised regarding how precision-weighting works in active inference. An agent that is sensitive to rates of error reduction can tune precision on the fly. We show how this ability to tune precision on the go can allow agents to develop skills for adapting better and better to the unexpected, and search out opportunities for resolving uncertainty and progressing in its learning.

Psychotic Markov Blankets: Striking a Free Energy Balance for Complex Adaptation

Evolution of adaptation mechanisms: Adaptation energy, stress, and oscillating death

Multiple Pareto-optimal solutions of the dissipation-adaptation trade-off

Neurophysiological avenues to better conceptualizing adaptive cognition

Dynamic metabolic resource allocation based on the maximum entropy principle

The adaptability of physiological systems optimizes performance: new directions in augmentation

Optimal phenotypic plasticity in a stochastic environment minimizes the cost/benefit ratio

Nonequilibrium Enhances Adaptation Efficiency of Stochastic Biochemical Systems

The free-energy principle: a unified brain theory?

Markov Blankets in the Brain

Transitions in optimal adaptive strategies for populations in fluctuating environments

Multiscale Entropy of Cardiac and Postural Control Reflects a Flexible Adaptation to a Cognitive Task

Optimal dormancy strategies in fluctuating environments given delays in phenotypic switching

Metastability demystified — the foundational past, the pragmatic present and the promising future

Dynamic and Thermodynamic Models of Adaptation

Emergent Simplicities in Stochastic Intergenerational Homeostasis

Maladaptation and the paradox of robustness in evolution

Balanced activation in a simple embodied neural simulation

Catastrophe by Design in Population Games: Destabilizing Wasteful Locked-in Technologies

Probabilistic measures for biological adaptation and resilience

From a false sense of safety to resilience under uncertainty