Abstract:Associative learning is a behavioral phenomenon in which individuals develop connections between stimuli or events based on their co-occurrence. Initially studied by Pavlov in his conditioning experiments, the fundamental principles of learning have been expanded on through the discovery of a wide range of learning phenomena. Computational models have been developed based on the concept of minimizing reward prediction errors. The Rescorla-Wagner model, in particular, is a well-known model that has greatly influenced the field of reinforcement learning. However, the simplicity of these models restricts their ability to fully explain the diverse range of behavioral phenomena associated with learning. In this study, we adopt the free energy principle, which suggests that living systems strive to minimize surprise or uncertainty under their internal models of the world. We consider the learning process as the minimization of free energy and investigate its relationship with the Rescorla-Wagner model, focusing on the informational aspects of learning, different types of surprise, and prediction errors based on beliefs and values. Furthermore, we explore how well-known behavioral phenomena such as blocking, overshadowing, and latent inhibition can be modeled within the active inference framework. We accomplish this by using the informational and novelty aspects of attention, which share similar ideas proposed by seemingly contradictory models such as Mackintosh and Pearce-Hall models. Thus, we demonstrate that the free energy principle, as a theoretical framework derived from first principles, can integrate the ideas and models of associative learning proposed based on empirical experiments and serve as a framework for a better understanding of the computational processes behind associative learning in the brain.

Abstract representations of events arise from mental errors in learning and memory

Humans rationally balance detailed and temporally abstract world models

Abstract representations emerge in human hippocampal neurons during inference

The brain as a probabilistic transducer: an evolutionarily plausible network architecture for knowledge representation, computation, and behavior

World model learning and inference

Neural representation of abstract task structure during generalization

An abstract relational map emerges in the human medial prefrontal cortex with consolidation

Neural and phenotypic representation under the free-energy principle

Consciousness as a logically consistent and prognostic model of reality

A neural mechanism for compositional generalization of structure in humans

Associative Learning and Active Inference

Dynamic emergence of relational structure network in human brains

Abstract choice representations during stable choice-response associations

Grounding Mental Representations in a Virtual Multi-Level Functional Framework

Relational Constraints On Neural Networks Reproduce Human Biases towards Abstract Geometric Regularity

Disentangling Abstraction from Statistical Pattern Matching in Human and Machine Learning

On the hazards of relating representations and inductive biases

A Formal Approach to Modeling the Memory of a Living Organism

When Abstract Becomes Concrete: Naturalistic Encoding of Concepts in the Brain

Learning abstract visual concepts via probabilistic program induction in a Language of Thought

Species-conserved mechanisms of abstract rule learning promote cognitive flexibility in complex environments