Abstract:Within computational neuroscience, the algorithmic and neural basis of structure learning remains poorly understood. Concept learning is one primary example, which requires both a type of internal model expansion process (adding novel hidden states that explain new observations), and a model reduction process (merging different states into one underlying cause and thus reducing model complexity via meta-learning). Although various algorithmic models of concept learning have been proposed within machine learning and cognitive science, many are limited to various degrees by an inability to generalize, the need for very large amounts of training data, and/or insufficiently established biological plausibility. Using concept learning as an example case, we introduce a novel approach for modeling structure learning—and specifically state-space expansion and reduction—within the active inference framework and its accompanying neural process theory. Our aim is to demonstrate its potential to facilitate a novel line of active inference research in this area. The approach we lay out is based on the idea that a generative model can be equipped with extra (hidden state or cause) "slots" that can be engaged when an agent learns about novel concepts. This can be combined with a Bayesian model reduction process, in which any concept learning—associated with these slots—can be reset in favor of a simpler model with higher model evidence. We use simulations to illustrate this model's ability to add new concepts to its state space (with relatively few observations) and increase the granularity of the concepts it currently possesses. We also simulate the predicted neural basis of these processes. We further show that it can accomplish a simple form of "one-shot" generalization to new stimuli. Although deliberately simple, these simulation results highlight ways in which active inference could offer useful resources in developing neurocomputational models of structure learning. They provide a template for how future active inference research could apply this approach to real-world structure learning problems and assess the added utility it may offer.

How a Minimal Learning Agent can Infer the Existence of Unobserved Variables in a Complex Environment

Minimal Cognitive Model for Deliberate Agents

From Concrete to Abstract: A Multimodal Generative Approach to Abstract Concept Learning

Learning $\textit{Ex Nihilo}$

An Active Inference Approach to Modeling Structure Learning: Concept Learning as an Example Case

A Minimal Active Inference Agent

Autonomous Discovery of Abstract Concepts by a Robot

Learning abstract visual concepts via probabilistic program induction in a Language of Thought

On the Learnability of Physical Concepts: Can a Neural Network Understand What's Real?

On the Minimal Theory of Consciousness Implicit in Active Inference

Learning by thinking in natural and artificial minds

The learnability of abstract syntactic principles

Minimally Naturalistic Artificial Intelligence

VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought

Cognitive Architectures for Language Agents

Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization

Humanoid infers Archimedes' principle: understanding physical relations and object affordances through cumulative learning experiences

Towards Understanding How Machines Can Learn Causal Overhypotheses

Embodied concept formation and reasoning via neural-symbolic integration

Active Causal Structure Learning with Latent Variables: Towards Learning to Detour in Autonomous Robots

Understanding Early Word Learning in Situated Artificial Agents