Abstract:This paper proposes how various disciplinary theories of cognition may be combined into a unifying, sub-symbolic, computational theory of cognition. The following theories are considered for integration: psychological theories, including the theory of event coding, event segmentation theory, the theory of anticipatory behavioral control, and concept development; artificial intelligence and machine learning theories, including reinforcement learning and generative artificial neural networks; and theories from theoretical and computational neuroscience, including predictive coding and free energy-based inference. In the light of such a potential unification, it is discussed how abstract cognitive, conceptualized knowledge and understanding may be learned from actively gathered sensorimotor experiences. The unification rests on the free energy-based inference principle, which essentially implies that the brain builds a predictive, generative model of its environment. Neural activity-oriented inference causes the continuous adaptation of the currently active predictive encodings. Neural structure-oriented inference causes the longer term adaptation of the developing generative model as a whole. Finally, active inference strives for maintaining internal homeostasis, causing goal-directed motor behavior. To learn abstract, hierarchical encodings, however, it is proposed that free energy-based inference needs to be enhanced with structural priors, which bias cognitive development toward the formation of particular, behaviorally suitable encoding structures. As a result, it is hypothesized how abstract concepts can develop from, and thus how they are structured by and grounded in, sensorimotor experiences. Moreover, it is sketched-out how symbol-like thought can be generated by a temporarily active set of predictive encodings, which constitute a distributed neural attractor in the form of an interactive free-energy minimum. The activated, interactive network attractor essentially characterizes the semantics of a concept or a concept composition, such as an actual or imagined situation in our environment. Temporal successions of attractors then encode unfolding semantics, which may be generated by a behavioral or mental interaction with an actual or imagined situation in our environment. Implications, further predictions, possible verification, and falsifications, as well as potential enhancements into a fully spelled-out unified theory of cognition are discussed at the end of the paper.

Symbol Grounding or the Emergence of Symbols? Vocabulary Growth in Children and a Connectionist Net

Softened Symbol Grounding for Neuro-symbolic Systems

Symbol Emergence in Cognitive Developmental Systems: A Survey

Getting symbols out of a neural architecture

Grounded Symbols in the Brain Computational Foundations for Perceptual Symbol System

Emergence of Symbols in Neural Networks for Semantic Understanding and Communication

Symbol ungrounding: what the successes (and failures) of large language models reveal about human cognition

Symbol Grounding via Chaining of Morphisms

Collective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference

How the symbol grounding of living organisms can be realized in artificial agents

Grounding Mental Representations in a Virtual Multi-Level Functional Framework

Mutual Bootstrapping Between Language and Analogical Processing

Symbol Emergence as an Interpersonal Multimodal Categorization

SymCog: An open-source toolkit for assessing human symbolic cognition

The Vector Grounding Problem

A Neurobiologically Constrained Cortex Model of Semantic Grounding With Spiking Neurons and Brain-Like Connectivity

The Neuro-Symbolic Brain

Symbol Correctness in Deep Neural Networks Containing Symbolic Layers

Symbolic functioning in preschool children

Toward a Unified Sub-symbolic Computational Theory of Cognition

Unsupervised, Bottom-up Category Discovery for Symbol Grounding with a Curious Robot