Abstract:Symbolic systems are powerful frameworks for modeling cognitive processes as they encapsulate the rules and relationships fundamental to many aspects of human reasoning and behavior. Central to these models are systematicity, compositionality, and productivity, making them invaluable in both cognitive science and artificial intelligence. However, certain limitations remain. For instance, the integration of structured symbolic processes and latent sub-symbolic processes has been implemented at the computational level through fiat methods such as quantization or softmax sampling, which assume, rather than derive, the operations underpinning discretization and symbolicization. In this work, we introduce a novel neural stochastic dynamical systems model that integrates attractor dynamics with symbolic representations to model cognitive processes akin to the probabilistic language of thought (PLoT). Our model segments the continuous representational space into discrete basins, with attractor states corresponding to symbolic sequences, that reflect the semanticity and compositionality characteristic of symbolic systems through unsupervised learning, rather than relying on pre-defined primitives. Moreover, like PLoT, our model learns to sample a diverse distribution of attractor states that reflect the mutual information between the input data and the symbolic encodings. This approach establishes a unified framework that integrates both symbolic and sub-symbolic processing through neural dynamics, a neuro-plausible substrate with proven expressivity in AI, offering a more comprehensive model that mirrors the complex duality of cognitive operations.

Alternative Views of Bilingual Representations: From Stationary to Dynamic Models

Differentiating Interpreting Types: Connecting Complex Networks to Cognitive Complexity

On the Representational Structure of the Bilingual Mental Lexicon

Getting symbols out of a neural architecture

Language experiences and cognitive control: A dynamic perspective

A structural representing and learning model based on biological neural mechanism

Discrete, compositional, and symbolic representations through attractor dynamics

Neurolinguistics: Structure, Function, and Connectivity in the Bilingual Brain

A Hierarchical Model for Perception Memory Based on Connected Graph and Dynamic Process

Dual-Coding Theory and Connectionist Lexical Selection

A Behavioral Perspective on Models of Linear Dynamical Networks with Manifest Variables

Representation and Development of Cognition

A Bilingual Advantage? An Appeal for a Change in Perspective and Recommendations for Future Research

Research on bilingual language processing and how languages are represented in the mind

Effective Integration of Symbolic and Connectionist Approaches through a Hybrid Representation

Learning Algebraic Representation for Abstract Spatial-Temporal Reasoning

The Advantage of Connectionism in Explaining the Complexity and Efficiency of Language Processing

Bilingual language processing relies on shared semantic representations that are modulated by each language

Geometry and dynamics of representations in a precisely balanced memory network related to olfactory cortex

Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains

A Neural Dynamic Model based on Activation Diffusion and a Micro-Explanation for Cognitive Operations