Abstract:Understanding how the brain forms representations of structured information distributed in time is a challenging endeavour for the neuroscientific community, requiring computationally and neurobiologically informed approaches. The neural mechanisms for segmenting continuous streams of sensory input and establishing representations of dependencies remain largely unknown, as do the transformations and computations occurring between the brain regions involved in these aspects of sequence processing. We propose a blueprint for a neurobiologically informed and informing computational model of sequence processing (entitled: Vector-symbolic Sequencing of Binding INstantiating Dependencies, or VS-BIND). This model is designed to support the transformation of serially ordered elements in sensory sequences into structured representations of bound dependencies, readily operates on multiple timescales, and encodes or decodes sequences with respect to chunked items wherever dependencies occur in time. The model integrates established vector symbolic additive and conjunctive binding operators with neurobiologically plausible oscillatory dynamics, and is compatible with modern spiking neural network simulation methods. We show that the model is capable of simulating previous findings from structured sequence processing tasks that engage fronto-temporal regions, specifying mechanistic roles for regions such as prefrontal areas 44/45 and the frontal operculum during interactions with sensory representations in temporal cortex. Finally, we are able to make predictions based on the configuration of the model alone that underscore the importance of serial position information, which requires input from time-sensitive cells, known to reside in the hippocampus and dorsolateral prefrontal cortex. This article is part of the theme issue ‘Towards mechanistic models of meaning composition’.

Temporal Binding in Multisensory and Motor-Sensory Contexts: Toward a Unified Model

The fusion point of temporal binding: Promises and perils of multisensory accounts

A Mechanistic Model of Perceptual Binding Predicts That Binding Mechanism Is Robust against Noise

To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference

Neural correlates of cross-modal binding

Evaluating the Bayesian causal inference model of intentional binding through computational modeling

Attention and feature binding in the temporal domain

Temporal binding window and sense of agency are related processes modifiable via occipital tACS

Temporal and Semantic Effects on Multisensory Integration

Temporal-Coherence Induces Binding in Responses to Sound Sequences in Ferret Auditory Cortex

The Motor of Time: Coupling Action to Temporally Predictable Events Heightens Perception

The time course of Temporal Binding in social and nonsocial interactions

Closing the loop on multisensory interactions: A neural architecture for multisensory causal inference and recalibration

Temporal cognition: Connecting subjective time to perception, attention, and memory.

Spatiotemporal models for multisensory integration

Unraveling the Binding Problem in Working Memory: Insights from the Hierarchical Binding Model

Structured sequence processing and combinatorial binding: neurobiologically and computationally informed hypotheses

Unveiling Dynamic System Strategies for Multisensory Processing: from Neuronal Fixed-Criterion Integration to Population Bayesian Inference

Temporal-Coherence Induces Binding of Responses to Sound Sequences in Ferret Auditory Cortex

A simple and efficient method to enhance audiovisual binding tendencies

Feature binding is slow: Temporal integration explains apparent ultrafast binding