Abstract:Understanding how the brain forms representations of structured information distributed in time is a challenging endeavour for the neuroscientific community, requiring computationally and neurobiologically informed approaches. The neural mechanisms for segmenting continuous streams of sensory input and establishing representations of dependencies remain largely unknown, as do the transformations and computations occurring between the brain regions involved in these aspects of sequence processing. We propose a blueprint for a neurobiologically informed and informing computational model of sequence processing (entitled: Vector-symbolic Sequencing of Binding INstantiating Dependencies, or VS-BIND). This model is designed to support the transformation of serially ordered elements in sensory sequences into structured representations of bound dependencies, readily operates on multiple timescales, and encodes or decodes sequences with respect to chunked items wherever dependencies occur in time. The model integrates established vector symbolic additive and conjunctive binding operators with neurobiologically plausible oscillatory dynamics, and is compatible with modern spiking neural network simulation methods. We show that the model is capable of simulating previous findings from structured sequence processing tasks that engage fronto-temporal regions, specifying mechanistic roles for regions such as prefrontal areas 44/45 and the frontal operculum during interactions with sensory representations in temporal cortex. Finally, we are able to make predictions based on the configuration of the model alone that underscore the importance of serial position information, which requires input from time-sensitive cells, known to reside in the hippocampus and dorsolateral prefrontal cortex. This article is part of the theme issue ‘Towards mechanistic models of meaning composition’.

How are segmentation and binding computed and represented in the brain?

The Binding Problem 2.0: Beyond Perceptual Features

Structured sequence processing and combinatorial binding: neurobiologically and computationally informed hypotheses

Visual binding through reentrant connectivity and dynamic synchronization in a brain-based device

Modeling Attention and Binding in the Brain through Bidirectional Recurrent Gating

Dance of SNN and ANN: Solving binding problem by combining spike timing and reconstructive attention

Automated scalable segmentation of neurons from multispectral images

Binding Dynamics in Rotating Features

Binding Dancers Into Attractors

Probabilistic Model of Visual Segmentation

Binding in hippocampal-entorhinal circuits enables compositionality in cognitive maps

Neural Concept Binder

A Mechanistic Model of Perceptual Binding Predicts That Binding Mechanism Is Robust against Noise

Cellular Neural Network Architecture for Gibbs Random-Field-based Image Segmentation.

A Novel Approach Of Combining Temporal Segmentation Results To The Region Binding Process For Separating Moving Objects From Still Background

Synchronisation, binding and the role of correlated firing in fast information transmission

Brain functional network connectivity based on a visual task: visual information processing-related brain regions are significantly activated in the task state

Getting symbols out of a neural architecture

Temporal Binding in Multisensory and Motor-Sensory Contexts: Toward a Unified Model

Multivariate Patterns of Fmri Activity in Human V2 Predict Feature Binding of Color and Motion