Abstract:Even as machine learning exceeds human-level performance on many applications, the generality, robustness, and rapidity of the brain's learning capabilities remain unmatched. How cognition arises from neural activity is the central open question in neuroscience, inextricable from the study of intelligence itself. A simple formal model of neural activity was proposed in Papadimitriou et al. (2020) and has been subsequently shown, through both mathematical proofs and simulations, to be capable of implementing certain simple cognitive operations via the creation and manipulation of assemblies of neurons. However, many intelligent behaviors rely on the ability to recognize, store, and manipulate temporal sequences of stimuli (planning, language, navigation, to list a few). Here we show that in the same model, sequential precedence can be captured naturally through synaptic weights and plasticity, and, as a result, a range of computations on sequences of assemblies can be carried out. In particular, repeated presentation of a sequence of stimuli leads to the memorization of the sequence through corresponding neural assemblies: upon future presentation of any stimulus in the sequence, the corresponding assembly and its subsequent ones will be activated, one after the other, until the end of the sequence. If the stimulus sequence is presented to two brain areas simultaneously, a scaffolded representation is created, resulting in more efficient memorization and recall, in agreement with cognitive experiments. Finally, we show that any finite state machine can be learned in a similar way, through the presentation of appropriate patterns of sequences. Through an extension of this mechanism, the model can be shown to be capable of universal computation. Taken together, these results provide a concrete hypothesis for the basis of the brain's remarkable abilities to compute and learn, with sequences playing a vital role.

Computation with Sequences in a Model of the Brain

Computation with Sequences of Assemblies in a Model of the Brain

Neuronal Sequence Models for Bayesian Online Inference

Sequence learning, prediction, and replay in networks of spiking neurons

Sequence memory for prediction, inference and behaviour

How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier.

Neurons learn by predicting future activity

Coin-Flipping In The Brain: Statistical Learning with Neuronal Assemblies

Sequential Memory: a Putative Neural and Synaptic Dynamical Mechanism.

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Sequence reproduction, single trial learning, and mimicry based on a mammalian-like distributed code for time

Neural Sequences and the Encoding of Time

The brain versus AI: World-model-based versatile circuit computation underlying diverse functions in the neocortex and cerebellum

Recurrent Network Models Of Sequence Generation And Memory

Inferring Inference

Beyond spiking networks: The computational advantages of dendritic amplification and input segregation

Structured sequence processing and combinatorial binding: neurobiologically and computationally informed hypotheses

The brain as an efficient and robust adaptive learner

Microscopic computation in human brain evolution

Long Sequence Hopfield Memory

Neurocoder: Learning General-Purpose Computation Using Stored Neural Programs