Abstract:Gamma oscillations nested in a theta rhythm are observed in the hippocampus, where are assumed to play a role in sequential episodic memory, i.e., memorization and retrieval of events that unfold in time. In this work, we present an original neurocomputational model based on neural masses, which simulates the encoding of sequences of events in the hippocampus and subsequent retrieval by exploiting the theta-gamma code. The model is based on a three-layer structure in which individual Units oscillate with a gamma rhythm and code for individual features of an episode. The first layer (working memory in the prefrontal cortex) maintains a cue in memory until a new signal is presented. The second layer (CA3 cells) implements an auto-associative memory, exploiting excitatory and inhibitory plastic synapses to recover an entire episode from a single feature. Units in this layer are disinhibited by a theta rhythm from an external source (septum or Papez circuit). The third layer (CA1 cells) implements a hetero-associative net with the previous layer, able to recover a sequence of episodes from the first one. During an encoding phase, simulating high-acetylcholine levels, the network is trained with Hebbian (synchronizing) and anti-Hebbian (desynchronizing) rules. During retrieval (low-acetylcholine), the network can correctly recover sequences from an initial cue using gamma oscillations nested inside the theta rhythm. Moreover, in high noise, the network isolated from the environment simulates a mind-wandering condition, randomly replicating previous sequences. Interestingly, in a state simulating sleep, with increased noise and reduced synapses, the network can "dream" by creatively combining sequences, exploiting features shared by different episodes. Finally, an irrational behavior (erroneous superimposition of features in various episodes, like "delusion") occurs after pathological-like reduction in fast inhibitory synapses. The model can represent a straightforward and innovative tool to help mechanistically understand the theta-gamma code in different mental states.

Theta sequences as eligibility traces: a biological solution to credit assignment

Expected Eligibility Traces

A theory of hippocampal theta correlations accounting for extrinsic and intrinsic sequences

A Unified Approach for Multi-step Temporal-Difference Learning with Eligibility Traces in Reinforcement Learning

One-shot learning and behavioral eligibility traces in sequential decision making

Sequence learning, prediction, and replay in networks of spiking neurons

THETA PHASE PRECESSION ENHANCING MEMORY OF PLACE SEQUENCE IN SINGLE TRIAL LEARNING

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Short-term Memory Traces for Action Bias in Human Reinforcement Learning

Modeling the contribution of theta-gamma coupling to sequential memory, imagination, and dreaming

A Hierarchical Organized Memory Model Using Spiking Neurons

Theta Phase Precession Enhance Single Trial Learning in an STDP Network

Sequence Compression Speeds Up Credit Assignment in Reinforcement Learning

Sparse Attentive Backtracking: Temporal CreditAssignment Through Reminding

Learning predictive cognitive maps with spiking neurons during behavior and replays

Spatial Memory Sequence Encoding and Replay During Modeled Theta and Ripple Oscillations

Long sequence Hopfield memory*

CA3 Circuit Model Compressing Sequential Information in Theta Oscillation and Replay

A hippocampus CA3 spiking neural network model for storage and retrieval of sequential memory

Long Sequence Hopfield Memory

Computation with Sequences in a Model of the Brain