Abstract:Threshold-linear (graded response) units approximate the real firing behaviour of pyramidal neurons in a simplified form, suited to the analytical study of large autoassociative networks. Here we extend previous results on threshold-linear networks to a much larger class of models, by considering different connectivities (including full feedback, highly diluted and multilayer feedforward architectures), different forms of Hebbian learning rules, and different distributions of firing rates (including realistic, continuous distributions of rates). This allows an evaluation of the main factors which may affect, in real cortical networks, the capacity for storage and retrieval of discrete firing patterns.In each case a single equation is derived, which determines both αc, the maximum number of retrievable patterns per synapse, and Im, the maximum amount of retrievable information per synapse. It is shown that: 1. Non-speeific effects, such as those usually ascribed to inhibition, or to neuramodulatary afferents, alter the overall response, but do not affect the capacity for retrieval.2. The crucial parameter which affects αc is a, the sparseness of the neural code. Results previously obtained with binary distributions of rates are shown to hold in general, namely that as a → 0 (sparse coding) αc grows proportionally to (aln(l/a))−1, while Im depends only weakly on a.3. When the coding is sparse, αc and Im become independent of the connectivity, and in particular the relative disadvantages of fully connected feedback networks, which are prominent with non-sparse codes, disappear.4. The precise form of the distribution of rates, and that of the learning rule used, turn out to have rather limited effects on αc and Im. It is to be noted, however, that when non-binary patterns are stored using nonlinear learning rules, such as those possibly modelling the action of NMDA receptors, information distortion occurs in retrieval, and results in a marked decrease of Im. These results may be applied to help understand the organization of a specific network in the hippocampus thought to operate as an autoassociative memory.

Simulation Studies of the CA3 Hippocampal Subfield Modelled As an Attractor Neural Network.

A Computationally Efficient Associative Memory Model of Hippocampus CA3 by Spiking Neurons

An attractor network in the hippocampus: theory and neurophysiology.

Associative Memory Model of Hippocampus CA3 Using Spike Response Neurons

A Quantitative Theory of the Functions of the Hippocampal CA3 Network in Memory

Distinguishing examples while building concepts in hippocampal and artificial networks

A hippocampus CA3 spiking neural network model for storage and retrieval of sequential memory

Robust Resting-State Dynamics in a Large-Scale Spiking Neural Network Model of Area CA3 in the Mouse Hippocampus

Synaptic Conditions for Auto-Associative Memory Storage and Pattern Completion in Jensen Et Al.’s Model of Hippocampal Area CA3

Memory storage fidelity in the hippocampal circuit: the role of subregions and input statistics

Formation and Retrieval of Cell Assemblies in a Biologically Realistic Spiking Neural Network Model of Area CA3 in the Mouse Hippocampus

A Model Of The Operation Of The Hippocampus And Entorhinal Cortex In Memory

Modeling rhythmic patterns in the hippocampus

A model of hippocampal memory based on an adaptive learning rule of synapses

Computational Models of Hippocampal Functions

A Continuous Attractor Model with Realistic Neural and Synaptic Properties Quantitatively Reproduces Grid Cell Physiology

Neural models of episodic memory

A Computational Theory of Hippocampal Function, and Empirical Tests of the Theory.

Encoding and retrieval in a model of the hippocampal CA1 microcircuit

Attractor neural networks storing multiple space representations: a model for hippocampal place fields

What Determines the Capacity of Autoassociative Memories in the Brain