Abstract:It is widely believed that memory storage depends on activity-dependent synaptic modifications. Classical studies of learning and memory in neural networks describe synaptic efficacy either as continuous or discrete. However, recent results suggest an intermediate scenario in which synaptic efficacy can be described by a continuous variable, but whose distribution is peaked around a small set of discrete values. Motivated by these results, we explored a model in which each synapse is described by a continuous variable that evolves in a potential with multiple minima. External inputs to the network can switch synapses from one potential well to another. Our analytical and numerical results show that this model can interpolate between models with discrete synapses which correspond to the deep potential limit, and models in which synapses evolve in a single quadratic potential. We find that the storage capacity of the network with double well synapses exhibits a power law dependence on the network size, rather than the logarithmic dependence observed in models with single well synapses. In addition, synapses with deeper potential wells lead to more robust information storage in the presence of noise. When memories are sparsely encoded, the scaling of the capacity with network size is similar to previously studied network models in the sparse coding limit. A long-lasting question in neuroscience is whether synaptic efficacies should be described as continuous variable or discrete variables. Recent experiments indicate that it is a combination of both: synaptic efficacy changes continuously, but its distribution peaks at several discrete values. In this study, we introduce a synapse model described by a double well potential, and investigate the memory properties of networks of neurons connected with such synapses. Our results show in networks with a bimodal weight distribution, the storage capacity depends on network size as a power law. In addition, we demonstrate that networks with such synapses store information more robustly in the presence of noise, compared to networks with synapses with a single well potential.

Geometry and dynamics of representations in a precisely balanced memory network related to olfactory cortex

Computational functions of precisely balanced neuronal assemblies in an olfactory memory network

Memory Dynamics in Attractor Networks with Saliency Weights.

Representational learning by optimization of neural manifolds in an olfactory memory network

How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier.

Memorizing morph patterns in small-world neuronal network

A Hierarchical Organized Memory Model Using Spiking Neurons

Precise Spatial Memory in Local Random Networks

Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model

Memory Storage and Retrieval in Sparsely Connected Balanced Networks

Robust spatial memory maps encoded in networks with transient connections

A dynamic attractor network model of memory formation, reinforcement and forgetting

Local dendritic balance enables learning of efficient representations in networks of spiking neurons

Memory retrieval dynamics and storage capacity of a modular network model of association cortex with featural decomposition

Attractor neural networks with double well synapses

Through synapses to spatial memory maps: a topological model

Building a realistic, scalable memory model with independent engrams using a homeostatic mechanism

A Spike-Timing Pattern Based Neural Network Model for the Study of Memory Dynamics

A balanced memory network

Emergence and maintenance of modularity in neural networks with Hebbian and anti-Hebbian inhibitory STDP

Situation-based memory in spiking neuron-astrocyte network