Abstract:Memory is a fundamental part of computational systems like the human brain. Theoretical models identify memories as attractors of neural network activity patterns based on the theory that attractor (recurrent) neural networks are able to capture some crucial characteristics of memory, such as encoding, storage, retrieval, and long-term and working memory. In such networks, long-term storage of the memory patterns is enabled by synaptic strengths that are adjusted according to some activity-dependent plasticity mechanisms (of which the most widely recognized is the Hebbian rule) such that the attractors of the network dynamics represent the stored memories. Most of previous studies on associative memory are focused on Hopfield-like binary networks, and the learned patterns are often assumed to be uncorrelated in a way that minimal interactions between memories are facilitated. In this letter, we restrict our attention to a more biological plausible attractor network model and study the neuronal representations of correlated patterns. We have examined the role of saliency weights in memory dynamics. Our results demonstrate that the retrieval process of the memorized patterns is characterized by the saliency distribution, which affects the landscape of the attractors. We have established the conditions that the network state converges to unique memory and multiple memories. The analytical result also holds for other cases for variable coding levels and nonbinary levels, indicating a general property emerging from correlated memories. Our results confirmed the advantage of computing with graded-response neurons over binary neurons (i.e., reducing of spurious states). It was also found that the nonuniform saliency distribution can contribute to disappearance of spurious states when they exit.

Performance of Associative Memory Using Partially-Connected Networks

Associative memory on small-world networks

Topology influences performance in the associative memory neural networks

Efficient Method for Designing Associative Memory with Contextual Small-World Architecture.

Memorizing morph patterns in small-world neuronal network

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

A Hierarchical Organized Memory Model Using Spiking Neurons

Sparsely Connected Associative Memory Based on the Preferential Mechanism of Heuristic Annealed Topology

Research on associative memory based on a small-world neural network

A Projection Learning Rule Associative Memory Model Based on Small-World Architecture

A Computationally Efficient Associative Memory Model of Hippocampus CA3 by Spiking Neurons

Memory Dynamics in Attractor Networks with Saliency Weights.

A Novel Continuous-Time Neural Network for Realizing Associative Memory

The Study of Chaotic Neural Network and its Applications in Associative Memory

Fractal Neural-Network - Computational Performance As an Associative Memory

A Novel Neural Network for Associative Memory Via Dynamical Systems

A Weakly Connected Memristive Neural Network for Associative Memory

Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Network

Memristive discrete chaotic neural network and its application in associative memory

Memristor-based Chaotic Neural Networks for Associative Memory