Abstract:Memory is a fundamental part of computational systems like the human brain. Theoretical models identify memories as attractors of neural network activity patterns based on the theory that attractor (recurrent) neural networks are able to capture some crucial characteristics of memory, such as encoding, storage, retrieval, and long-term and working memory. In such networks, long-term storage of the memory patterns is enabled by synaptic strengths that are adjusted according to some activity-dependent plasticity mechanisms (of which the most widely recognized is the Hebbian rule) such that the attractors of the network dynamics represent the stored memories. Most of previous studies on associative memory are focused on Hopfield-like binary networks, and the learned patterns are often assumed to be uncorrelated in a way that minimal interactions between memories are facilitated. In this letter, we restrict our attention to a more biological plausible attractor network model and study the neuronal representations of correlated patterns. We have examined the role of saliency weights in memory dynamics. Our results demonstrate that the retrieval process of the memorized patterns is characterized by the saliency distribution, which affects the landscape of the attractors. We have established the conditions that the network state converges to unique memory and multiple memories. The analytical result also holds for other cases for variable coding levels and nonbinary levels, indicating a general property emerging from correlated memories. Our results confirmed the advantage of computing with graded-response neurons over binary neurons (i.e., reducing of spurious states). It was also found that the nonuniform saliency distribution can contribute to disappearance of spurious states when they exit.

Analysis and Design of Associative Memories Based on Recurrent Neural Networks with Linear Saturation Activation Functions and Time-Varying Delays

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

A neuron-weighted learning algorithm and its hardware implementation in associative memories

Memory Dynamics in Attractor Networks with Saliency Weights.

Associative Memory Synthesis Based on Region Attractive Recurrent Neural Networks

Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

Global Stability of Bidirectional Associative Memory Neural Networks with Delays

Memory Circuit Design, Implementation and Analysis Based on Memristor Full-function Pavlov Associative

Convergence Analysis Of Hybrid Bi-Directional Associative Memory Neural Networks With Discrete Delays

Associative memories based on delayed fractional-order neural networks and application to explaining-lesson skills assessment of normal students: from the perspective of multiple $ \mathit O(t^{-\alpha}) $ stability

A Novel Neural Network for Associative Memory Via Dynamical Systems

Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms

An estimation of the domain of attraction for recurrent neural networks with time-varying delays

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

Associative memory with a controlled chaotic neural network.

Synaptic Conditions for Auto-Associative Memory Storage and Pattern Completion in Jensen Et Al.’s Model of Hippocampal Area CA3

Convergence dynamics of hybrid bidirectional associative memory neural networks with distributed delays

Saturation Region Attractivity Analysis for Memristive Neural Networks under the Strong External Input

Global Stability of Periodic Solution for Bidirectional Associative Memory Neural Networks with Varying-Time Delay.

Memristive discrete chaotic neural network and its application in associative memory

Cellular Neural Networks As a Model of Associative Memories