Abstract:Memory is a fundamental part of computational systems like the human brain. Theoretical models identify memories as attractors of neural network activity patterns based on the theory that attractor (recurrent) neural networks are able to capture some crucial characteristics of memory, such as encoding, storage, retrieval, and long-term and working memory. In such networks, long-term storage of the memory patterns is enabled by synaptic strengths that are adjusted according to some activity-dependent plasticity mechanisms (of which the most widely recognized is the Hebbian rule) such that the attractors of the network dynamics represent the stored memories. Most of previous studies on associative memory are focused on Hopfield-like binary networks, and the learned patterns are often assumed to be uncorrelated in a way that minimal interactions between memories are facilitated. In this letter, we restrict our attention to a more biological plausible attractor network model and study the neuronal representations of correlated patterns. We have examined the role of saliency weights in memory dynamics. Our results demonstrate that the retrieval process of the memorized patterns is characterized by the saliency distribution, which affects the landscape of the attractors. We have established the conditions that the network state converges to unique memory and multiple memories. The analytical result also holds for other cases for variable coding levels and nonbinary levels, indicating a general property emerging from correlated memories. Our results confirmed the advantage of computing with graded-response neurons over binary neurons (i.e., reducing of spurious states). It was also found that the nonuniform saliency distribution can contribute to disappearance of spurious states when they exit.

Designation of complex-valued hopfield associative memory with prespecified attractive domain

A New Approach to the Design of Hopfield Associative Memory

Estimation of domain of attraction and exponential convergence rate of Hopfield's continuous-time associative memory and its applications

Designing Bidirectional Associative Memories with Optimal Stability

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

A Memristive Hopfield Network for Associative Memory

Storage Capacity of the Hopfield Network Associative Memory

Simplicial Hopfield networks

Multistability of State-Dependent Switched Fractional-Order Hopfield Neural Networks With Mexican-Hat Activation Function and Its Application in Associative Memories

Pattern Storage and Hopfield Neural Associative Memory with Hidden Structure.

Associative Memory Synthesis Based on Region Attractive Recurrent Neural Networks

Associative memory realized by a reconfigurable memristive Hopfield neural network

Memory Dynamics in Attractor Networks with Saliency Weights.

Estimation of Attraction Domain and Exponential Convergence Rate of Continuous Feedback Associative Memory and Its Applications

Large Associative Memory Problem in Neurobiology and Machine Learning

Dynamics of a Random Hopfield Neural Lattice Model with Adaptive Synapses and Delayed Hebbian Learning

Some Exact Results of Hopfield Neural Networks and Applications

Global Convergence and Asymptotic Stability of Asymmetric Hopfield Neural Networks

The Stability of Asymmetric Hopfield Networks With Nonnegative Weights

Effects of Delays on the Basin Boundary of Attraction in A Hopfield Network of Two Delay-Connecting Neurons

Long Sequence Hopfield Memory