Abstract:Memory is a fundamental part of computational systems like the human brain. Theoretical models identify memories as attractors of neural network activity patterns based on the theory that attractor (recurrent) neural networks are able to capture some crucial characteristics of memory, such as encoding, storage, retrieval, and long-term and working memory. In such networks, long-term storage of the memory patterns is enabled by synaptic strengths that are adjusted according to some activity-dependent plasticity mechanisms (of which the most widely recognized is the Hebbian rule) such that the attractors of the network dynamics represent the stored memories. Most of previous studies on associative memory are focused on Hopfield-like binary networks, and the learned patterns are often assumed to be uncorrelated in a way that minimal interactions between memories are facilitated. In this letter, we restrict our attention to a more biological plausible attractor network model and study the neuronal representations of correlated patterns. We have examined the role of saliency weights in memory dynamics. Our results demonstrate that the retrieval process of the memorized patterns is characterized by the saliency distribution, which affects the landscape of the attractors. We have established the conditions that the network state converges to unique memory and multiple memories. The analytical result also holds for other cases for variable coding levels and nonbinary levels, indicating a general property emerging from correlated memories. Our results confirmed the advantage of computing with graded-response neurons over binary neurons (i.e., reducing of spurious states). It was also found that the nonuniform saliency distribution can contribute to disappearance of spurious states when they exit.

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

Qualitative Analysis for Recurrent Neural Networks with Linear Threshold Transfer Functions

LT network dynamics and analog associative memory

Memory Dynamics in Attractor Networks with Saliency Weights.

Linear-Threshold Network Models for Describing and Analyzing Brain Dynamics

Analysis and Design of Associative Memories Based on Recurrent Neural Networks with Linear Saturation Activation Functions and Time-Varying Delays

Some multistability properties of bidirectional associative memory recurrent neural networks with unsaturating piecewise linear transfer functions

Stability analysis of memristive multidirectional associative memory neural networks and applications in information storage

Dynamics of Four-Neuron Recurrent Inhibitory Loop with State-Dependent Time Delays.

Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

Delay for the Capacity-Simplicity Dilemma in Associative Memory Attractor Networks

Multistability of Delayed Hybrid Impulsive Neural Networks with Application to Associative Memories.

Pattern Retrieval in Threshold Linear Associative Nets

Asymptotic Stability of Bidirectional Associative Memory Neural Networks with Time-Varying Delays Via Delta Operator Approach

Analysis and Design of Associative Memories Based on Recurrent Neural Network with Discontinuous Activation Functions

An emergent attractor network in a passive resistive switching circuit

Sequential attractors in combinatorial threshold-linear networks

Dynamics of Bidirectional Associative Memory Networks with Distributed Delays and Reaction–diffusion Terms

New results on stability analysis and extended dissipative conditions for uncertain memristive neural networks with two additive time-varying delay components and reaction-diffusion terms

Exponential Stability of Continuous-Time and Discrete-Time Bidirectional Associative Memory Networks with Delays