Abstract:Memory is a fundamental part of computational systems like the human brain. Theoretical models identify memories as attractors of neural network activity patterns based on the theory that attractor (recurrent) neural networks are able to capture some crucial characteristics of memory, such as encoding, storage, retrieval, and long-term and working memory. In such networks, long-term storage of the memory patterns is enabled by synaptic strengths that are adjusted according to some activity-dependent plasticity mechanisms (of which the most widely recognized is the Hebbian rule) such that the attractors of the network dynamics represent the stored memories. Most of previous studies on associative memory are focused on Hopfield-like binary networks, and the learned patterns are often assumed to be uncorrelated in a way that minimal interactions between memories are facilitated. In this letter, we restrict our attention to a more biological plausible attractor network model and study the neuronal representations of correlated patterns. We have examined the role of saliency weights in memory dynamics. Our results demonstrate that the retrieval process of the memorized patterns is characterized by the saliency distribution, which affects the landscape of the attractors. We have established the conditions that the network state converges to unique memory and multiple memories. The analytical result also holds for other cases for variable coding levels and nonbinary levels, indicating a general property emerging from correlated memories. Our results confirmed the advantage of computing with graded-response neurons over binary neurons (i.e., reducing of spurious states). It was also found that the nonuniform saliency distribution can contribute to disappearance of spurious states when they exit.

Pattern Memory And Acquisition Based On Stability Of Cellular Neural Networks

Convergence Analysis of General Neural Networks under Almost Periodic Stimuli

Designing Bidirectional Associative Memories with Optimal Stability

Nontrivial Global Attractors in 2-D Multistable Attractor Neural Networks

Sufficient condition of stability for cellular neural networks

Memory Dynamics in Attractor Networks with Saliency Weights.

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Memorizing morph patterns in small-world neuronal network

Controlling Chaos In A Neural Network Based On The Phase Space Constraint

Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms

Cellular Neural Networks As a Model of Associative Memories

A New Lmi-Based Approach For Stability Analysis Of Cellular Neural Networks With Time Delay

The Stability Of The 2(N)-Element Number Neural-Network Models

Unconditioned stability of cellular neural networks with delay

Novel Exponential Stability and Periodicity of Cellular Neural Networks

A Gaussian attractor network for memory and recognition with experience-dependent learning.

Associative Memory Synthesis Based on Region Attractive Recurrent Neural Networks

Dreaming neural networks: Forgetting spurious memories and reinforcing pure ones

An Improved Result for Complete Stability of Delayed Cellular Neural Networks

Estimation of Attraction Domain and Exponential Convergence Rate of Continuous Feedback Associative Memory and Its Applications

A Class of Connection Patterns for Neural Networks with Absolute Stability