Abstract:Memory is a fundamental part of computational systems like the human brain. Theoretical models identify memories as attractors of neural network activity patterns based on the theory that attractor (recurrent) neural networks are able to capture some crucial characteristics of memory, such as encoding, storage, retrieval, and long-term and working memory. In such networks, long-term storage of the memory patterns is enabled by synaptic strengths that are adjusted according to some activity-dependent plasticity mechanisms (of which the most widely recognized is the Hebbian rule) such that the attractors of the network dynamics represent the stored memories. Most of previous studies on associative memory are focused on Hopfield-like binary networks, and the learned patterns are often assumed to be uncorrelated in a way that minimal interactions between memories are facilitated. In this letter, we restrict our attention to a more biological plausible attractor network model and study the neuronal representations of correlated patterns. We have examined the role of saliency weights in memory dynamics. Our results demonstrate that the retrieval process of the memorized patterns is characterized by the saliency distribution, which affects the landscape of the attractors. We have established the conditions that the network state converges to unique memory and multiple memories. The analytical result also holds for other cases for variable coding levels and nonbinary levels, indicating a general property emerging from correlated memories. Our results confirmed the advantage of computing with graded-response neurons over binary neurons (i.e., reducing of spurious states). It was also found that the nonuniform saliency distribution can contribute to disappearance of spurious states when they exit.

Feed-Forward Chains of Recurrent Attractor Neural Networks Near Saturation

Feed-forward chains of recurrent attractor neural networks with finite dilution near saturation

Qualitative Analysis for Recurrent Neural Networks with Linear Threshold Transfer Functions

Coexisting Chaotic Attractors in A Single Neuron Model with Adapting Feedback Synapse

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Attractor Modulation and Proliferation in 1+$\infty$ Dimensional Neural Networks

Continuous Attractors of Discrete-Time Recurrent Neural Networks

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

An Analysis on Neural Dynamics with Saturated Sigmoidal Functions

Continuous Recurrent Neural Networks Based on Function Satlins

Memory Dynamics in Attractor Networks with Saliency Weights.

Bistability and Tunable Gating in a Recurrent Neuronal Network with Synaptic Failure and Hidden Neurons

On the stationary state of a network of inhibitory spiking neurons

Back to the Continuous Attractor

Slow and Weak Attractor Computation Embedded in Fast and Strong E-I Balanced Neural Dynamics.

Neural networks with transient state dynamics

Dynamical properties of a small heterogeneous chain network of neurons in discrete time

Bistability Analysis of Excitatory-Inhibitory Neural Networks in Limited-Sustained-Activity Regime

Ising-like model replicating time-averaged spiking behaviour of in vitro neuronal networks

A Step Towards Uncovering The Structure of Multistable Neural Networks