Abstract:Neural networks are developed to model the behavior of the brain. One crucial question in this field pertains to when and how a neural network can memorize a given set of patterns. There are two mechanisms to store information: associative memory and sequential pattern recognition. In the case of associative memory, the neural network operates with dynamical attractors that are point attractors, each corresponding to one of the patterns to be stored within the network. In contrast, sequential pattern recognition involves the network memorizing a set of patterns and subsequently retrieving them in a specific order over time. From a dynamical perspective, this corresponds to the presence of a continuous attractor or a cyclic attractor composed of the sequence of patterns stored within the network in a given order. Evidence suggests that the brain is capable of simultaneously performing both associative memory and sequential pattern recognition. Therefore, these types of attractors coexist within the neural network, signifying that some patterns are stored as point attractors, while others are stored as continuous or cyclic attractors. This article investigates the coexistence of cyclic attractors and continuous or point attractors in certain nonlinear neural networks, enabling the simultaneous emergence of various memory mechanisms. By selectively grouping neurons, conditions are established for the existence of cyclic attractors, continuous attractors, and point attractors, respectively. Furthermore, each attractor is explicitly represented, and a competitive dynamic emerges among these coexisting attractors, primarily regulated by adjustments to external inputs.

Analysis and Design of Associative Memories Based on Recurrent Neural Network with Discontinuous Activation Functions

Analysis and Design of Associative Memories Based on Recurrent Neural Networks with Linear Saturation Activation Functions and Time-Varying Delays

Analysis and Design of Multivalued High-Capacity Associative Memories Based on Delayed Recurrent Neural Networks.

Design and analysis of high-capacity associative memories based on a class of discrete-time recurrent neural networks.

A Neural Network with a Single Recurrent Unit for Associative Memories Based on Linear Optimization

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

A Novel Continuous-Time Neural Network for Realizing Associative Memory

Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

Analysis and Optimal Design of Continuous Neural Networks with Applications to Associative Memory

Multistability and multiperiodicity of delayed bidirectional associative memory neural networks with discontinuous activation functions.

A Recurrent Neural Network Based on Memristive Activation Function and Its Associative Memory

Associative Memory Synthesis Based on Region Attractive Recurrent Neural Networks

Multistability of Complex-Valued NNs with General Periodic-Type Activation Functions and Its Application to Associative Memories

Design of High-Capacity Auto-Associative Memories Based on the Analysis of Complex-Valued Neural Networks

Multistability of Delayed Hybrid Impulsive Neural Networks with Application to Associative Memories.

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

A Novel Neural Network for Associative Memory Via Dynamical Systems

Design and analysis of associative memories based on external inputs of delayed recurrent neural networks.

Global Asymptotical Stability Analysis for a Kind of Discrete-Time Recurrent Neural Network with Discontinuous Activation Functions

Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms

Analysis and optimal design of nonlinear continuous associative memory neural networks