Abstract:Neural networks are developed to model the behavior of the brain. One crucial question in this field pertains to when and how a neural network can memorize a given set of patterns. There are two mechanisms to store information: associative memory and sequential pattern recognition. In the case of associative memory, the neural network operates with dynamical attractors that are point attractors, each corresponding to one of the patterns to be stored within the network. In contrast, sequential pattern recognition involves the network memorizing a set of patterns and subsequently retrieving them in a specific order over time. From a dynamical perspective, this corresponds to the presence of a continuous attractor or a cyclic attractor composed of the sequence of patterns stored within the network in a given order. Evidence suggests that the brain is capable of simultaneously performing both associative memory and sequential pattern recognition. Therefore, these types of attractors coexist within the neural network, signifying that some patterns are stored as point attractors, while others are stored as continuous or cyclic attractors. This article investigates the coexistence of cyclic attractors and continuous or point attractors in certain nonlinear neural networks, enabling the simultaneous emergence of various memory mechanisms. By selectively grouping neurons, conditions are established for the existence of cyclic attractors, continuous attractors, and point attractors, respectively. Furthermore, each attractor is explicitly represented, and a competitive dynamic emerges among these coexisting attractors, primarily regulated by adjustments to external inputs.

On the number of limit cycles in asymmetric neural networks

Effect of dilution in asymmetric recurrent neural networks

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

Stability switches, oscillatory multistability, and spatio-temporal patterns of nonlinear oscillations in recurrently delay coupled neural networks

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Sequential attractors in combinatorial threshold-linear networks

On the number of limit cycles in general planar piecewise linear systems of node-node types

Connectivity structure and dynamics of nonlinear recurrent neural networks

Limit Cycle of a Single-Neuron System and Its Circuitry Design

Limit Cycle of a Single-Neuron System with Smooth Continuous and Binary-Value Activation Functions and Its Circuitry Design

Chaos, Multiplicity, Crisis, and Synchronicity in Higher-Order Neural Networks

Attractor Modulation and Proliferation in 1+$\infty$ Dimensional Neural Networks

Bistability and Tunable Gating in a Recurrent Neuronal Network with Synaptic Failure and Hidden Neurons

Unboundedness and Periodicity of Solutions for a Discrete-Time Network Model of Three Neurons

Large-Scale Neural Networks with Asymmetrical Three-Ring Structure: Stability, Nonlinear Oscillations, and Hopf Bifurcation

Critical Dynamics and Cyclic Memory Retrieval in Non-reciprocal Hopfield Networks

Bifurcation and Oscillations of a Multi-ring Coupling Neural Network with Discrete Delays

Bifurcation Analysis and Spatiotemporal Patterns of Nonlinear Oscillations in a Ring Lattice of Identical Neurons with Delayed Coupling

Convergence And Periodicity Of Solutions For A Discrete-Time Network Model Of Two Neurons

Dynamics of Four-Neuron Recurrent Inhibitory Loop with State-Dependent Time Delays.

Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms