Abstract:Development of computer science has led to the blooming of artificial intelligence (AI), and neural networks are the core of AI research. Although mainstream neural networks have done well in the fields of image processing and speech recognition, they do not perform well in models aimed at understanding contextual information. In our opinion, the reason for this is that the essence of building a neural network through parameter training is to fit the data to the statistical law through parameter training. Since the neural network built using this approach does not possess memory ability, it cannot reflect the relationship between data with respect to the causality. Biological memory is fundamentally different from the current mainstream digital memory in terms of the storage method. The information stored in digital memory is converted to binary code and written in separate storage units. This physical isolation destroys the correlation of information. Therefore, the information stored in digital memory does not have the recall or association functions of biological memory which can present causality. In this paper, we present the results of our preliminary effort at constructing an associative memory system based on a spiking neural network. We broke the neural network building process into two phases: the Structure Formation Phase and the Parameter Training Phase. The Structure Formation Phase applies a learning method based on Hebb's rule to provoke neurons in the memory layer growing new synapses to connect to neighbor neurons as a response to the specific input spiking sequences fed to the neural network. The aim of this phase is to train the neural network to memorize the specific input spiking sequences. During the Parameter Training Phase, STDP and reinforcement learning are employed to optimize the weight of synapses and thus to find a way to let the neural network recall the memorized specific input spiking sequences. The results show that our memory neural network could memorize different targets and could recall the images it had memorized.

Associative Memory Synthesis Based on Region Attractive Recurrent Neural Networks

Memory Dynamics in Attractor Networks with Saliency Weights.

Constructing an Associative Memory System Using Spiking Neural Network

A Novel Neural Network for Associative Memory Via Dynamical Systems

Design and analysis of high-capacity associative memories based on a class of discrete-time recurrent neural networks.

A Novel Continuous-Time Neural Network for Realizing Associative Memory

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms

Analysis and Design of Associative Memories Based on Recurrent Neural Networks with Linear Saturation Activation Functions and Time-Varying Delays

Analysis and Design of Associative Memories Based on Recurrent Neural Network with Discontinuous Activation Functions

Design of High-Capacity Auto-Associative Memories Based on the Analysis of Complex-Valued Neural Networks

Memory Circuit Design, Implementation and Analysis Based on Memristor Full-function Pavlov Associative

A Gaussian attractor network for memory and recognition with experience-dependent learning.

A hippocampus CA3 spiking neural network model for storage and retrieval of sequential memory

How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier.

A Synthesis Method for the Complex-Valued Associative Memory Constrained by the Attractive Domain

Synthesis of Bipolar Associative Memories Based on Cellular Neural Networks with Two-dimensional Space-invariant Templates

Saturation Region Attractivity Analysis for Memristive Neural Networks under the Strong External Input

Analysis and synthesis of associative memories based on Brain-State-in-a-Box neural networks

A Memristor-Based Neural Network Design for Associative Learning

Associative memory and segmentation in a network composed of Izhikevich neurons