Abstract:Associative system has attracted increasing attention for it can store basic information and then infer details to match perception with an efficient self-organization algorithm. However, the implementation of the associative system with the application of real-world data is relatively difficult. To address this issue, we propose a novel biologically inspired auto-associative (BIAA) network to explore the structure, encoding and formation of associative memory as well as to extend the ability to real-world application. Our network is constructed by imitating the organization of the cortical minicolumns where each minicolumn contains plenty of parallel biological spiking neurons. To allow the network to learn and predict one symbol per theta cycle, we incorporate synaptic delay and theta oscillation into the neuron dynamic process. Subsequently, we design a sparse temporal population (STP) coding scheme that allows each input symbol to be represented as stable, unique, and easily recallable sparsely distributed representations. By combining associative learning dynamics with the STP coding, our network realizes efficient storage and inference in an ordered manner. Experimental results indicate that the proposed network successfully performs sequence retrieval from partial text and sequence recovery from distorted information. BIAA network provides new insight into introducing biologically inspired mechanisms into associative system and has enormous potential for hardware and software applications.

An associative memory system for incremental learning and temporal sequence

A Multidirectional Associative Memory Based on Self-organizing Incremental Neural Network

A neuron-weighted learning algorithm and its hardware implementation in associative memories

An Incremental Time-delay Neural Network for Dynamical Recurrent Associative Memory

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

A hippocampus CA3 spiking neural network model for storage and retrieval of sequential memory

Efficient learning algorithm for associative memory neural network

Learning And Retrieving Spatio-Temporal Sequences With Any Static Associative Neural Network

A Biologically Inspired Auto-Associative Network with Sparse Temporal Population Coding.

Long Sequence Hopfield Memory

A Hierarchical Organized Memory Model Using Spiking Neurons

Learning associative memories by error backpropagation.

Long sequence Hopfield memory*

Self-Attentive Associative Memory

A Novel Neural Network for Associative Memory Via Dynamical Systems

BayesPCN: A Continually Learnable Predictive Coding Associative Memory

A New Hierarchical Temporal Memory Based on Recurrent Learning Unit

Neural networks trained for associative memory

Fuzzy associative memories with autoencoding mechanisms

Entropic Hetero-Associative Memory

Design and analysis of high-capacity associative memories based on a class of discrete-time recurrent neural networks.