Abstract:Associative system has attracted increasing attention for it can store basic information and then infer details to match perception with an efficient self-organization algorithm. However, the implementation of the associative system with the application of real-world data is relatively difficult. To address this issue, we propose a novel biologically inspired auto-associative (BIAA) network to explore the structure, encoding and formation of associative memory as well as to extend the ability to real-world application. Our network is constructed by imitating the organization of the cortical minicolumns where each minicolumn contains plenty of parallel biological spiking neurons. To allow the network to learn and predict one symbol per theta cycle, we incorporate synaptic delay and theta oscillation into the neuron dynamic process. Subsequently, we design a sparse temporal population (STP) coding scheme that allows each input symbol to be represented as stable, unique, and easily recallable sparsely distributed representations. By combining associative learning dynamics with the STP coding, our network realizes efficient storage and inference in an ordered manner. Experimental results indicate that the proposed network successfully performs sequence retrieval from partial text and sequence recovery from distorted information. BIAA network provides new insight into introducing biologically inspired mechanisms into associative system and has enormous potential for hardware and software applications.

The optimal encodings for biased association in linear associative memories

Optimal learning algorithm in bidirectional associative memories

Designing Bidirectional Associative Memories with Optimal Stability

A neuron-weighted learning algorithm and its hardware implementation in associative memories

Optimum associative neural network utilizing maximum likelihood

Optimal Bidirectional Associative Memories.

Bidirectional Associative Memory Utilizing Maximum Likelihood

Learning algorithm of associative memory with optimal stability of pattern components

The Relative Advantages of Sparse Versus Distributed Encoding for Associative Neuronal Networks in the Brain

Optimal Encoding in Stochastic Latent-Variable Models

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

Two iterative encoding schemes for bidirectional associative memory

The optimality of attaching unlinked labels to unlinked meanings

Efficient learning algorithm for associative memory neural network

Learning algorithms of bidirectional associative memory based on max-min criterion

Noise Facilitation in Associative Memories of Exponential Capacity

Sparsely Connected Associative Memory Based on the Preferential Mechanism of Heuristic Annealed Topology

Asymmetric Bidirectional Associative Memories.

Competitive learning to generate sparse representations for associative memory

A Biologically Inspired Auto-Associative Network with Sparse Temporal Population Coding.

An effective associative memory for pattern recognition