Abstract:The abilities to perceive, learn, and use generalities, similarities, classes, i.e., semantic memory (SM), is central to cognition. Machine learning (ML), neural network, and AI research has been primarily driven by tasks requiring such abilities. However, another central facet of cognition, single-trial formation of permanent memories of experiences, i.e., episodic memory (EM), has had relatively little focus. Only recently has EM-like functionality been added to Deep Learning (DL) models, e.g., Neural Turing Machine, Memory Networks. However, in these cases: a) EM is implemented as a separate module, which entails substantial data movement (and so, time and power) between the DL net itself and EM; and b) individual items are stored localistically within the EM, precluding realizing the exponential representational efficiency of distributed over localist coding. We describe Sparsey, an unsupervised, hierarchical, spatial/spatiotemporal associative memory model differing fundamentally from mainstream ML models, most crucially, in its use of sparse distributed representations (SDRs), or, cell assemblies, which admits an extremely efficient, single-trial learning algorithm that maps input similarity into code space similarity (measured as intersection). SDRs of individual inputs are stored in superposition and because similarity is preserved, the patterns of intersections over the assigned codes reflect the similarity, i.e., statistical, structure, of all orders, not simply pairwise, over the inputs. Thus, SM, i.e., a generative model, is built as a computationally free side effect of the act of storing episodic memory traces of individual inputs, either spatial patterns or sequences. We report initial results on MNIST and on the Weizmann video event recognition benchmarks. While we have not yet attained SOTA class accuracy, learning takes only minutes on a single CPU.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to combine and optimize two cognitive functions - semantic memory (SM) and episodic memory (EM). Specifically: 1. **Combination of semantic memory and episodic memory**: Traditional machine learning, neural network, and artificial intelligence research mainly focuses on tasks that require abilities such as pattern recognition and classification, which correspond to semantic memory (SM). However, the rapid formation of memories of specific experiences, that is, episodic memory (EM), has not received sufficient attention in these studies. The paper proposes a new model - Sparsey, which can efficiently store episodic memory in a single trial and automatically construct semantic memory in the process. 2. **Improving storage efficiency and computational efficiency**: Existing deep - learning models usually add episodic memory as an independent module to the main network, which leads to an increase in the time and energy consumption of data movement. In addition, the episodic memory in these models is stored in the form of local representations and cannot fully utilize the exponential - level storage advantages of distributed representations. Sparsey solves these problems by using sparse distributed representations (SDRs), enabling episodic memory and semantic memory to be stored in the same location simultaneously, thus avoiding the overhead of data movement and enabling an efficient single - trial learning algorithm. 3. **Verifying the effectiveness of the model**: The paper preliminarily verifies the effectiveness of the Sparsey model through experiments on the MNIST handwritten digit recognition and Weizmann video event recognition benchmarks. Although it has not yet reached the state - of - the - art level in terms of classification accuracy, the learning time is very short, and training can be completed on a single CPU in just a few minutes. In summary, this paper aims to propose a new neural network model, Sparsey, which can efficiently store episodic memory in a single trial and automatically construct semantic memory in the process, thus being superior to existing deep - learning models in terms of storage efficiency and computational efficiency.

Superposed Episodic and Semantic Memory via Sparse Distributed Representation

How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier.

Semantic Spatiotemporal Memory Toward 3D Robotic Vision

A computational deep learning approach for establishing long-term declarative episodic memory through one-shot learning

Sparsey™: event recognition via deep hierarchical sparse distributed codes

Spiking representation learning for associative memories

Sparse Coding in a Dual Memory System for Lifelong Learning

Classification and Generation of real-world data with an Associative Memory Model

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

A Hierarchical Organized Memory Model Using Spiking Neurons

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Competitive learning to generate sparse representations for associative memory

Associative Memories via Predictive Coding

Human-like Episodic Memory for Infinite Context LLMs

In-memory Realization of In-situ Few-shot Continual Learning with a Dynamically Evolving Explicit Memory

Sparsified Subgraph Memory for Continual Graph Representation Learning

Sparse Distributed Memory using Spiking Neural Networks on Nengo

Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes

End-to-End Egospheric Spatial Memory

Biologically Plausible Sparse Temporal Word Representations