Abstract:Recently, the use of bio-inspired learning techniques such as Hebbian learning and its closely-related Spike-Timing-Dependent Plasticity (STDP) variant have drawn significant attention for the design of compute-efficient AI systems that can continuously learn on-line at the edge. A key differentiating factor regarding this emerging class of neuromorphic continual learning system lies in the fact that learning must be carried using a data stream received in its natural order, as opposed to conventional gradient-based offline training, where a static training dataset is assumed available a priori and randomly shuffled to make the training set independent and identically distributed (i.i.d). In contrast, the emerging class of neuromorphic continual learning systems covered in this survey must learn to integrate new information on the fly in a non-i.i.d manner, which makes these systems subject to catastrophic forgetting. In order to build the next generation of neuromorphic AI systems that can continuously learn at the edge, a growing number of research groups are studying the use of Sparse and Predictive Coding-based Hebbian neural network architectures and the related Spiking Neural Networks (SNNs) equipped with STDP learning. However, since this research field is still emerging, there is a need for providing a holistic view of the different approaches proposed in the literature so far. To this end, this survey covers a number of recent works in the field of neuromorphic continual learning based on state-of-the-art Sparse and Predictive Coding technology; provides background theory to help interested researchers quickly learn the key concepts; and discusses important future research questions in light of the different works covered in this paper. It is hoped that this survey will contribute towards future research in the field of neuromorphic continual learning.

Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)

Efficient Spike-Driven Learning With Dendritic Event-Based Processing

Learning Delays Through Gradients and Structure: Emergence of Spatiotemporal Patterns in Spiking Neural Networks

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Continual Learning with Hebbian Plasticity in Sparse and Predictive Coding Networks: A Survey and Perspective

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

NADOL: Neuromorphic Architecture for Spike-Driven Online Learning by Dendrites

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

PC-SNN: Supervised Learning with Local Hebbian Synaptic Plasticity Based on Predictive Coding in Spiking Neural Networks

Continual learning under domain transfer with sparse synaptic bursting

Supervised Learning with First-to-Spike Decoding in Multilayer Spiking Neural Networks

Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

Active Dendrites Enable Efficient Continual Learning in Time-To-First-Spike Neural Networks

Using local plasticity rules to train recurrent neural networks

Continual Learning with Deep Artificial Neurons

Towards deep learning with spiking neurons in energy based models with contrastive Hebbian plasticity

Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Efficient dendritic learning as an alternative to synaptic plasticity hypothesis

Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning