Abstract:Achieving personalized intelligence at the edge with real-time learning capabilities holds enormous promise in enhancing our daily experiences and helping decision making, planning, and sensing. However, efficient and reliable edge learning remains difficult with current technology due to the lack of personalized data, insufficient hardware capabilities, and inherent challenges posed by online learning. Over time and across multiple developmental stages, the brain has evolved to efficiently incorporate new knowledge by gradually building on previous knowledge. In this work, we emulate the multiple stages of learning with digital neuromorphic technology that simulates the neural and synaptic processes of the brain using two stages of learning. First, a meta-training stage trains the hyperparameters of synaptic plasticity for one-shot learning using a differentiable simulation of the neuromorphic hardware. This meta-training process refines a hardware local three-factor synaptic plasticity rule and its associated hyperparameters to align with the trained task domain. In a subsequent deployment stage, these optimized hyperparameters enable fast, data-efficient, and accurate learning of new classes. We demonstrate our approach using event-driven vision sensor data and the Intel Loihi neuromorphic processor with its plasticity dynamics, achieving real-time one-shot learning of new classes that is vastly improved over transfer learning. Our methodology can be deployed with arbitrary plasticity models and can be applied to situations demanding quick learning and adaptation at the edge, such as navigating unfamiliar environments or learning unexpected categories of data through user engagement.

Towards On-Chip Bayesian Neuromorphic Learning

Neuromorphic Incremental on-chip Learning with Hebbian Weight Consolidation

Improving classification accuracy of feedforward neural networks for spiking neuromorphic chips

A Burst-Dependent Algorithm for Neuromorphic On-Chip Learning of Spiking Neural Networks

Emerging NeoHebbian Dynamics in Forward-Forward Learning: Implications for Neuromorphic Computing

A Design Methodology for Fault-Tolerant Neuromorphic Computing Using Bayesian Neural Network

An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning

Neuromorphic analog circuits for robust on-chip always-on learning in spiking neural networks

Emulating Brain-like Rapid Learning in Neuromorphic Edge Computing

Efficient Spike-Driven Learning With Dendritic Event-Based Processing

A Lightweight Integer-STBP On-Chip Learning Method of Spiking Neural Networks For Edge Processors.

BayesFT: Bayesian Optimization for Fault Tolerant Neural Network Architecture

An error-propagation spiking neural network compatible with neuromorphic processors

Stochastic dendrites enable online learning in mixed-signal neuromorphic processing systems

Edge AI Collaborative Learning: Bayesian Approaches to Uncertainty Estimation

Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

An Edge Neuromorphic Hardware With Fast On-Chip Error-Triggered Learning on Compressive Sensed Spikes

sBSNN: Stochastic-Bits Enabled Binary Spiking Neural Network with On-Chip Learning for Energy Efficient Neuromorphic Computing at the Edge

Implementing Efficient Balanced Networks with Mixed-Signal Spike-Based Learning Circuits

Scalable NoC-based Neuromorphic Hardware Learning and Inference