Abstract:Objective: This work explores use of a few-shot transfer learning method to train and implement a convolutional spiking neural network (CSNN) on a BrainChip Akida AKD1000 neuromorphic system-on-chip for developing individual-level, instead of traditionally used group-level, models using electroencephalographic data. Main Results: Efficacy of the above methodology to develop individual-specific braking intention predictive models by rapidly adapting the group-level model in as few as three training epochs while achieving at least 90% accuracy, true positive rate and true negative rate is presented. Further, results show the energy-efficiency of the neuromorphic hardware through a power reduction of over 97% with only a $1.3* increase in latency when using the Akida AKD1000 processor for network inference compared to an Intel Xeon central processing unit. Similar results were obtained in a subsequent ablation study using a subset of five out of 19 channels.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to use few - shot transfer learning to train and implement Convolutional Spiking Neural Networks (CSNN) on neuromorphic hardware in order to develop an individual - specific braking intention prediction model, rather than the traditional group - level model. Specifically, the research objectives are: 1. **Personalized Model Development**: Traditional methods are usually based on group data to train models, and these models may not be well - adapted to individual differences. This research aims to quickly adjust the group model by using a small amount of individual data, thereby customizing a specific braking intention prediction model for each individual. 2. **Efficiency and Real - Time Application**: In order to enable the model to run in real - time in a resource - constrained environment, the research emphasizes the energy - efficiency advantages of neuromorphic hardware (such as BrainChip Akida AKD1000). This hardware not only has low - power consumption characteristics but also can support online learning, allowing the model to be updated according to new data. 3. **Experimental Verification**: The research verifies the effectiveness of the proposed method by collecting electroencephalogram (EEG) data of participants in different driving scenarios. These scenarios include: - **Baseline Environment**: Only audio cues, without other distractions. - **Fatigue and Cognitive Distraction Environment**: Added elements of physical fatigue and cognitive distraction. - **Visual Cue Environment**: Brake actions are cued by traffic lights. ### Method Overview The research method can be divided into three main steps: 1. **Group Model Training**: First, a Convolutional Neural Network (CNN) is trained on the CPU using group data, and then performance loss is reduced through quantization and quantization - aware retraining, and the model is converted into a form compatible with Akida AKD1000. 2. **Model Mapping to Neuromorphic Hardware**: Map the trained CNN model to the Akida AKD1000 processor to ensure that it can run on neuromorphic hardware. 3. **Individualized Model Fine - Tuning**: Use the online Akida edge - learning algorithm to train only the last - layer decision - making layer of the model with a small amount of individual data, thereby creating a personalized braking intention prediction model. ### Main Results - This method can achieve at least 90% accuracy, true positive rate, and true negative rate within just three training cycles. - When using the Akida AKD1000 processor for inference, compared with the Intel Xeon CPU, the energy consumption is reduced by more than 97%, and the latency is only increased by 1.3 times. - In the subsequent ablation study, similar results were obtained even when only 5 out of 19 channels were used. ### Significance This work shows how to achieve efficient few - shot transfer learning on neuromorphic hardware, especially in real - time applications, such as EEG - based Advanced Driver Assistance Systems (ADAS). Through this method, not only can the degree of model personalization be increased, but also the energy consumption can be significantly reduced, making this type of technology more suitable for practical applications.

Few-Shot Transfer Learning for Individualized Braking Intent Detection on Neuromorphic Hardware

Convolutional spiking neural networks for intent detection based on anticipatory brain potentials using electroencephalogram

Improving classification accuracy of feedforward neural networks for spiking neuromorphic chips

Real-Time Target Tracking System with Spiking Neural Networks Implemented on Neuromorphic Chips

Low-power event-based face detection with asynchronous neuromorphic hardware

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

Neuromorphic deep spiking neural networks for seizure detection

Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware

TripleBrain: An Edge Neuromorphic Architecture for High-accuracy Single-layer Spiking Neural Network with On-chip Self-organizing and Reinforcement Learning

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Brain-Inspired Hardware for Artificial Intelligence: Accelerated Learning in a Physical-Model Spiking Neural Network

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms

Edge Deep Learning for Neural Implants

ReplaceNet: real-time replacement of a biological neural circuit with a hardware-assisted spiking neural network

Edge deep learning for neural implants: a case study of seizure detection and prediction

Autologous Fat Graft in Scar Treatment

An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning

Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks

Neuromorphic Overparameterisation and Few-Shot Learning in Multilayer Physical Neural Networks

One-Shot Federated Learning with Neuromorphic Processors