Abstract:Objective.Implanted devices providing real-time neural activity classification and control are increasingly used to treat neurological disorders, such as epilepsy and Parkinson's disease. Classification performance is critical to identifying brain states appropriate for the therapeutic action (e.g. neural stimulation). However, advanced algorithms that have shown promise in offline studies, in particular deep learning (DL) methods, have not been deployed on resource-restrained neural implants. Here, we designed and optimized three DL models or edge deployment and evaluated their inference performance in a case study of seizure detection.Approach.A deep neural network (DNN), a convolutional neural network (CNN), and a long short-term memory (LSTM) network were designed and trained with TensorFlow to classify ictal, preictal, and interictal phases from the CHB-MIT scalp EEG database. A sliding window based weighted majority voting algorithm was developed to detect seizure events based on each DL model's classification results. After iterative model compression and coefficient quantization, the algorithms were deployed on a general-purpose, off-the-shelf microcontroller for real-time testing. Inference sensitivity, false positive rate (FPR), execution time, memory size, and power consumption were quantified.Main results.For seizure event detection, the sensitivity and FPR for the DNN, CNN, and LSTM models were 87.36%/0.169 h-1, 96.70%/0.102 h-1, and 97.61%/0.071 h-1, respectively. Predicting seizures for early warnings was also feasible. The LSTM model achieved the best overall performance at the expense of the highest power. The DNN model achieved the shortest execution time. The CNN model showed advantages in balanced performance and power with minimum memory requirement. The implemented model compression and quantization achieved a significant saving of power and memory with an accuracy degradation of less than 0.5%.Significance.Inference with embedded DL models achieved performance comparable to many prior implementations that had no time or computational resource limitations. Generic microcontrollers can provide the required memory and computational resources, while model designs can be migrated to application-specific integrated circuits for further optimization and power saving. The results suggest that edge DL inference is a feasible option for future neural implants to improve classification performance and therapeutic outcomes.

Resource-Efficient Neural Network Architectures for Classifying Nerve Cuff Recordings on Implantable Devices

Constructing Lightweight and Efficient Spiking Neural Networks for EEG-based Motor Imagery Classification

Time series classification of multi-channel nerve cuff recordings using deep learning

Closed-Loop Control of Functional Electrical Stimulation Using a Selectively Recording and Bidirectional Nerve Cuff Interface

Artificial Neural Networks-based Real-time Classification of ENG Signals for Implanted Nerve Interfaces

A Neural Network-Based ECG Classification Processor with Exploitation of Heartbeat Similarity

Edge Deep Learning for Neural Implants

A Comparison of Energy-Efficient Seizure Detectors for Implantable Neurostimulation Devices

Selective and Compressive Sensing for Energy-Efficient Implantable Neural Decoding.

An Implantable Wireless Neural Interface System for Simultaneous Recording and Stimulation of Peripheral Nerve with a Single Cuff Electrode

Edge deep learning for neural implants: a case study of seizure detection and prediction

A Neuromorphic Processing System for Low-Power Wearable ECG Classification.

Using Compound Neural Action Potentials for Functional Validation of a High-Density Intraneural Interface: A Preliminary Study

Computationally efficient neural network classifiers for next generation closed loop neuromodulation therapy -- a case study in epilepsy

ANN vs SNN: A case study for Neural Decoding in Implantable Brain-Machine Interfaces

Efficient universal computing architectures for decoding neural activity

A Novel Event-Driven Spiking Convolutional Neural Network for Electromyography Pattern Recognition

NeuralTree: A 256-Channel 0.227-μJ/Class Versatile Neural Activity Classification and Closed-Loop Neuromodulation SoC

Energy-Aware Adaptive Multi-Exit Neural Network Inference Implementation for a Millimeter-Scale Sensing System

NeuralTree: A 256-Channel 0.227-$μ$J/Class Versatile Neural Activity Classification and Closed-Loop Neuromodulation SoC