Abstract:Objective.Implanted devices providing real-time neural activity classification and control are increasingly used to treat neurological disorders, such as epilepsy and Parkinson's disease. Classification performance is critical to identifying brain states appropriate for the therapeutic action (e.g. neural stimulation). However, advanced algorithms that have shown promise in offline studies, in particular deep learning (DL) methods, have not been deployed on resource-restrained neural implants. Here, we designed and optimized three DL models or edge deployment and evaluated their inference performance in a case study of seizure detection.Approach.A deep neural network (DNN), a convolutional neural network (CNN), and a long short-term memory (LSTM) network were designed and trained with TensorFlow to classify ictal, preictal, and interictal phases from the CHB-MIT scalp EEG database. A sliding window based weighted majority voting algorithm was developed to detect seizure events based on each DL model's classification results. After iterative model compression and coefficient quantization, the algorithms were deployed on a general-purpose, off-the-shelf microcontroller for real-time testing. Inference sensitivity, false positive rate (FPR), execution time, memory size, and power consumption were quantified.Main results.For seizure event detection, the sensitivity and FPR for the DNN, CNN, and LSTM models were 87.36%/0.169 h-1, 96.70%/0.102 h-1, and 97.61%/0.071 h-1, respectively. Predicting seizures for early warnings was also feasible. The LSTM model achieved the best overall performance at the expense of the highest power. The DNN model achieved the shortest execution time. The CNN model showed advantages in balanced performance and power with minimum memory requirement. The implemented model compression and quantization achieved a significant saving of power and memory with an accuracy degradation of less than 0.5%.Significance.Inference with embedded DL models achieved performance comparable to many prior implementations that had no time or computational resource limitations. Generic microcontrollers can provide the required memory and computational resources, while model designs can be migrated to application-specific integrated circuits for further optimization and power saving. The results suggest that edge DL inference is a feasible option for future neural implants to improve classification performance and therapeutic outcomes.

Deep Neural Network for Direct Prediction of Analytic Signals from Neural Oscillations

Real-Time Epileptic Seizure Detection Based on Deep Learning.

A Deep Fourier Neural Network for Seizure Prediction Using Convolutional Neural Network and Ratios of Spectral Power.

A Novel Real-time Phase Prediction Network in EEG Rhythm

Interpretable Deep Neural Networks for Single-Trial EEG Classification

Prediction of dMRI signals with neural architecture search

Beyond the Surface: Revealing the Depths of Brain Activity by Predicting fMRI from EEG with Deep Learning

Predicting EEG Responses to Attended Speech via Deep Neural Networks for Speech

Prediction For High Risk Clinical Symptoms Of Epilepsy Based On Deep Learning Algorithm

Electroencephalogram (EEG) Classification using a bio-inspired Deep Oscillatory Neural Network

Artificial neural network-based rapid predictor of biological nerve fiber activation for DBS applications

Edge deep learning for neural implants: a case study of seizure detection and prediction

Real-Time Non-Invasive Imaging and Detection of Spreading Depolarizations through EEG: An Ultra-Light Explainable Deep Learning Approach

Seizure Prediction Using Directed Transfer Function and Convolution Neural Network on Intracranial EEG

Motion prediction using brain waves based on artificial intelligence deep learning recurrent neural network

Time-Series Prediction of the Oscillatory Phase of EEG Signals Using the Least Mean Square Algorithm-Based AR Model

Deep Classification of Epileptic Signals

EEG Enhancement by Auto DNNs with Regularization of Spatial Feature Loss

Edge Deep Learning for Neural Implants

Deep learning analysis of intracranial EEG for recognizing drug effects and mechanisms of action

Leveraging sinusoidal representation networks to predict fMRI signals from EEG