Abstract:Objective.Implanted devices providing real-time neural activity classification and control are increasingly used to treat neurological disorders, such as epilepsy and Parkinson's disease. Classification performance is critical to identifying brain states appropriate for the therapeutic action (e.g. neural stimulation). However, advanced algorithms that have shown promise in offline studies, in particular deep learning (DL) methods, have not been deployed on resource-restrained neural implants. Here, we designed and optimized three DL models or edge deployment and evaluated their inference performance in a case study of seizure detection.Approach.A deep neural network (DNN), a convolutional neural network (CNN), and a long short-term memory (LSTM) network were designed and trained with TensorFlow to classify ictal, preictal, and interictal phases from the CHB-MIT scalp EEG database. A sliding window based weighted majority voting algorithm was developed to detect seizure events based on each DL model's classification results. After iterative model compression and coefficient quantization, the algorithms were deployed on a general-purpose, off-the-shelf microcontroller for real-time testing. Inference sensitivity, false positive rate (FPR), execution time, memory size, and power consumption were quantified.Main results.For seizure event detection, the sensitivity and FPR for the DNN, CNN, and LSTM models were 87.36%/0.169 h-1, 96.70%/0.102 h-1, and 97.61%/0.071 h-1, respectively. Predicting seizures for early warnings was also feasible. The LSTM model achieved the best overall performance at the expense of the highest power. The DNN model achieved the shortest execution time. The CNN model showed advantages in balanced performance and power with minimum memory requirement. The implemented model compression and quantization achieved a significant saving of power and memory with an accuracy degradation of less than 0.5%.Significance.Inference with embedded DL models achieved performance comparable to many prior implementations that had no time or computational resource limitations. Generic microcontrollers can provide the required memory and computational resources, while model designs can be migrated to application-specific integrated circuits for further optimization and power saving. The results suggest that edge DL inference is a feasible option for future neural implants to improve classification performance and therapeutic outcomes.

Performance Evaluation of Embedded Image Classification Models Using Edge Impulse for Application on Medical Images

Edge Segmentation: Empowering Mobile Telemedicine with Compressed Cellular Neural Networks

Energy efficiency in Edge TPU vs. embedded GPU for computer-aided medical imaging segmentation and classification

Energy Efficiency of Machine Learning in Embedded Systems Using Neuromorphic Hardware

EdgeMedNet: Lightweight and Accurate U-Net for Implementing Efficient Medical Image Segmentation on Edge Devices

Edge Deep Learning for Neural Implants

Edge deep learning for neural implants: a case study of seizure detection and prediction

ML-MCU: A Framework to Train ML Classifiers on MCU-based IoT Edge Devices

Machine Learning on Mainstream Microcontrollers

Convolutional neural network for bio-medical image segmentation with hardware acceleration

Edge Computing for AI-Based Brain MRI Applications: A Critical Evaluation of Real-Time Classification and Segmentation

Edge Artificial Intelligence: Real-Time Noninvasive Technique for Vital Signs of Myocardial Infarction Recognition Using Jetson Nano

Image Classification on IoT Edge Devices: Profiling and Modeling

Towards Machine Learning and Inference for Resource-constrained MCUs

Diagnosing Clinical Diseases Using an Edge-Enabled Deep Learning Technology

Evaluation of a Machine Learning Algorithm to Classify Ultrasonic Transducer Misalignment and Deployment Using TinyML

Scalable Machine Learning Architecture for Neonatal Seizure Detection on Ultra-Edge Devices

Embeddings are all you need! Achieving High Performance Medical Image Classification through Training-Free Embedding Analysis

A Method for Medical Data Analysis Using the LogNNet for Clinical Decision Support Systems and Edge Computing in Healthcare

Deep Learning Frameworks Evaluation for Image Classification on Resource Constrained Device

Plant Disease Identification Using Machine Learning Algorithms on Single-Board Computers in IoT Environments