Abstract:OBJECTIVE: Brain-computer interfaces (BCI) enable direct communication with a computer, using neural activity as the control signal. This neural signal is generally chosen from a variety of well-studied electroencephalogram (EEG) signals. For a given BCI paradigm, feature extractors and classifiers are tailored to the distinct characteristics of its expected EEG control signal, limiting its application to that specific signal. Convolutional neural networks (CNNs), which have been used in computer vision and speech recognition to perform automatic feature extraction and classification, have successfully been applied to EEG-based BCIs; however, they have mainly been applied to single BCI paradigms and thus it remains unclear how these architectures generalize to other paradigms. Here, we ask if we can design a single CNN architecture to accurately classify EEG signals from different BCI paradigms, while simultaneously being as compact as possible.APPROACH: In this work we introduce EEGNet, a compact convolutional neural network for EEG-based BCIs. We introduce the use of depthwise and separable convolutions to construct an EEG-specific model which encapsulates well-known EEG feature extraction concepts for BCI. We compare EEGNet, both for within-subject and cross-subject classification, to current state-of-the-art approaches across four BCI paradigms: P300 visual-evoked potentials, error-related negativity responses (ERN), movement-related cortical potentials (MRCP), and sensory motor rhythms (SMR).MAIN RESULTS: We show that EEGNet generalizes across paradigms better than, and achieves comparably high performance to, the reference algorithms when only limited training data is available across all tested paradigms. In addition, we demonstrate three different approaches to visualize the contents of a trained EEGNet model to enable interpretation of the learned features.SIGNIFICANCE: Our results suggest that EEGNet is robust enough to learn a wide variety of interpretable features over a range of BCI tasks. Our models can be found at: https://github.com/vlawhern/arl-eegmodels.

A Contrastive Learning Based Convolutional Neural Network for ERP Brain-Computer Interfaces

A Robust 3D-Convolutional Neural Network-Based Electroencephalogram Decoding Model for the Intra-Individual Difference

Rapid Face Recognition Based On Single-Trial Event-Related Potential Detection Over Multiple Brains

P300 Event-Related Potential Detection Using One-Dimensional Convolutional Capsule Networks.

High-performance Deep Neural Network Pretrained with Contrastive Learning for Asynchronous High-frequency c-VEP Detection.

A Rapid Face Recognition Bci System Using Single-Trial Erp

MOCNN: A Multiscale Deep Convolutional Neural Network for ERP-Based Brain-Computer Interfaces

Capsule Network for ERP Detection in Brain-Computer Interface

A auto-segmented multi-time window dual-scale neural network for brain-computer interfaces based on event-related potentials

Bayesian Signal Matching for Transfer Learning in ERP-Based Brain Computer Interface

Learning Invariant Patterns Based on a Convolutional Neural Network and Big Electroencephalography Data for Subject-Independent P300 Brain-Computer Interfaces

A Hybrid Network for ERP Detection and Analysis Based on Restricted Boltzmann Machine

A Novel Neural Network for P300 Brain-Computer Interface Signal Recognition

EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces

Application of CNN Classifier for Somatosensory ERP-Based Brain-Computer Interface

An Auto-Segmented Multi-Time Window Dual-Scale Neural Network for Brain-Computer Interfaces Based on Event-Related Potentials

Discriminative canonical pattern matching for single-trial classification of ERP components.

A Linear-Attention-combined Convolutional Neural Network for EEG-based Visual Stimulus Recognition

A P300-Detection Method Based on Logistic Regression and a Convolutional Neural Network

EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces

A Spatiotemporal Approach to N170 Detection with Application to Brain-Computer Interfaces.