Abstract:OBJECTIVE: Brain-computer interfaces (BCI) enable direct communication with a computer, using neural activity as the control signal. This neural signal is generally chosen from a variety of well-studied electroencephalogram (EEG) signals. For a given BCI paradigm, feature extractors and classifiers are tailored to the distinct characteristics of its expected EEG control signal, limiting its application to that specific signal. Convolutional neural networks (CNNs), which have been used in computer vision and speech recognition to perform automatic feature extraction and classification, have successfully been applied to EEG-based BCIs; however, they have mainly been applied to single BCI paradigms and thus it remains unclear how these architectures generalize to other paradigms. Here, we ask if we can design a single CNN architecture to accurately classify EEG signals from different BCI paradigms, while simultaneously being as compact as possible.APPROACH: In this work we introduce EEGNet, a compact convolutional neural network for EEG-based BCIs. We introduce the use of depthwise and separable convolutions to construct an EEG-specific model which encapsulates well-known EEG feature extraction concepts for BCI. We compare EEGNet, both for within-subject and cross-subject classification, to current state-of-the-art approaches across four BCI paradigms: P300 visual-evoked potentials, error-related negativity responses (ERN), movement-related cortical potentials (MRCP), and sensory motor rhythms (SMR).MAIN RESULTS: We show that EEGNet generalizes across paradigms better than, and achieves comparably high performance to, the reference algorithms when only limited training data is available across all tested paradigms. In addition, we demonstrate three different approaches to visualize the contents of a trained EEGNet model to enable interpretation of the learned features.SIGNIFICANCE: Our results suggest that EEGNet is robust enough to learn a wide variety of interpretable features over a range of BCI tasks. Our models can be found at: https://github.com/vlawhern/arl-eegmodels.

A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

DEEP TRANSFER LEARNING FOR EEG-BASED BRAIN COMPUTER INTERFACE

EEGNet-based multi-source domain filter for BCI transfer learning

A transfer learning framework based on motor imagery rehabilitation for stroke

Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI

Ensemble or pool: A comprehensive study on transfer learning for c-VEP BCI during interpersonal interaction

Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network

Domain Adaptive Algorithm Based on Multi-Manifold Embedded Distributed Alignment for Brain-Computer Interfaces

EEG Decoding for Datasets with Heterogenous Electrode Configurations using Transfer Learning Graph Neural Networks

EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces

EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces

An Unsupervised Deep-Transfer-Learning-Based Motor Imagery EEG Classification Scheme for Brain–Computer Interface

Cross-Modal Transfer Learning From EEG to Functional Near-Infrared Spectroscopy for Classification Task in Brain-Computer Interface System

An intertwined neural network model for EEG classification in brain-computer interfaces

IFBCLNet: Spatio-temporal frequency feature extraction-based MI-EEG classification convolutional network

MI-MBFT: Superior Motor Imagery Decoding of Raw EEG Data Based on a Multi-Branch and Fusion Transformer Framework

Personalized Continual EEG Decoding Framework for Knowledge Retention and Transfer

Hybrid deep neural network using transfer learning for EEG motor imagery decoding

EEG-Based Motor Imagery Recognition Framework via Multisubject Dynamic Transfer and Iterative Self-Training

Learning joint space-time-frequency features for EEG decoding on small labeled data

End-to-End Deep Transfer Learning for Calibration-free Motor Imagery Brain Computer Interfaces