Abstract:OBJECTIVE: Brain-computer interfaces (BCI) enable direct communication with a computer, using neural activity as the control signal. This neural signal is generally chosen from a variety of well-studied electroencephalogram (EEG) signals. For a given BCI paradigm, feature extractors and classifiers are tailored to the distinct characteristics of its expected EEG control signal, limiting its application to that specific signal. Convolutional neural networks (CNNs), which have been used in computer vision and speech recognition to perform automatic feature extraction and classification, have successfully been applied to EEG-based BCIs; however, they have mainly been applied to single BCI paradigms and thus it remains unclear how these architectures generalize to other paradigms. Here, we ask if we can design a single CNN architecture to accurately classify EEG signals from different BCI paradigms, while simultaneously being as compact as possible.APPROACH: In this work we introduce EEGNet, a compact convolutional neural network for EEG-based BCIs. We introduce the use of depthwise and separable convolutions to construct an EEG-specific model which encapsulates well-known EEG feature extraction concepts for BCI. We compare EEGNet, both for within-subject and cross-subject classification, to current state-of-the-art approaches across four BCI paradigms: P300 visual-evoked potentials, error-related negativity responses (ERN), movement-related cortical potentials (MRCP), and sensory motor rhythms (SMR).MAIN RESULTS: We show that EEGNet generalizes across paradigms better than, and achieves comparably high performance to, the reference algorithms when only limited training data is available across all tested paradigms. In addition, we demonstrate three different approaches to visualize the contents of a trained EEGNet model to enable interpretation of the learned features.SIGNIFICANCE: Our results suggest that EEGNet is robust enough to learn a wide variety of interpretable features over a range of BCI tasks. Our models can be found at: https://github.com/vlawhern/arl-eegmodels.

Limited but consistent gains in adversarial robustness by co-training object recognition models with human EEG

Adversarial Training for the Adversarial Robustness of EEG-Based Brain-Computer Interfaces

Adversarial Neural Network Training for Secure and Robust Brain-to-Brain Communication

Seeing eye-to-eye? A comparison of object recognition performance in humans and deep convolutional neural networks under image manipulation

Different Spectral Representations in Optimized Artificial Neural Networks and Brains

Leveraging the Human Ventral Visual Stream to Improve Neural Network Robustness

Achieving More Human Brain-Like Vision via Human EEG Representational Alignment

Decorrelative Network Architecture for Robust Electrocardiogram Classification

Alignment-Based Adversarial Training (ABAT) for Improving the Robustness and Accuracy of EEG-Based BCIs

Human Eyes Inspired Recurrent Neural Networks are More Robust Against Adversarial Noises

An Extended Study of Human-like Behavior under Adversarial Training

Dissociable Neural Representations of Adversarially Perturbed Images in Convolutional Neural Networks and the Human Brain

Assessing robustness to adversarial attacks in attention-based networks: Case of EEG-based motor imagery classification

Human Eyes-Inspired Recurrent Neural Networks Are More Robust Against Adversarial Noises

Inter-participant transfer learning with attention based domain adversarial training for P300 detection

Strengthening Robustness Under Adversarial Attacks Using Brain Visual Codes

Learning From Brains How to Regularize Machines

Improved object recognition using neural networks trained to mimic the brain's statistical properties

EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces

Towards a Network Expansion Approach for Reliable Brain-Computer Interface

Exploiting Multiple EEG Data Domains with Adversarial Learning