Abstract:Convolutional neural networks (CNNs), which automatically learn features from raw data to approximate functions, are being increasingly applied to the end-to-end analysis of electroencephalographic (EEG) signals, especially for decoding brain states in brain-computer interfaces (BCIs). Nevertheless, CNNs introduce a large number of trainable parameters, may require long training times, and lack in interpretability of learned features. The aim of this study is to propose a CNN design for P300 decoding with emphasis on its lightweight design while guaranteeing high performance, on the effects of different training strategies, and on the use of post-hoc techniques to explain network decisions. The proposed design, named MS-EEGNet, learned temporal features in two different timescales (i.e., multi-scale, MS) in an efficient and optimized (in terms of trainable parameters) way, and was validated on three P300 datasets. The CNN was trained using different strategies (within-participant and within-session, within-participant and cross-session, leave-one-subject-out, transfer learning) and was compared with several state-of-the-art (SOA) algorithms. Furthermore, variants of the baseline MS-EEGNet were analyzed to evaluate the impact of different hyper-parameters on performance. Lastly, saliency maps were used to derive representations of the relevant spatio-temporal features that drove CNN decisions. MS-EEGNet was the lightest CNN compared with the tested SOA CNNs, despite its multiple timescales, and significantly outperformed the SOA algorithms. Post-hoc hyper-parameter analysis confirmed the benefits of the innovative aspects of MS-EEGNet. Furthermore, MS-EEGNet did benefit from transfer learning, especially using a low number of training examples, suggesting that the proposed approach could be used in BCIs to accurately decode the P300 event while reducing calibration times. Representations derived from the saliency maps matched the P300 spatio-temporal distribution, further validating the proposed decoding approach. This study, by specifically addressing the aspects of lightweight design, transfer learning, and interpretability, can contribute to advance the development of deep learning algorithms for P300-based BCIs.

Interpretable and lightweight convolutional neural network for EEG decoding: Application to movement execution and imagination

Constructing Lightweight and Efficient Spiking Neural Networks for EEG-based Motor Imagery Classification

A channel-mixing convolutional neural network for motor imagery EEG decoding and feature visualization

A Lightweight Multi-Scale Convolutional Neural Network for P300 Decoding: Analysis of Training Strategies and Uncovering of Network Decision

Sinc-based convolutional neural networks for EEG-BCI-based motor imagery classification

Dimensionality Reduction of Local Field Potential Features with Convolution Neural Network in Neural Decoding: A Pilot Study

Portable deep-learning decoder for motor imaginary EEG signals based on a novel compact convolutional neural network incorporating spatial-attention mechanism

Deep Convolutional Neural Network for EEG-Based Motor Decoding

EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces

Exploring EEG-based motor imagery decoding: a dual approach using spatial features and spectro-spatial Deep Learning model IFNet

EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces

An intertwined neural network model for EEG classification in brain-computer interfaces

EEG classification using a simple CNN model for imagined and executed motor signals

BrainWave-Scattering Net: A lightweight network for EEG-based motor imagery recognition

Deep learning with convolutional neural networks for EEG decoding and visualization

GCNs-Net: A Graph Convolutional Neural Network Approach for Decoding Time-resolved EEG Motor Imagery Signals

A Multi-Domain Convolutional Neural Network for EEG-Based Motor Imagery Decoding

Attention-based convolutional neural network with multi-modal temporal information fusion for motor imagery EEG decoding

SincMSNet: A Sinc filter convolutional neural network for EEG motor imagery classification

MFRC-Net: Multi-Scale Feature Residual Convolutional Neural Network for Motor Imagery Decoding

Decoding visual brain representations from electroencephalography through Knowledge Distillation and latent diffusion models