Abstract:As an important paradigm of spontaneous brain-computer interfaces (BCIs), motor imagery (MI) has been widely used in the fields of neurological rehabilitation and robot control. Recently, researchers have proposed various methods for feature extraction and classification based on MI signals. The decoding model based on deep neural networks (DNNs) has attracted significant attention in the field of MI signal processing. Due to the strict requirements for subjects and experimental environments, it is difficult to collect large-scale and high-quality electroencephalogram (EEG) data. However, the performance of a deep learning model depends directly on the size of the datasets. Therefore, the decoding of MI-EEG signals based on a DNN has proven highly challenging in practice. Based on this, we investigated the performance of different data augmentation (DA) methods for the classification of MI data using a DNN. First, we transformed the time series signals into spectrogram images using a short-time Fourier transform (STFT). Then, we evaluated and compared the performance of different DA methods for this spectrogram data. Next, we developed a convolutional neural network (CNN) to classify the MI signals and compared the classification performance of after DA. The Fréchet inception distance (FID) was used to evaluate the quality of the generated data (GD) and the classification accuracy, and mean kappa values were used to explore the best CNN-DA method. In addition, analysis of variance (ANOVA) and paired t-tests were used to assess the significance of the results. The results showed that the deep convolutional generative adversarial network (DCGAN) provided better augmentation performance than traditional DA methods: geometric transformation (GT), autoencoder (AE), and variational autoencoder (VAE) (p < 0.01). Public datasets of the BCI competition IV (datasets 1 and 2b) were used to verify the classification performance. Improvements in the classification accuracies of 17% and 21% (p < 0.01) were observed after DA for the two datasets. In addition, the hybrid network CNN-DCGAN outperformed the other classification methods, with average kappa values of 0.564 and 0.677 for the two datasets.

A Novel Data Augmentation Approach Using Mask Encoding for Deep Learning-Based Asynchronous SSVEP-BCI

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

A Deep Learning Method for Improving the Classification Accuracy of SSMVEP-Based BCI

Improving Motor Imagery EEG Classification by CNN with Data Augmentation

A Novel Classification Algorithm for MI-EEG Based on Deep Learning

EEGGAN-Net: enhancing EEG signal classification through data augmentation

Data Augmentation for Deep Neural Networks Model in EEG Classification Task: A Review

An efficient CNN-LSTM Network with spectral normalization and label smoothing technologies for SSVEP frequency recognition

An amplitudes-perturbation data augmentation method in convolutional neural networks for EEG decoding

Enhancing EEG Motor Imagery Decoding Performance Via Deep Temporal-domain Information Extraction

A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

A Deep Transfer Convolutional Neural Network Framework for EEG Signal Classification

Compact CNN with Dynamic Window for SSVEP-based BCIs

Sample-Based Data Augmentation Based on Electroencephalogram Intrinsic Characteristics

Dynamic decomposition graph convolutional neural network for SSVEP-based brain-computer interface

Data augmentation for Convolutional LSTM based brain computer interface system

Data Augmentation for Motor Imagery Signal Classification Based on a Hybrid Neural Network.

Dual-TSST: A Dual-Branch Temporal-Spectral-Spatial Transformer Model for EEG Decoding

A Novel End-to-End Neural Network for SSVEP-Based Brain-Computer Interfaces

An Intelligent EEG Classification Methodology Based on Sparse Representation Enhanced Deep Learning Networks