Abstract:As an important paradigm of spontaneous brain-computer interfaces (BCIs), motor imagery (MI) has been widely used in the fields of neurological rehabilitation and robot control. Recently, researchers have proposed various methods for feature extraction and classification based on MI signals. The decoding model based on deep neural networks (DNNs) has attracted significant attention in the field of MI signal processing. Due to the strict requirements for subjects and experimental environments, it is difficult to collect large-scale and high-quality electroencephalogram (EEG) data. However, the performance of a deep learning model depends directly on the size of the datasets. Therefore, the decoding of MI-EEG signals based on a DNN has proven highly challenging in practice. Based on this, we investigated the performance of different data augmentation (DA) methods for the classification of MI data using a DNN. First, we transformed the time series signals into spectrogram images using a short-time Fourier transform (STFT). Then, we evaluated and compared the performance of different DA methods for this spectrogram data. Next, we developed a convolutional neural network (CNN) to classify the MI signals and compared the classification performance of after DA. The Fréchet inception distance (FID) was used to evaluate the quality of the generated data (GD) and the classification accuracy, and mean kappa values were used to explore the best CNN-DA method. In addition, analysis of variance (ANOVA) and paired t-tests were used to assess the significance of the results. The results showed that the deep convolutional generative adversarial network (DCGAN) provided better augmentation performance than traditional DA methods: geometric transformation (GT), autoencoder (AE), and variational autoencoder (VAE) (p < 0.01). Public datasets of the BCI competition IV (datasets 1 and 2b) were used to verify the classification performance. Improvements in the classification accuracies of 17% and 21% (p < 0.01) were observed after DA for the two datasets. In addition, the hybrid network CNN-DCGAN outperformed the other classification methods, with average kappa values of 0.564 and 0.677 for the two datasets.

Diffusion models-based motor imagery EEG sample augmentation via mixup strategy

Component-mixing strategy: A decomposition-based data augmentation algorithm for motor imagery signals

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

Data Augmentation for Motor Imagery Signal Classification Based on a Hybrid Neural Network.

Neurophysiologically Meaningful Motor Imagery EEG Simulation With Applications to Data Augmentation

BDAN-SPD: A Brain Decoding Adversarial Network Guided by Spatiotemporal Pattern Differences for Cross-Subject MI-BCI

Enhancing EEG Motor Imagery Decoding Performance Via Deep Temporal-domain Information Extraction

Improved Motor Imagery EEG Interdevice Decoding by Reweighting Multisource Domain Samples.

MI-DAGSC: A domain adaptation approach incorporating comprehensive information from MI-EEG signals

A Spatial-Spectral and Temporal Dual Prototype Network for Motor Imagery Brain-Computer Interface

Improving classification performance of motor imagery BCI through EEG data augmentation with conditional generative adversarial networks

Enhancement of lower limb motor imagery ability via dual-level multimodal stimulation and sparse spatial pattern decoding method

Three-stage transfer learning for motor imagery EEG recognition

Motor Imagery EEG Classification Based on Riemannian Sparse Optimization and Dempster-Shafer Fusion of Multi-Time-Frequency Patterns

Decoding Motor Imagery Tasks Using ESI and Hybrid Feature CNN

MI-MBFT: Superior Motor Imagery Decoding of Raw EEG Data Based on a Multi-Branch and Fusion Transformer Framework

Improved Motor Imagery EEG Inter-device Decoding by Reweighting Multi-source Domain Samples

Classification of Motor Imagery EEG Signals Based on Data Augmentation and Convolutional Neural Networks

A Data Augmentation Method for Motor Imagery EEG Signals Based on DCGAN-GP Network

EISATC-Fusion: Inception Self-Attention Temporal Convolutional Network Fusion for Motor Imagery EEG Decoding

An Algorithm for Motor Imagery Classification Based on Transfer Learning and Feature Fusion