Abstract:Background: The adoption of convolutional neural networks (CNNs) for decoding electroencephalogram (EEG)-based motor imagery (MI) in brain-computer interfaces has significantly increased recently. The effective extraction of motor imagery features is vital due to the variability among individuals and temporal states. Methods: This study introduces a novel network architecture, 3D-convolutional neural network-generative adversarial network (3D-CNN-GAN), for decoding both within-session and cross-session motor imagery. Initially, EEG signals were extracted over various time intervals using a sliding window technique, capturing temporal, frequency, and phase features to construct a temporal-frequency-phase feature (TFPF) three-dimensional feature map. Generative adversarial networks (GANs) were then employed to synthesize artificial data, which, when combined with the original datasets, expanded the data capacity and enhanced functional connectivity. Moreover, GANs proved capable of learning and amplifying the brain connectivity patterns present in the existing data, generating more distinctive brain network features. A compact, two-layer 3D-CNN model was subsequently developed to efficiently decode these TFPF features. Results: Taking into account session and individual differences in EEG data, tests were conducted on both the public GigaDB dataset and the SHU laboratory dataset. On the GigaDB dataset, our 3D-CNN and 3D-CNN-GAN models achieved two-class within-session motor imagery accuracies of 76.49% and 77.03%, respectively, demonstrating the algorithm's effectiveness and the improvement provided by data augmentation. Furthermore, on the SHU dataset, the 3D-CNN and 3D-CNN-GAN models yielded two-class within-session motor imagery accuracies of 67.64% and 71.63%, and cross-session motor imagery accuracies of 58.06% and 63.04%, respectively. Conclusions: The 3D-CNN-GAN algorithm significantly enhances the generalizability of EEG-based motor imagery brain-computer interfaces (BCIs). Additionally, this research offers valuable insights into the potential applications of motor imagery BCIs.

Multi-Class Image Generation from EEG Features with Conditional Generative Adversarial Networks

Neurocognition-inspired Design with Machine Learning

Eeg Based Visual Classification with Multi-Feature Joint Learning

EEG-Based Feature Classification Combining 3D-Convolutional Neural Networks with Generative Adversarial Networks for Motor Imagery

EEGGAN-Net: enhancing EEG signal classification through data augmentation

A GAN model encoded by CapsEEGNet for visual EEG encoding and image reproduction

A Visual Characteristic Land-Scape Design for EEG Signal Based on LSTM-GAN

EEG2IMAGE: Image Reconstruction from EEG Brain Signals

Improving brain computer interface performance by data augmentation with conditional Deep Convolutional Generative Adversarial Networks

NeuroGAN: image reconstruction from EEG signals via an attention-based GAN

NECOMIMI: Neural-Cognitive Multimodal EEG-informed Image Generation with Diffusion Models

Human-in-the-loop design with machine learning

Common Spatial Generative Adversarial Networks based EEG Data Augmentation for Cross-Subject Brain-Computer Interface

A Data Augmentation Method for Motor Imagery EEG Signals Based on DCGAN-GP Network

Improving classification performance of motor imagery BCI through EEG data augmentation with conditional generative adversarial networks

Decoding human brain activity with deep learning

MindCeive: Perceiving human imagination using CNN-GRU and GANs

EEG-DG: A Multi-Source Domain Generalization Framework for Motor Imagery EEG Classification

Classification of Left-Versus Right-Hand Motor Imagery in Stroke Patients Using Supplementary Data Generated by CycleGAN

BrainDreamer: Reasoning-Coherent and Controllable Image Generation from EEG Brain Signals via Language Guidance

See What You See: Self-supervised Cross-modal Retrieval of Visual Stimuli from Brain Activity