Extended Random Sets for Knowledge Discovery in Information Systems

Yuefeng Li

DOI: https://doi.org/10.1007/3-540-39205-X_87

2003-05-26

Abstract:

What problem does this paper attempt to address?

A Data Augmentation Method for Motor Imagery EEG Signals Based on DCGAN-GP Network

Xiuli Du,Xiaohui Ding,Meiling Xi,Yana Lv,Shaoming Qiu,Qingli Liu

DOI: https://doi.org/10.3390/brainsci14040375

IF: 3.333

2024-04-13

Brain Sciences

Abstract:Motor imagery electroencephalography (EEG) signals have garnered attention in brain–computer interface (BCI) research due to their potential in promoting motor rehabilitation and control. However, the limited availability of labeled data poses challenges for training robust classifiers. In this study, we propose a novel data augmentation method utilizing an improved Deep Convolutional Generative Adversarial Network with Gradient Penalty (DCGAN-GP) to address this issue. We transformed raw EEG signals into two-dimensional time–frequency maps and employed a DCGAN-GP network to generate synthetic time–frequency representations resembling real data. Validation experiments were conducted on the BCI IV 2b dataset, comparing the performance of classifiers trained with augmented and unaugmented data. Results demonstrated that classifiers trained with synthetic data exhibit enhanced robustness across multiple subjects and achieve higher classification accuracy. Our findings highlight the effectiveness of utilizing a DCGAN-GP-generated synthetic EEG data to improve classifier performance in distinguishing different motor imagery tasks. Thus, the proposed data augmentation method based on a DCGAN-GP offers a promising avenue for enhancing BCI system performance, overcoming data scarcity challenges, and bolstering classifier robustness, thereby providing substantial support for the broader adoption of BCI technology in real-world applications.

neurosciences
Improving brain computer interface performance by data augmentation with conditional Deep Convolutional Generative Adversarial Networks

Qiqi Zhang,Ying Liu

DOI: https://doi.org/10.48550/arXiv.1806.07108

2018-12-27

Abstract:One of the big restrictions in brain computer interface field is the very limited training samples, it is difficult to build a reliable and usable system with such limited data. Inspired by generative adversarial networks, we propose a conditional Deep Convolutional Generative Adversarial (cDCGAN) Networks method to generate more artificial EEG signal automatically for data augmentation to improve the performance of convolutional neural networks in brain computer interface field and overcome the small training dataset problems. We evaluate the proposed cDCGAN method on BCI competition dataset of motor imagery. The results show that the generated artificial EEG data from Gaussian noise can learn the features from raw EEG data and has no less than the classification accuracy of raw EEG data in the testing dataset. Also by using generated artificial data can effectively improve classification accuracy at the same model with limited training data.

Human-Computer Interaction,Machine Learning,Neurons and Cognition
Improved Domain Adaptation Network Based on Wasserstein Distance for Motor Imagery EEG Classification

Qingshan She,Tie Chen,Feng Fang,Jianhai Zhang,Yunyuan Gao,Yingchun Zhang

DOI: https://doi.org/10.1109/TNSRE.2023.3241846

2023-02-01

Abstract:Motor Imagery (MI) paradigm is critical in neural rehabilitation and gaming. Advances in brain-computer interface (BCI) technology have facilitated the detection of MI from electroencephalogram (EEG). Previous studies have proposed various EEG-based classification algorithms to identify the MI, however, the performance of prior models was limited due to the cross-subject heterogeneity in EEG data and the shortage of EEG data for training. Therefore, inspired by generative adversarial network (GAN), this study aims to propose an improved domain adaption network based on Wasserstein distance, which utilizes existing labeled data from multiple subjects (source domain) to improve the performance of MI classification on a single subject (target domain). Specifically, our proposed framework consists of three components, including a feature extractor, a domain discriminator, and a classifier. The feature extractor employs an attention mechanism and a variance layer to improve the discrimination of features extracted from different MI classes. Next, the domain discriminator adopts the Wasserstein matrix to measure the distance between source domain and target domain, and aligns the data distributions of source and target domain via adversarial learning strategy. Finally, the classifier uses the knowledge acquired from the source domain to predict the labels in the target domain. The proposed EEG-based MI classification framework was evaluated by two open-source datasets, the BCI Competition IV Datasets 2a and 2b. Our results demonstrated that the proposed framework could enhance the performance of EEG-based MI detection, achieving better classification results compared with several state-of-the-art algorithms. In conclusion, this study is promising in helping the neural rehabilitation of different neuropsychiatric diseases.
EEGGAN-Net: enhancing EEG signal classification through data augmentation

Jiuxiang Song,Qiang Zhai,Chuang Wang,Jizhong Liu

DOI: https://doi.org/10.3389/fnhum.2024.1430086

IF: 3.473

2024-06-22

Frontiers in Human Neuroscience

Abstract:Background: Emerging brain-computer interface (BCI) technology holds promising potential to enhance the quality of life for individuals with disabilities. Nevertheless, the constrained accuracy of electroencephalography (EEG) signal classification poses numerous hurdles in real-world applications. Methods: In response to this predicament, we introduce a novel EEG signal classification model termed EEGGAN-Net, leveraging a data augmentation framework. By incorporating Conditional Generative Adversarial Network (CGAN) data augmentation, a cropped training strategy and a Squeeze-and-Excitation (SE) attention mechanism, EEGGAN-Net adeptly assimilates crucial features from the data, consequently enhancing classification efficacy across diverse BCI tasks. Results: The EEGGAN-Net model exhibits notable performance metrics on the BCI Competition IV-2a and IV-2b datasets. Specifically, it achieves a classification accuracy of 81.3% with a kappa value of 0.751 on the IV-2a dataset, and a classification accuracy of 90.3% with a kappa value of 0.79 on the IV-2b dataset. Remarkably, these results surpass those of four other CNN-based decoding models. Conclusions: In conclusion, the amalgamation of data augmentation and attention mechanisms proves instrumental in acquiring generalized features from EEG signals, ultimately elevating the overall proficiency of EEG signal classification.

psychology,neurosciences
Data augmentation for invasive brain-computer interfaces based on stereo-electroencephalography (SEEG)

Xiaolong Wu,Dingguo Zhang,Guangye Li,Xin Gao,Benjamin Metcalfe,Liang Chen

DOI: https://doi.org/10.1088/1741-2552/ad200e

IF: 5.043

2024-01-20

Journal of Neural Engineering

Abstract:—Objective: : Deep learning is increasingly used for Brain-computer interfaces (BCIs). However, the available brain data is sparse, especially for invasive BCIs, which can dramatically deteriorate deep learning performance. Data augmentation methods (DA), such as generative models, can help to address this issue. However, existing studies on brain signals relied on convolutional neural networks (CNNs) and ignored the temporal dependence. This paper tried to enhance the generative model by capturing the temporal relationship from a time-series perspective. Methods: A conditional generative network (cTGAN) based on the transformer model is proposed, and tested on the Stereo- electroencephalography (SEEG) data which was recorded from eight epileptic patients performing five different movements. Three other commonly-used DA methods were also implemented: noise injection (NI), variational autoencoder (VAE) and conditional Wasserstein GAN with gradient penalty (cWGANGP). Artificial SEEG data was generated, and various metrics were used to compare the data quality, including visual inspection, Cosine similarity (CS), Jensen-Shannon distance (JSD) and the effect on the performance of a deep learning-based classifier. Result: Both the proposed cTGAN and the cWGANGP methods were able to generate realistic data, while NI and VAE output inferior samples when visualised as raw sequences and in a lower dimensional space. The cTGAN generated the best samples in terms of cosine similarity and Jensen-Shannon distance and outperformed cWGANGP significantly in enhancing the performance of a deep learning-based classifier (each of them yielding a significant improvement of 6% and 3.4%, respectively). Conclusion: This paper demonstrated that a generative model that preserves temporal dependence is superior in data generation and boosting deep learning performance for SEEG signals. Significance: This is the first time that DA methods are applied to invasive BCIs based on SEEG. In addition, this study demonstrated the advantages of the model that preserves the temporal dependence from a time-series perspective.

engineering, biomedical,neurosciences
EEG-Based Feature Classification Combining 3D-Convolutional Neural Networks with Generative Adversarial Networks for Motor Imagery

Chengcheng Fan,Banghua Yang,Xiaoou Li,Shouwei Gao,Peng Zan

DOI: https://doi.org/10.31083/j.jin2308153

2024-08-20

Abstract:Background: The adoption of convolutional neural networks (CNNs) for decoding electroencephalogram (EEG)-based motor imagery (MI) in brain-computer interfaces has significantly increased recently. The effective extraction of motor imagery features is vital due to the variability among individuals and temporal states. Methods: This study introduces a novel network architecture, 3D-convolutional neural network-generative adversarial network (3D-CNN-GAN), for decoding both within-session and cross-session motor imagery. Initially, EEG signals were extracted over various time intervals using a sliding window technique, capturing temporal, frequency, and phase features to construct a temporal-frequency-phase feature (TFPF) three-dimensional feature map. Generative adversarial networks (GANs) were then employed to synthesize artificial data, which, when combined with the original datasets, expanded the data capacity and enhanced functional connectivity. Moreover, GANs proved capable of learning and amplifying the brain connectivity patterns present in the existing data, generating more distinctive brain network features. A compact, two-layer 3D-CNN model was subsequently developed to efficiently decode these TFPF features. Results: Taking into account session and individual differences in EEG data, tests were conducted on both the public GigaDB dataset and the SHU laboratory dataset. On the GigaDB dataset, our 3D-CNN and 3D-CNN-GAN models achieved two-class within-session motor imagery accuracies of 76.49% and 77.03%, respectively, demonstrating the algorithm's effectiveness and the improvement provided by data augmentation. Furthermore, on the SHU dataset, the 3D-CNN and 3D-CNN-GAN models yielded two-class within-session motor imagery accuracies of 67.64% and 71.63%, and cross-session motor imagery accuracies of 58.06% and 63.04%, respectively. Conclusions: The 3D-CNN-GAN algorithm significantly enhances the generalizability of EEG-based motor imagery brain-computer interfaces (BCIs). Additionally, this research offers valuable insights into the potential applications of motor imagery BCIs.
Classification of Motor Imagery EEG Signals Based on Data Augmentation and Convolutional Neural Networks

Yu Xie,Stefan Oniga

DOI: https://doi.org/10.3390/s23041932

IF: 3.9

2023-02-10

Sensors

Abstract:In brain–computer interface (BCI) systems, motor imagery electroencephalography (MI-EEG) signals are commonly used to detect participant intent. Many factors, including low signal-to-noise ratios and few high-quality samples, make MI classification difficult. In order for BCI systems to function, MI-EEG signals must be studied. In pattern recognition and other fields, deep learning approaches have recently been successfully applied. In contrast, few effective deep learning algorithms have been applied to BCI systems, especially MI-based systems. In this paper, we address these problems from two aspects based on the characteristics of EEG signals: first, we proposed a combined time–frequency domain data enhancement method. This method guarantees that the size of the training data is effectively increased while maintaining the intrinsic composition of the data. Second, our design consists of a parallel CNN that takes both raw EEG images and images transformed through continuous wavelet transform (CWT) as inputs. We conducted classification experiments on a public data set to verify the effectiveness of the algorithm. According to experimental results based on the BCI Competition IV Dataset2a, the average classification accuracy is 97.61%. A comparison of the proposed algorithm with other algorithms shows that it performs better in classification. The algorithm can be used to improve the classification performance of MI-based BCIs and BCI systems created for people with disabilities.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Improved Scalp Swarm Optimization with Generative Adversarial Network for Recognition of Motor Imagery EEG

Sikkandar,Mohamed Yacin

DOI: https://doi.org/10.1590/1678-4324-2024230545

2024-11-09

Brazilian Archives of Biology and Technology

Abstract:Stephen, Stephe ; Thangaiyan, Jayasankar ; Anand, Sheryl Oliver ; Sikkandar, Mohamed Yacin ; Motor imaging (MI) has been commonly employed in the domains of nervous analysis and robot control as an essential model of impulsive brain-computer interfaces (BCIs). Several approaches for extraction and classification based on MI signals have presented by researchers. Because of its random initialization technique, deep-learning (DL) procedures like convolutional neural networks (CNNs) employed in motor imagery categorization would suffer from the problem of extracting the features and improving the classification performance. To overcome these shortcomings, the proposed work presented a technique for reconstructing MI signals using empirical mode decomposition (EMD). In which it can manage the non-stationary problem and mix their Intrinsic Mode Functions (IMFs) extended to multichannel analysis. The proposed works uses the transformation technique of discrete wavelet transform (DWT) for extracting the signal. In classification wise, the proposed work used conditional generative adversarial network (CGAN), which provides the better classification performance and reduces the computational time. The proposed work used both binary class and multi-class classification. Scalp swarm optimization (SSO) used to enhance and optimize the learning parameters of the GAN model because in multi-class subjects, the performance of CGAN gradually degrades. In this BCI experimentation, the proposed work used two BCI competition datasets, such as BCI competition three dataset III (a) and BCI competition three dataset IV (a). Furthermore, evaluate the proposed technique performance by evaluating and comparing with DL technique as CNN (Alexnet and Resnet) model. The CNN achieved a classification accuracy performance of 81.61% in multiclass, while the CGAN showed better performance at 89.11%.

biology
Optimizing EEG Signal Classification in BCI Systems: A Comparative Study of Hybrid Transfer Learning and Advanced Machine Learning Approaches

P S Thanigaivelu

DOI: https://doi.org/10.52783/jes.4832

2024-06-27

Abstract:Electroencephalogram (EEG) data can be challenging to classify for motor imagery (MI) tasks in brain-computer interfaces (BCI) due to low signal-to-noise ratios, complex patterns, and subject variability. This study aims to overcome these issues by evaluating various Transfer Learning (TL) and advanced machine learning models to improve EEG data classification accuracy. We pre-processed raw EEG signals into scalogram images by Continuous Wavelet Transform (CWT) and fed them into TL models like DenseNet, VGG19, ResNet, and InceptionV3. Features from these models were classified using advanced machine learning classifiers, including Random Forest, K-Nearest Neighbours, Decision Tree, and XGBoost. Using the BCI Competition IV 2a raw dataset, DenseNet combined with XGBoost achieved 99.2% classification accuracy on both training and validation datasets. According to the study, TL-based architecture can be used for controlling rehabilitation devices using EEG data for post-stroke patients, improving their quality of life and facilitating a more convenient way for individuals with severe physical disabilities to manage their healthcare via hybrid TL and advanced ML integrated BCI systems.
Wasserstein generative adversarial network with gradient penalty and convolutional neural network based motor imagery EEG classification

Hui Xiong,Jiahe Li,Jinzhen Liu,Jinlong Song,Yuqing Han

DOI: https://doi.org/10.1088/1741-2552/ad6cf5

2024-08-14

Abstract:Objective.Due to the difficulty in acquiring motor imagery electroencephalography (MI-EEG) data and ensuring its quality, insufficient training data often leads to overfitting and inadequate generalization capabilities of deep learning-based classification networks. Therefore, we propose a novel data augmentation method and deep learning classification model to enhance the decoding performance of MI-EEG further.Approach.The raw EEG signals were transformed into the time-frequency maps as the input to the model by continuous wavelet transform. An improved Wasserstein generative adversarial network with gradient penalty data augmentation method was proposed, effectively expanding the dataset used for model training. Additionally, a concise and efficient deep learning model was designed to improve decoding performance further.Main results.It has been demonstrated through validation by multiple data evaluation methods that the proposed generative network can generate more realistic data. Experimental results on the BCI Competition IV 2a and 2b datasets and the actual collected dataset show that classification accuracies are 83.4%, 89.1% and 73.3%, and Kappa values are 0.779, 0.782 and 0.644, respectively. The results indicate that the proposed model outperforms state-of-the-art methods.Significance.Experimental results demonstrate that this method effectively enhances MI-EEG data, mitigates overfitting in classification networks, improves MI classification accuracy, and holds positive implications for MI tasks.
Generative Adversarial Networks-Based Data Augmentation for Brain–Computer Interface

Fatemeh Fahimi,Strahinja Dosen,Kai Keng Ang,Natalie Mrachacz-Kersting,Cuntai Guan

DOI: https://doi.org/10.1109/tnnls.2020.3016666

IF: 14.255

2021-09-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:The performance of a classifier in a brain–computer interface (BCI) system is highly dependent on the quality and quantity of training data. Typically, the training data are collected in a laboratory where the users perform tasks in a controlled environment. However, users' attention may be diverted in real-life BCI applications and this may decrease the performance of the classifier. To improve the robustness of the classifier, additional data can be acquired in such conditions, but it is not practical to record electroencephalogram (EEG) data over several long calibration sessions. A potentially time- and cost-efficient solution is artificial data generation. Hence, in this study, we proposed a framework based on the deep convolutional generative adversarial networks (DCGANs) for generating artificial EEG to augment the training set in order to improve the performance of a BCI classifier. To make a comparative investigation, we designed a motor task experiment with diverted and focused attention conditions. We used an end-to-end deep convolutional neural network for classification between movement intention and rest using the data from 14 subjects. The results from the leave-one subject-out (LOO) classification yielded baseline accuracies of 73.04% for diverted attention and 80.09% for focused attention without data augmentation. Using the proposed DCGANs-based framework for augmentation, the results yielded a significant improvement of 7.32% for diverted attention ( <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="8.492ex" height="2.509ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -791.3 3656.1 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use xlink:href="#MJMAIN-3C" x="781" y="0"></use><g transform="translate(1837,0)"> <use xlink:href="#MJMAIN-30"></use> <use xlink:href="#MJMAIN-2E" x="500" y="0"></use> <use xlink:href="#MJMAIN-30" x="779" y="0"></use> <use xlink:href="#MJMAIN-31" x="1279" y="0"></use></g></g></svg></span> ) and 5.45% for focused attention ( <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="8.492ex" height="2.509ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -791.3 3656.1 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use xlink:href="#MJMAIN-3C" x="781" y="0"></use><g transform="translate(1837,0)"> <use xlink:href="#MJMAIN-30"></use> <use xlink:href="#MJMAIN-2E" x="500" y="0"></use> <use xlink:href="#MJMAIN-30" x="779" y="0"></use> <use xlink:href="#MJMAIN-31" x="1279" y="0"></use></g></g></svg></span> ). In addition, we implemented the method on the data set IVa from BCI competition III to distinguish different motor imagery tasks. The proposed method increase- the accuracy by 3.57% ( <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="8.492ex" height="2.509ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -791.3 3656.1 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use xlink:href="#MJMAIN-3C" x="781" y="0"></use><g transform="translate(1837,0)"> <use xlink:href="#MJMAIN-30"></use> <use xlink:href="#MJMAIN-2E" x="500" y="0"></use> <use xlink:href="#MJMAIN-30" x="779" y="0"></use> <use xlink:href="#MJMAIN-32" x="1279" y="0"></use></g></g></svg></span> ). This study shows that using GANs for EEG augmentation can significantly improve BCI performance, especially in real-life applications, whereby users' attention may be diverted.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-70" d="M23 287Q24 290 25 295T30 317T40 348T55 381T75 411T101 433T134 442Q209 442 230 378L240 387Q302 442 358 442Q423 442 460 395T497 281Q497 173 421 82T249 -10Q227 -10 210 -4Q199 1 187 11T168 28L161 36Q160 35 139 -51T118 -138Q118 -144 126 -145T163 -148H188Q194 -155 194 -157T191 -175Q188 -187 185 -190T172 -194Q170 -194 161 -194T127 -193T65 -192Q-5 -192 -24 -194H-32Q-39 -187 -39 -183Q-37 -156 -26 -148H-6Q28 -147 33 -136Q36 -130 94 103T155 350Q156 355 156 364Q156 405 131 405Q109 405 94 377T71 316T59 280Q57 278 43 278H29Q23 284 23 287ZM178 102Q200 26 252 26Q282 26 310 49T356 107Q374 141 392 215T411 325V331Q411 405 350 405Q339 405 328 402T306 393T286 380T269 365T254 350T243 336T235 326L232 322Q232 321 229 308T218 264T204 212Q178 106 178 102Z"></path><path stroke-width="1" id="MJMAIN-3C" d="M694 -11T694 -19T688 -33T678 -40Q671 -40 524 29T234 166L90 235Q83 240 83 250Q83 261 91 266Q664 540 678 540Q681 540 687 534T694 519T687 505Q686 504 417 376L151 250L417 124Q686 -4 687 -5Q694 -11 694 -19Z"></path><path stroke-width="1" id="MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs></svg>

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Common Spatial Generative Adversarial Networks based EEG Data Augmentation for Cross-Subject Brain-Computer Interface

Yonghao Song,Lie Yang,Xueyu Jia,Longhan Xie

2021-01-01

Abstract: The cross-subject application of EEG-based brain-computer interface (BCI) has always been limited by large individual difference and complex characteristics that are difficult to perceive. Therefore, it takes a long time to collect the training data of each user for calibration. Even transfer learning method pre-training with amounts of subject-independent data cannot decode different EEG signal categories without enough subject-specific data. Hence, we proposed a cross-subject EEG classification framework with a generative adversarial networks (GANs) based method named common spatial GAN (CS-GAN), which used adversarial training between a generator and a discriminator to obtain high-quality data for augmentation. A particular module in the discriminator was employed to maintain the spatial features of the EEG signals and increase the difference between different categories, with two losses for further enhancement. Through adaptive training with sufficient augmentation data, our cross-subject classification accuracy yielded a significant improvement of 15.85% than leave-one subject-out (LOO) test and 8.57% than just adapting 100 original samples on the dataset 2a of BCI competition IV. Moreover, We designed a convolutional neural networks (CNNs) based classification method as a benchmark with a similar spatial enhancement idea, which achieved remarkable results to classify motor imagery EEG data. In summary, our framework provides a promising way to deal with the cross-subject problem and promote the practical application of BCI.
SCDAN: Learning Common Feature Representation of Brain Activation for Intersubject Motor Imagery EEG Decoding

Boxun Fu,Fu Li,Youshuo Ji,Yang Li,Xuemei Xie,Guangming Shi

DOI: https://doi.org/10.1109/tim.2023.3284926

IF: 5.6

2023-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:An electroencephalogram (EEG)-based motor imagery (MI) brain–computer interface (BCI) builds a direct communication channel between humans and computers by decoding EEG signals. The intersubject decoding ability is crucial for the application of MI-BCI, which implies that the subject can use MI-BCI equipment without recording additional data for training. Physiologically, because of the distinction in the imagery method, brain structure, and brain state, the intersubject data distribution of MI EEG data is different. This often leads to a partial or even complete failure of the MI decoding algorithm between subjects. To solve these issues, we propose a novel deep learning method called the spatial and conditional domain adaption network (SCDAN), which aims to adapt the intersubject MI EEG data. In SCDAN, three innovative structures are employed: a parallel temporal–spatial convolution feature extractor, a spatial discriminator, and a conditional discriminator. The feature extractor adopts an improved temporal–spatial convolutional network that has a more reasonable structure and fewer parameters to reduce the risk of intersubject overfitting. The spatial discriminator and conditional discriminator calibrate the training processing to help the feature extractor learn the intersubject common feature representation. We evaluate the performance of SCDAN on the GigaScience dataset and the 2a BCI Competition IV dataset using both one-to-one and leave-one-out transfer protocols. For the one-to-one transfer protocol, the classification accuracies of SCDAN improve by 5.70% and 12.43% compared with the baseline method. And for the leave-one-out transfer protocol, the improvements are 8.60% and 15.84%, respectively. The results show a significant improvement compared with the baseline and comparison methods.

engineering, electrical & electronic,instruments & instrumentation
Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network

Kaishuo Zhang,Neethu Robinson,Seong-Whan Lee,Cuntai Guan

DOI: https://doi.org/10.1016/j.neunet.2020.12.013

IF: 7.8

2021-04-01

Neural Networks

Abstract:In recent years, deep learning has emerged as a powerful tool for developing Brain-Computer Interface (BCI) systems. However, for deep learning models trained entirely on the data from a specific individual, the performance increase has only been marginal owing to the limited availability of subject-specific data. To overcome this, many transfer-based approaches have been proposed, in which deep networks are trained using pre-existing data from other subjects and evaluated on new target subjects. This mode of transfer learning however faces the challenge of substantial inter-subject variability in brain data. Addressing this, in this paper, we propose 5 schemes for adaptation of a deep convolutional neural network (CNN) based electroencephalography (EEG)-BCI system for decoding hand motor imagery (MI). Each scheme fine-tunes an extensively trained, pre-trained model and adapt it to enhance the evaluation performance on a target subject. We report the highest subject-independent performance with an average (N=54) accuracy of 84.19% (±9.98%) for two-class motor imagery, while the best accuracy on this dataset is 74.15% (±15.83%) in the literature. Further, we obtain a statistically significant improvement (p=0.005) in classification using the proposed adaptation schemes compared to the baseline subject-independent model.

computer science, artificial intelligence,neurosciences
Score-Based Data Generation for EEG Spatial Covariance Matrices: Towards Boosting BCI Performance

Ce Ju,Reinmar Josef Kobler,Cuntai Guan

DOI: https://doi.org/10.1109/EMBC40787.2023.10340899

2023-12-15

Abstract:The efficacy of Electroencephalogram (EEG) classifiers can be augmented by increasing the quantity of available data. In the case of geometric deep learning classifiers, the input consists of spatial covariance matrices derived from EEGs. In order to synthesize these spatial covariance matrices and facilitate future improvements of geometric deep learning classifiers, we propose a generative modeling technique based on state-of-the-art score-based models. The quality of generated samples is evaluated through visual and quantitative assessments using a left/right-hand-movement motor imagery dataset. The exceptional pixel-level resolution of these generative samples highlights the formidable capacity of score-based generative modeling. Additionally, the center (Frechet mean) of the generated samples aligns with neurophysiological evidence that event-related desynchronization and synchronization occur on electrodes C3 and C4 within the Mu and Beta frequency bands during motor imagery processing. The quantitative evaluation revealed that 84.3% of the generated samples could be accurately predicted by a pre-trained classifier and an improvement of up to 8.7% in the average accuracy over ten runs for a specific test subject in a holdout experiment.

Signal Processing
Subject-independent EEG classification based on a hybrid neural network

Hao Zhang,Hongfei Ji,Jian Yu,Jie Li,Lingjing Jin,Lingyu Liu,Zhongfei Bai,Chen Ye

DOI: https://doi.org/10.3389/fnins.2023.1124089

IF: 4.3

2023-06-02

Frontiers in Neuroscience

Abstract:A brain-computer interface (BCI) based on the electroencephalograph (EEG) signal is a novel technology that provides a direct pathway between human brain and outside world. For a traditional subject-dependent BCI system, a calibration procedure is required to collect sufficient data to build a subject-specific adaptation model, which can be a huge challenge for stroke patients. In contrast, subject-independent BCI which can shorten or even eliminate the pre-calibration is more time-saving and meets the requirements of new users for quick access to the BCI. In this paper, we design a novel fusion neural network EEG classification framework that uses a specially designed generative adversarial network (GAN), called a filter bank GAN (FBGAN), to acquire high-quality EEG data for augmentation and a proposed discriminative feature network for motor imagery (MI) task recognition. Specifically, multiple sub-bands of MI EEG are first filtered using a filter bank approach, then sparse common spatial pattern (CSP) features are extracted from multiple bands of filtered EEG data, which constrains the GAN to maintain more spatial features of the EEG signal, and finally we design a convolutional recurrent network classification method with discriminative features (CRNN-DF) to recognize MI tasks based on the idea of feature enhancement. The hybrid neural network proposed in this study achieves an average classification accuracy of 72.74 ± 10.44% (mean ± std) in four-class tasks of BCI IV-2a, which is 4.77% higher than the state-of-the-art subject-independent classification method. A promising approach is provided to facilitate the practical application of BCI.

neurosciences
Improving Multi-Class Motor Imagery EEG Classification Using Overlapping Sliding Window and Deep Learning Model

Jeonghee Hwang,Soyoung Park,Jeonghee Chi

DOI: https://doi.org/10.3390/electronics12051186

IF: 2.9

2023-03-02

Electronics

Abstract:Motor imagery (MI) electroencephalography (EEG) signals are widely used in BCI systems. MI tasks are performed by imagining doing a specific task and classifying MI through EEG signal processing. However, it is a challenging task to classify EEG signals accurately. In this study, we propose a LSTM-based classification framework to enhance classification accuracy of four-class MI signals. To obtain time-varying data of EEG signals, a sliding window technique is used, and an overlapping-band-based FBCSP is applied to extract the subject-specific spatial features. Experimental results on BCI competition IV dataset 2a showed an average accuracy of 97% and kappa value of 0.95 in all subjects. It is demonstrated that the proposed method outperforms the existing algorithms for classifying the four-class MI EEG, and it also illustrates the robustness on the variability of inter-trial and inter-session of MI data. Furthermore, the extended experimental results for channel selection showed the best performance of classification accuracy when using all twenty-two channels by the proposed method, but an average kappa value of 0.93 was achieved with only seven channels.

engineering, electrical & electronic,computer science, information systems,physics, applied
Bidirectional feature pyramid attention-based temporal convolutional network model for motor imagery electroencephalogram classification

Xinghe Xie,Liyan Chen,Shujia Qin,Fusheng Zha,Xinggang Fan

DOI: https://doi.org/10.3389/fnbot.2024.1343249

IF: 3.493

2024-01-30

Frontiers in Neurorobotics

Abstract:Introduction: As an interactive method gaining popularity, brain-computer interfaces (BCIs) aim to facilitate communication between the brain and external devices. Among the various research topics in BCIs, the classification of motor imagery using electroencephalography (EEG) signals has the potential to greatly improve the quality of life for people with disabilities. Methods: This technology assists them in controlling computers or other devices like prosthetic limbs, wheelchairs, and drones. However, the current performance of EEG signal decoding is not sufficient for real-world applications based on Motor Imagery EEG (MI-EEG). To address this issue, this study proposes an attention-based bidirectional feature pyramid temporal convolutional network model for the classification task of MI-EEG. The model incorporates a multi-head self-attention mechanism to weigh significant features in the MI-EEG signals. It also utilizes a temporal convolution network (TCN) to separate high-level temporal features. The signals are enhanced using the sliding-window technique, and channel and time-domain information of the MI-EEG signals is extracted through convolution. Results: Additionally, a bidirectional feature pyramid structure is employed to implement attention mechanisms across different scales and multiple frequency bands of the MI-EEG signals. The performance of our model is evaluated on the BCI Competition IV-2a dataset and the BCI Competition IV-2b dataset, and the results showed that our model outperformed the state-of-the-art baseline model, with an accuracy of 87.5 and 86.3% for the subject-dependent, respectively. Discussion: In conclusion, the BFATCNet model offers a novel approach for EEG-based motor imagery classification in BCIs, effectively capturing relevant features through attention mechanisms and temporal convolutional networks. Its superior performance on the BCI Competition IV-2a and IV-2b datasets highlights its potential for real-world applications. However, its performance on other datasets may vary, necessitating further research on data augmentation techniques and integration with multiple modalities to enhance interpretability and generalization. Additionally, reducing computational complexity for real-time applications is an important area for future work.

robotics,computer science, artificial intelligence,neurosciences
An end-to-end CNN with attentional mechanism applied to raw EEG in a BCI classification task

Elnaz Lashgari,Jordan Ott,Akima Connelly,Pierre Baldi,Uri Maoz

DOI: https://doi.org/10.1088/1741-2552/ac1ade

IF: 5.043

2021-08-01

Journal of Neural Engineering

Abstract:Objective. Motor-imagery (MI) classification base on electroencephalography (EEG) has been long studied in neuroscience and more recently widely used in healthcare applications such as mobile assistive robots and neurorehabilitation. In particular, EEG-based MI classification methods that rely on convolutional neural networks (CNNs) have achieved relatively high classification accuracy. However, naively training CNNs to classify raw EEG data from all channels, especially for high-density EEG, is computationally demanding and requires huge training sets. It often also introduces many irrelevant input features, making it difficult for the CNN to extract the informative ones. This problem is compounded by a dearth of training data, which is particularly acute for MI tasks, because these are cognitively demanding and thus fatigue inducing. Approach. To address these issues, we proposed an end-to-end CNN-based neural network with attentional mechanism together with different data augmentation (DA) techniques. We tested it on two benchmark MI datasets, brain–computer interface (BCI) competition IV 2a and 2b. In addition, we collected a new dataset, recorded using high-density EEG, and containing both MI and motor execution (ME) tasks, which we share with the community. Main results. Our proposed neural-network architecture outperformed all state-of-the-art methods that we found in the literature, with and without DA, reaching an average classification accuracy of 93.6% and 87.83% on BCI 2a and 2b, respectively. We also directly compare decoding of MI and ME tasks. Focusing on MI classification, we find optimal channel configurations and the best DA techniques as well as investigate combining data across participants and the role of transfer learning. Significance. Our proposed approach improves the classification accuracy for MI in the benchmark datasets. In addition, collecting our own dataset enables us to compare MI and ME and investigate various aspects of EEG decoding critical for neuroscience and BCI.

engineering, biomedical,neurosciences
An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classification

Xianheng Wang,Veronica Liesaputra,Zhaobin Liu,Yi Wang,Zhiyi Huang

DOI: https://doi.org/10.1016/j.artmed.2023.102738

IF: 7.011

2023-12-04

Artificial Intelligence in Medicine

Abstract:Electroencephalogram (EEG)-based Brain-Computer Interfaces (BCIs) build a communication path between human brain and external devices. Among EEG-based BCI paradigms, the most commonly used one is motor imagery (MI). As a hot research topic, MI-EEG based BCI has largely contributed to medical field and smart home industry. However, because of the low signal-to-noise ratio (SNR) and the non-stationary characteristic of EEG data, it is difficult to correctly classify different types of MI-EEG signals. Recently, the advances in Deep Learning (DL) significantly facilitate the development of MI EEG-based BCIs. In this paper, we provide a systematic survey of DL-based MI-EEG classification methods. Specifically, we first comprehensively discuss several important aspects of DL-based MI-EEG classification, covering input formulations, network architectures, public datasets, etc. Then, we summarize problems in model performance comparison and give guidelines to future studies for fair performance comparison. Next, we fairly evaluate the representative DL-based models using source code released by the authors and meticulously analyse the evaluation results. By performing ablation study on the network architecture, we found that (1) effective feature fusion is indispensable for multi-stream CNN-based models. (2) LSTM should be combined with spatial feature extraction techniques to obtain good classification performance. (3) the use of dropout contributes little to improving the model performance, and that (4) adding fully connected layers to the models significantly increases their parameters but it might not improve their performance. Finally, we raise several open issues in MI-EEG classification and provide possible future research directions.

engineering, biomedical,computer science, artificial intelligence,medical informatics

Extended Random Sets for Knowledge Discovery in Information Systems

A Data Augmentation Method for Motor Imagery EEG Signals Based on DCGAN-GP Network

Improving brain computer interface performance by data augmentation with conditional Deep Convolutional Generative Adversarial Networks

Improved Domain Adaptation Network Based on Wasserstein Distance for Motor Imagery EEG Classification

EEGGAN-Net: enhancing EEG signal classification through data augmentation

Data augmentation for invasive brain-computer interfaces based on stereo-electroencephalography (SEEG)

EEG-Based Feature Classification Combining 3D-Convolutional Neural Networks with Generative Adversarial Networks for Motor Imagery

Classification of Motor Imagery EEG Signals Based on Data Augmentation and Convolutional Neural Networks

Improved Scalp Swarm Optimization with Generative Adversarial Network for Recognition of Motor Imagery EEG

Optimizing EEG Signal Classification in BCI Systems: A Comparative Study of Hybrid Transfer Learning and Advanced Machine Learning Approaches

Wasserstein generative adversarial network with gradient penalty and convolutional neural network based motor imagery EEG classification

Generative Adversarial Networks-Based Data Augmentation for Brain–Computer Interface

Common Spatial Generative Adversarial Networks based EEG Data Augmentation for Cross-Subject Brain-Computer Interface

SCDAN: Learning Common Feature Representation of Brain Activation for Intersubject Motor Imagery EEG Decoding

Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network

Score-Based Data Generation for EEG Spatial Covariance Matrices: Towards Boosting BCI Performance

Subject-independent EEG classification based on a hybrid neural network

Improving Multi-Class Motor Imagery EEG Classification Using Overlapping Sliding Window and Deep Learning Model

Bidirectional feature pyramid attention-based temporal convolutional network model for motor imagery electroencephalogram classification

An end-to-end CNN with attentional mechanism applied to raw EEG in a BCI classification task

An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classification