Hyperfraktionierte-akzelerierte simultane Radio-Chemo-Therapie bei fortgeschrittenen Hypopharynxkarzinomen Überlebensrate, Funktionserhalt und Lebensqualität in einer Phase-II-Studie

M. Schrader,J. Schipper,K. Jahnke,M. Stuschke,H. Sack,V. Budach

DOI: https://doi.org/10.1007/s001060050212

1998-02-01

Abstract:

What problem does this paper attempt to address?

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Chao Li,Yong Sheng,Haishuai Wang,Mingyue Niu,Peiguang Jing,Ziping Zhao,Bjorn W Schuller

DOI: https://doi.org/10.1109/embc48229.2022.9871072

2022-01-01

Abstract:In recent years, due to the fundamental role played by the central nervous system in emotion expression, electroencephalogram (EEG) signals have emerged as the most robust signals for use in emotion recognition and inference. Current emotion recognition methods mainly employ deep learning technology to learn the spatial or temporal representation of each channel, then obtain complementary information from different EEG channels by adopting a multi-modal fusion strategy. However, emotional expression is usually accompanied by the dynamic spatio-temporal evolution of functional connections in the brain. Therefore, the effective learning of more robust long-term dynamic representations for the brain's functional connection networks is a key to improving the EEG-based emotion recognition system. To address these issues, we propose a brain network representation learning method that employs self-attention dynamic graph neural networks to obtain the spatial structure information and temporal evolution characteristics of brain networks. Experimental results on the AMIGOS dataset show that the proposed method is superior to the state-of-the-art methods.
Generative Listener EEG for Speech Emotion Recognition Using Generative Adversarial Networks with Compressed Sensing

Jiang Chang,Zhixin Zhang,Zelin Wang,Jiacheng Li,Linsheng Meng,Pan Lin

DOI: https://doi.org/10.1109/jbhi.2024.3360151

IF: 7.7

2024-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Currently, emotional features in speech emotion recognition are typically extracted from the speeches, However, recognition accuracy can be influenced by factors such as semantics, language, and cross-speech datasets. Achieving consistent emotional judgment with human listeners is a key challenge for AI to address. Electroencephalography (EEG) signals prove to be an effective means of capturing authentic and meaningful emotional information in humans. This positions EEG as a promising tool for detecting emotional cues conveyed in speech. In this study, we proposed a novel approach named CS-GAN that generates listener EEGs in response to a speaker's speech, specifically aimed at enhancing cross-subject emotion recognition. We utilized generative adversarial networks (GANs) to establish a mapping relationship between speech and EEGs to generate stimulus-induced EEGs. Furthermore, we integrated compressive sensing theory (CS) into the GAN-based EEG generation method, thereby enhancing the fidelity and diversity of the generated EEGs. The generated EEGs were then processed using a CNN-LSTM model to identify the emotional categories conveyed in the speech. By averaging these EEGs, we obtained the event-related potentials (ERPs) to improve the cross-subject capability of the method. The experimental results demonstrate that the generated EEGs by this method outperform real listener EEGs by 9.31% in cross-subject emotion recognition tasks. Furthermore, the ERPs show an improvement of 43.59%, providing evidence for the effectiveness of this method in cross-subject emotion recognition.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
EEG Emotion Recognition Model Based on Attention and GAN

Wenxuan Qiao,Li Sun,Jinhui Wu,Pinshuo Wang,Jiubo Li,Minjie Zhao

DOI: https://doi.org/10.1109/access.2024.3370041

IF: 3.9

2024-03-06

IEEE Access

Abstract:We designed a generative adversarial network and an attention network to solve the brainwave emotion-classification problem. Using spatial attention and channel attention superposition to normalize and enhance the raw EEG data, we effectively solved the defects in the EEG data with weak features and easily disturbed them. First, a cognitive map of the brain in the emotional state was constructed by extracting graphical features from EEG signals. Simultaneously, generative adversarial networks are used to add noise to the cognitive map to generate similar data. The volume of the brain cognitive map has been expanded. The problem of insufficient EEG signal data was solved, and the accuracy and robustness were improved. Finally, we compared the processing abilities of different neural networks using EEG and adversarial signals. Compared with other deep learning models and parameter optimization methods, the proposed model achieved a detection accuracy of 94.87% on the SEED dataset.

computer science, information systems,telecommunications,engineering, electrical & electronic
Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition

Weishan Ye,Zhiguo Zhang,Fei Teng,Min Zhang,Jianhong Wang,Dong Ni,Fali Li,Peng Xu,Zhen Liang

2024-08-02

Abstract:Electroencephalography (EEG) is an objective tool for emotion recognition with promising applications. However, the scarcity of labeled data remains a major challenge in this field, limiting the widespread use of EEG-based emotion recognition. In this paper, a semi-supervised Dual-stream Self-Attentive Adversarial Graph Contrastive learning framework (termed as DS-AGC) is proposed to tackle the challenge of limited labeled data in cross-subject EEG-based emotion recognition. The DS-AGC framework includes two parallel streams for extracting non-structural and structural EEG features. The non-structural stream incorporates a semi-supervised multi-domain adaptation method to alleviate distribution discrepancy among labeled source domain, unlabeled source domain, and unknown target domain. The structural stream develops a graph contrastive learning method to extract effective graph-based feature representation from multiple EEG channels in a semi-supervised manner. Further, a self-attentive fusion module is developed for feature fusion, sample selection, and emotion recognition, which highlights EEG features more relevant to emotions and data samples in the labeled source domain that are closer to the target domain. Extensive experiments conducted on two benchmark databases (SEED and SEED-IV) using a semi-supervised cross-subject leave-one-subject-out cross-validation evaluation scheme show that the proposed model outperforms existing methods under different incomplete label conditions (with an average improvement of 5.83% on SEED and 6.99% on SEED-IV), demonstrating its effectiveness in addressing the label scarcity problem in cross-subject EEG-based emotion recognition.

Signal Processing,Human-Computer Interaction,Machine Learning
GANSER: A Self-supervised Data Augmentation Framework for EEG-based Emotion Recognition

Zhi Zhang,Sheng-hua Zhong,Yan Liu

DOI: https://doi.org/10.1109/taffc.2022.3170369

IF: 13.99

2022-01-01

IEEE Transactions on Affective Computing

Abstract:Electroencephalography (EEG)-based affective computing has a scarcity problem. As a result, it is difficult to build effective, highly accurate and stable models using machine learning algorithms, especially deep learning models. Data augmentation has recently shown performance improvements in deep learning models with increased accuracy, stability and reduced overfitting. In this paper, we propose a novel data augmentation framework, named the generative adversarial network-based self-supervised data augmentation (GANSER). As the first to combine adversarial training with self-supervised learning for EEG-based emotion recognition, the proposed framework generates high-quality and high-diversity simulated EEG samples. In particular, we utilize adversarial training to learn an EEG generator and force the generated EEG signals to approximate the distribution of real samples, ensuring the quality of the augmented samples. A transformation operation is employed to mask parts of the EEG signals and force the generator to synthesize potential EEG signals based on the unmasked parts to produce a wide variety of samples. A masking possibility during transformation is introduced as prior knowledge to generalize the classifier for the augmented sample space. Finally, numerous experiments demonstrate that our proposed method can improve emotion recognition with an increase in performance and achieve state-of-the-art results.

computer science, cybernetics, artificial intelligence
Data Augmentation for EEG-Based Emotion Recognition Using Generative Adversarial Networks

Guangcheng Bao,Bin Yan,Li Tong,Jun Shu,Linyuan Wang,Kai Yang,Ying Zeng

DOI: https://doi.org/10.3389/fncom.2021.723843

IF: 3.387

2021-12-09

Frontiers in Computational Neuroscience

Abstract:One of the greatest limitations in the field of EEG-based emotion recognition is the lack of training samples, which makes it difficult to establish effective models for emotion recognition. Inspired by the excellent achievements of generative models in image processing, we propose a data augmentation model named VAE-D2GAN for EEG-based emotion recognition using a generative adversarial network. EEG features representing different emotions are extracted as topological maps of differential entropy (DE) under five classical frequency bands. The proposed model is designed to learn the distributions of these features for real EEG signals and generate artificial samples for training. The variational auto-encoder (VAE) architecture can learn the spatial distribution of the actual data through a latent vector, and is introduced into the dual discriminator GAN to improve the diversity of the generated artificial samples. To evaluate the performance of this model, we conduct a systematic test on two public emotion EEG datasets, the SEED and the SEED-IV. The obtained recognition accuracy of the method using data augmentation shows as 92.5 and 82.3%, respectively, on the SEED and SEED-IV datasets, which is 1.5 and 3.5% higher than that of methods without using data augmentation. The experimental results show that the artificial samples generated by our model can effectively enhance the performance of the EEG-based emotion recognition.

neurosciences,mathematical & computational biology
A Graph Neural Network for EEG-Based Emotion Recognition With Contrastive Learning and Generative Adversarial Neural Network Data Augmentation

Hussein Al Osman,S. S. Gilakjani

DOI: https://doi.org/10.1109/ACCESS.2023.3344476

IF: 3.9

IEEE Access

Abstract:The limited size of existing datasets and signal variability have hindered EEG-based emotion recognition. In this paper, we present a solution that simultaneously addresses both problems. Generative Adversarial Networks (GANs) have recently shown notable data augmentation (DA) success. Therefore, we leverage a GAN-based DA technique to enhance the robustness of our proposed emotion recognition model by synthetically increasing the size of our datasets. Moreover, we employ contrastive learning to improve the quality of the learned representations from EEG signals and mitigate the adverse impact of inter-subject and intra-subject variability in signals corresponding to the same stimuli or emotions. We do so by maximizing the similarity in the representation of such EEG signals. We perform EEG-based emotion classification using a Graph Neural Network (GNN), which learns the relationship between the extracted EEG features. We compare the proposed model with several recent state-of-the-art emotion recognition models on the DEAP and MAHNOB datasets. The experimental results demonstrate that the proposed model outperforms previous models with a 64.84% and 66.40% emotion classification accuracy on the test set of the DEAP dataset and a 66.98% and 71.69% emotion classification accuracy on the test set of the MAHNOB-HCI dataset for the valence and arousal emotional dimensions, respectively. We perform an ablation study to demonstrate how contrastive learning, GAN, and GNN contribute to improving the proposed solution’s performance.

Computer Science
Semi-supervised EEG emotion recognition model based on enhanced graph fusion and GCN

Guangqiang Li,Ning Chen,Jing Jin

DOI: https://doi.org/10.1088/1741-2552/ac63ec

2022-04-14

Abstract:Objective. To take full advantage of both labeled data and unlabeled ones, the Graph Convolutional Network (GCN) was introduced in electroencephalography (EEG) based emotion recognition to achieve feature propagation. However, a single feature cannot represent the emotional state entirely and precisely due to the instability of the EEG signal and the complexity of the emotional state. In addition, the noise existing in the graph may affect the performance greatly. To solve these problems, it was necessary to introduce feature/similarity fusion and noise reduction strategies.Approach. A semi-supervised EEG emotion recognition model combining graph fusion, network enhancement, and feature fusion was proposed. Firstly, different features were extracted from EEG and then compacted by Principal Component Analysis (PCA), respectively. Secondly, a Sample-by-sample Similarity Matrix (SSM) was constructed based on each feature, and similarity network fusion (SNF) was adopted to fuse the graphs corresponding to different SSMs to take advantage of their complementarity. Then, Network Enhancement (NE) was performed on the fused graph to reduce the noise in it. Finally, GCN was performed on the concatenated features and the enhanced fused graph to achieve feature propagation.Main results. Experimental results demonstrated that: (a) When 5.30%of SEED and 7.20%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum classification accuracy improvement achieved by the proposed scheme over state-of-the-art schemes were 1.52%on SEED and 13.14%on SEED-IV, respectively. (b) When 8.00%of SEED and 9.60%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum training time reduction achieved by the proposed scheme over state-of-the-art schemes were 46.75 s and 22.55 s, respectively. (c) Graph fusion, network enhancement, and feature fusion all contributed to the performance enhancement. (d) The key hyperparameters that affect the performance were relatively few and easy to set to obtain outstanding performance.Significance. This paper demonstrated that the combination of graph fusion, network enhancement, and feature fusion help to enhance GCN-based EEG emotion recognition.
Transfer EEG Emotion Recognition by Combining Semi-Supervised Regression with Bipartite Graph Label Propagation

Wenzheng Li,Yong Peng

DOI: https://doi.org/10.3390/systems10040111

2022-07-29

Systems

Abstract:Individual differences often appear in electroencephalography (EEG) data collected from different subjects due to its weak, nonstationary and low signal-to-noise ratio properties. This causes many machine learning methods to have poor generalization performance because the independent identically distributed assumption is no longer valid in cross-subject EEG data. To this end, transfer learning has been introduced to alleviate the data distribution difference between subjects. However, most of the existing methods have focused only on domain adaptation and failed to achieve effective collaboration with label estimation. In this paper, an EEG feature transfer method combined with semi-supervised regression and bipartite graph label propagation (TSRBG) is proposed to realize the unified joint optimization of EEG feature distribution alignment and semi-supervised joint label estimation. Through the cross-subject emotion recognition experiments on the SEED-IV data set, the results show that (1) TSRBG has significantly better recognition performance in comparison with the state-of-the-art models; (2) the EEG feature distribution differences between subjects are significantly minimized in the learned shared subspace, indicating the effectiveness of domain adaptation; (3) the key EEG frequency bands and channels for cross-subject EEG emotion recognition are achieved by investigating the learned subspace, which provides more insights into the study of EEG emotion activation patterns.
EEG Data Augmentation for Emotion Recognition with a Task-Driven GAN

Qing Liu,Jianjun Hao,Yijun Guo

DOI: https://doi.org/10.3390/a16020118

2023-02-16

Algorithms

Abstract:The high cost of acquiring training data in the field of emotion recognition based on electroencephalogram (EEG) is a problem, making it difficult to establish a high-precision model from EEG signals for emotion recognition tasks. Given the outstanding performance of generative adversarial networks (GANs) in data augmentation in recent years, this paper proposes a task-driven method based on CWGAN to generate high-quality artificial data. The generated data are represented as multi-channel EEG data differential entropy feature maps, and a task network (emotion classifier) is introduced to guide the generator during the adversarial training. The evaluation results show that the proposed method can generate artificial data with clearer classifications and distributions that are more similar to the real data, resulting in obvious improvements in EEG-based emotion recognition tasks.
DAGAM: A domain adversarial graph attention model for subject independent EEG-based emotion recognition

Tao Xu,Wang Dang,Jiabao Wang,Yun Zhou

DOI: https://doi.org/10.1088/1741-2552/acae06

IF: 5.043

2022-12-24

Journal of Neural Engineering

Abstract:Objective. Due to individual differences in EEG signals, the learning model built by the subject-dependent technique from one person's data would be inaccurate when applied to another person for emotion recognition. Thus, the subject-dependent approach for emotion recognition may result in poor generalization performance when compared to the subject-independent approach. Existing studies, However, have attempted but not fully utilized EEG's topology, nor have they solved the problem caused by the difference in data distribution between the source and target domains. Approach. To eliminate individual differences in EEG signals, this paper proposes the domain adversarial graph attention model (DAGAM), a novel EEG-based emotion recognition model. The basic idea is to generate a graph using biological topology to model multichannel EEG signals. Graph theory can topologically describe and analyze EEG channel relationships and mutual dependencies. Then, unlike other graph convolutional networks, self-attention pooling is used to benefit the extraction of salient EEG features from the graph, effectively improving performance. Finally, following graph pooling, the domain adversarial based on the graph is used to identify and handle EEG variation across subjects, achieving good generalizability efficiently. Main Results. We conduct extensive evaluations on two benchmark datasets (SEED and SEED IV) and obtain cutting-edge results in subject-independent emotion recognition. Our model boosts the SEED accuracy to 92.59% (4.06% improvement) with the lowest standard deviation of 3.21% (2.46% decrements) and SEED IV accuracy to 80.74% (6.90% improvement) with the lowest standard deviation of 4.14% (3.88% decrements) respectively. The computational complexity is drastically reduced in comparison to similar efforts (33 times lower). Significance. We have developed a model that significantly reduces the computation time while maintaining accuracy, making EEG-based emotion decoding more practical and generalizable.

engineering, biomedical,neurosciences
SFT-SGAT: A semi-supervised fine-tuning self-supervised graph attention network for emotion recognition and consciousness detection

Lina Qiu,Liangquan Zhong,Jianping Li,Weisen Feng,Chengju Zhou,Jiahui Pan

DOI: https://doi.org/10.1016/j.neunet.2024.106643

2024-08-22

Abstract:Emotional recognition is highly important in the field of brain-computer interfaces (BCIs). However, due to the individual variability in electroencephalogram (EEG) signals and the challenges in obtaining accurate emotional labels, traditional methods have shown poor performance in cross-subject emotion recognition. In this study, we propose a cross-subject EEG emotion recognition method based on a semi-supervised fine-tuning self-supervised graph attention network (SFT-SGAT). First, we model multi-channel EEG signals by constructing a graph structure that dynamically captures the spatiotemporal topological features of EEG signals. Second, we employ a self-supervised graph attention neural network to facilitate model training, mitigating the impact of signal noise on the model. Finally, a semi-supervised approach is used to fine-tune the model, enhancing its generalization ability in cross-subject classification. By combining supervised and unsupervised learning techniques, the SFT-SGAT maximizes the utility of limited labeled data in EEG emotion recognition tasks, thereby enhancing the model's performance. Experiments based on leave-one-subject-out cross-validation demonstrate that SFT-SGAT achieves state-of-the-art cross-subject emotion recognition performance on the SEED and SEED-IV datasets, with accuracies of 92.04% and 82.76%, respectively. Furthermore, experiments conducted on a self-collected dataset comprising ten healthy subjects and eight patients with disorders of consciousness (DOCs) revealed that the SFT-SGAT attains high classification performance in healthy subjects (maximum accuracy of 95.84%) and was successfully applied to DOC patients, with four patients achieving emotion recognition accuracies exceeding 60%. The experiments demonstrate the effectiveness of the proposed SFT-SGAT model in cross-subject EEG emotion recognition and its potential for assessing levels of consciousness in patients with DOC.
EEG Emotion Recognition Based on GADF and AMB‐CNN Model

Qian Zhao,Dandan Zhao,Wuliang Yin

DOI: https://doi.org/10.1002/jnm.70000

2024-11-27

International Journal of Numerical Modelling Electronic Networks Devices and Fields

Abstract:ABSTRACT Deep learning has achieved better results in natural language processing, computer vision, and other fields. Nowadays, more deep learning algorithms have also been applied in brain‐based emotion recognition. In the studies on brain‐based emotion recognition, deep learning models typically use one‐dimensional time series as the input and cannot fully leverage the advantages of the models in image classification or recognition. To address this issue, based on the publicly available SEED and DEAP datasets, the Gramian angular difference field (GADF) method was proposed to construct two‐dimensional image representation datasets: SEED‐GADF and DEAP‐GADF datasets, in the paper. Additionally, a convolutional attention mechanism model (AMB‐CNN) was introduced and its classification performance was validated on SEED‐GADF and DEAP‐GADF datasets. AMB‐CNN achieved an average accuracy of 90.8%, a recall rate of 90%, and AUC of 96.86% on SEED‐GADF. On DEAP‐GADF, the average accuracy, recall rate, and AUC respectively reached 96.06%, 96.06%, and 98.58% in the valence dimension and 96.11%, 96.11%, and 98.73% in the arousal dimension. Finally, the comparison results with various algorithms and ablation experiments proved the superiority of the proposed model.

engineering, electrical & electronic,mathematics, interdisciplinary applications
Emotion Classification from Multi-Band Electroencephalogram Data Using Dynamic Simplifying Graph Convolutional Network and Channel Style Recalibration Module

Xiaoliang Zhu,Gendong Liu,Liang Zhao,Wenting Rong,Junyi Sun,Ran Liu

DOI: https://doi.org/10.3390/s23041917

IF: 3.9

2023-02-09

Sensors

Abstract:Because of its ability to objectively reflect people's emotional states, electroencephalogram (EEG) has been attracting increasing research attention for emotion classification. The classification method based on spatial-domain analysis is one of the research hotspots. However, most previous studies ignored the complementarity of information between different frequency bands, and the information in a single frequency band is not fully mined, which increases the computational time and the difficulty of improving classification accuracy. To address the above problems, this study proposes an emotion classification method based on dynamic simplifying graph convolutional (SGC) networks and a style recalibration module (SRM) for channels, termed SGC-SRM, with multi-band EEG data as input. Specifically, first, the graph structure is constructed using the differential entropy characteristics of each sub-band and the internal relationship between different channels is dynamically learned through SGC networks. Second, a convolution layer based on the SRM is introduced to recalibrate channel features to extract more emotion-related features. Third, the extracted sub-band features are fused at the feature level and classified. In addition, to reduce the redundant information between EEG channels and the computational time, (1) we adopt only 12 channels that are suitable for emotion classification to optimize the recognition algorithm, which can save approximately 90.5% of the time cost compared with using all channels; (2) we adopt information in the θ, α, β, and γ bands, consequently saving 23.3% of the time consumed compared with that in the full bands while maintaining almost the same level of classification accuracy. Finally, a subject-independent experiment is conducted on the public SEED dataset using the leave-one-subject-out cross-validation strategy. According to experimental results, SGC-SRM improves classification accuracy by 5.51–15.43% compared with existing methods.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Semi-supervised bipartite graph construction with active EEG sample selection for emotion recognition

Bowen Pang,Yong Peng,Jian Gao,Wanzeng Kong

DOI: https://doi.org/10.1007/s11517-024-03094-z

2024-08-19

Medical & Biological Engineering & Computing

Abstract:Electroencephalogram (EEG) signals are derived from the central nervous system and inherently difficult to camouflage, leading to the recent popularity of EEG-based emotion recognition. However, due to the non-stationary nature of EEG, inter-subject variabilities become obstacles for recognition models to well adapt to different subjects. In this paper, we propose a novel approach called semi-supervised bipartite graph construction with active EEG sample selection (SBGASS) for cross-subject emotion recognition, which offers two significant advantages. Firstly, SBGASS adaptively learns a bipartite graph to characterize the underlying relationships between labeled and unlabeled EEG samples, effectively implementing the semantic connection for samples from different subjects. Secondly, we employ active sample selection technique in this paper to reduce the impact of negative samples (outliers or noise in the data) on bipartite graph construction. Drawing from the experimental results with the SEED-IV data set, we have gained the following three insights. (1) SBGASS actively rejects negative labeled samples, which helps mitigate the impact of negative samples when constructing the optimal bipartite graph and improves the model performance. (2) Through the learned optimal bipartite graph in SBGASS, the transferability of labeled EEG samples is quantitatively analyzed, which exhibits a decreasing tendency as the distance between each labeled sample and the corresponding class centroid increases. (3) Besides the improved recognition accuracy, the spatial-frequency patterns in emotion recognition are investigated by the acquired projection matrix.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,medical informatics
EEG-Based Subject-Independent Emotion Recognition Using Gated Recurrent Unit and Minimum Class Confusion

Heng Cui,Aiping Liu,Xu Zhang,Xiang Chen,Jun Liu,Xun Chen

DOI: https://doi.org/10.1109/taffc.2022.3179717

IF: 13.99

2022-01-01

IEEE Transactions on Affective Computing

Abstract:Automatic emotion recognition based on electroencephalogram (EEG) has attracted rapidly increasing interests. Due to large inter-subject variabilities, subject-independent emotion recognition faces great challenges. Recently, domain adaptation methods have been successfully applied in this field due to their ability to align features from different subjects. However, since EEG signals corresponding to some emotions have similar oscillation patterns, they are often confused and aligned to the wrong categories, which limits the generalization ability of the model across subjects. Besides, almost all methods only support offline applications, which require collecting a large number of samples of new subjects. To achieve online recognition, a simpler model is needed. In this paper, a novel Gated Recurrent Unit-Minimum Class Confusion (GRU-MCC) model is proposed. Specifically, a simple feature extractor based on gated recurrent unit (GRU) is firstly applied to model the spatial dependence of multiple electrodes and obtain high-level discriminative features. Then, during training, minimum class confusion (MCC) loss is introduced to reduce the confusion between the correct and ambiguous classes for the target subject and increase the transfer gains. We conduct both offline and online experiments on two public datasets: SEED and MPED. The results indicate that our method can obtain the superior performance.

computer science, cybernetics, artificial intelligence
Cross-subject emotion recognition in brain-computer interface based on frequency band attention graph convolutional adversarial neural networks

Shinan Chen,Yuchen Wang,Xuefen Lin,Xiaoyong Sun,Weihua Li,Weifeng Ma

DOI: https://doi.org/10.1016/j.jneumeth.2024.110276

2024-09-03

Abstract:Background: Emotion is an important area in neuroscience. Cross-subject emotion recognition based on electroencephalogram (EEG) data is challenging due to physiological differences between subjects. Domain gap, which refers to the different distributions of EEG data at different subjects, has attracted great attention for cross-subject emotion recognition. Comparison with existing methods: This study focuses on narrowing the domain gap between subjects through the emotional frequency bands and the relationship information between EEG channels. Emotional frequency band features represent the energy distribution of EEG data in different frequency ranges, while relationship information between EEG channels provides spatial distribution information about EEG data. New method: To achieve this, this paper proposes a model called the Frequency Band Attention Graph convolutional Adversarial neural Network (FBAGAN). This model includes three components: a feature extractor, a classifier, and a discriminator. The feature extractor consists of a layer with a frequency band attention mechanism and a graph convolutional neural network. The mechanism effectively extracts frequency band information by assigning weights and Graph Convolutional Networks can extract relationship information between EEG channels by modeling the graph structure. The discriminator then helps minimize the gap in the frequency information and relationship information between the source and target domains, improving the model's ability to generalize. Results: The FBAGAN model is extensively tested on the SEED, SEED-IV, and DEAP datasets. The accuracy and standard deviation scores are 88.17% and 4.88, respectively, on the SEED dataset, and 77.35% and 3.72 on the SEED-IV dataset. On the DEAP dataset, the model achieves 69.64% for Arousal and 65.18% for Valence. These results outperform most existing models. Conclusions: The experiments indicate that FBAGAN effectively addresses the challenges of transferring EEG channel domain and frequency band domain, leading to improved performance.
Emotion Recognition Based on EEG Using Generative Adversarial Nets and Convolutional Neural Network

Bo Pan,Wei Zheng

DOI: https://doi.org/10.1155/2021/2520394

2021-10-11

Abstract:Emotion recognition plays an important role in the field of human-computer interaction (HCI). Automatic emotion recognition based on EEG is an important topic in brain-computer interface (BCI) applications. Currently, deep learning has been widely used in the field of EEG emotion recognition and has achieved remarkable results. However, due to the cost of data collection, most EEG datasets have only a small amount of EEG data, and the sample categories are unbalanced in these datasets. These problems will make it difficult for the deep learning model to predict the emotional state. In this paper, we propose a new sample generation method using generative adversarial networks to solve the problem of EEG sample shortage and sample category imbalance. In experiments, we explore the performance of emotion recognition with the frequency band correlation and frequency band separation computational models before and after data augmentation on standard EEG-based emotion datasets. Our experimental results show that the method of generative adversarial networks for data augmentation can effectively improve the performance of emotion recognition based on the deep learning model. And we find that the frequency band correlation deep learning model is more conducive to emotion recognition.
Dual-Encoder VAE-GAN With Spatiotemporal Features for Emotional EEG Data Augmentation

Chenxi Tian,Yuliang Ma,Jared Cammon,Feng Fang,Yingchun Zhang,Ming Meng

DOI: https://doi.org/10.1109/tnsre.2023.3266810

IF: 4.9

2023-04-21

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:The current data scarcity problem in EEG-based emotion recognition tasks leads to difficulty in building high-precision models using existing deep learning methods. To tackle this problem, a dual encoder variational autoencoder-generative adversarial network (DEVAE-GAN) incorporating spatiotemporal features is proposed to generate high-quality artificial samples. First, EEG data for different emotions are preprocessed as differential entropy features under five frequency bands and divided into segments with a 5s time window. Secondly, each feature segment is processed in two forms: the temporal morphology data and the spatial morphology data distributed according to the electrode position. Finally, the proposed dual encoder is trained to extract information from these two features, concatenate the two pieces of information as latent variables, and feed them into the decoder to generate artificial samples. To evaluate the effectiveness, a systematic experimental study was conducted in this work on the SEED dataset. First, the original training dataset is augmented with different numbers of generated samples; then, the augmented training datasets are used to train the deep neural network to construct the sentiment model. The results show that the augmented datasets generated by the proposed method have an average accuracy of 97.21% on all subjects, which is a 5% improvement compared to the original dataset, and the similarity between the generated data and the original data distribution is proved. These results demonstrate that our proposed model can effectively learn the distribution of raw data to generate high-quality artificial samples, which can effectively train a high-precision affective model.

engineering, biomedical,rehabilitation
MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition

Shuaiqi Liu,Xinrui Wang,Mingqi Jiang,Yanling An,Zhihui Gu,Bing Li,Yudong Zhang

DOI: https://doi.org/10.1016/j.knosys.2024.112599

IF: 8.139

2024-10-20

Knowledge-Based Systems

Abstract:In recent years, with the rise of deep learning technologies, EEG-based emotion recognition has garnered significant attention. However, most existing methods tend to focus on the spatiotemporal information of EEG signals while overlooking the potential topological information of brain regions. To address this issue, this paper proposes a dynamic graph attention network with multi-branch feature extraction and staged fusion (MAS-DGAT-Net), which integrates graph convolutional neural networks (GCN) for EEG emotion recognition. Specifically, the differential entropy (DE) features of EEG signals are first reconstructed into a correlation matrix using the Spearman correlation coefficient. Then, the brain-region connectivity-feature extraction (BCFE) module is employed to capture the brain connectivity features associated with emotional activation states. Meanwhile, this paper introduces a dual-branch cross-fusion feature extraction (CFFE) module, which consists of an attention-based cross-fusion feature extraction branch (A-CFFEB) and a cross-fusion feature extraction branch (CFFEB). A-CFFEB efficiently extracts key channel-frequency information from EEG features by using an attention mechanism and then fuses it with the output features from the BCFE. The fused features are subsequently input into the proposed dynamic graph attention module with a broad learning system (DGAT-BLS) to mine the brain connectivity feature information further. Finally, the deep features output by DGAT-BLS and CFFEB are combined for emotion classification. The proposed algorithm has been experimentally validated on SEED, SEED-IV, and DEAP datasets in subject-dependent and subject-independent settings, with the results confirming the model's effectiveness. The source code is publicly available at: https://github.com/cvmdsp/MAS-DGAT-Net

computer science, artificial intelligence

Hyperfraktionierte-akzelerierte simultane Radio-Chemo-Therapie bei fortgeschrittenen Hypopharynxkarzinomen Überlebensrate, Funktionserhalt und Lebensqualität in einer Phase-II-Studie

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Generative Listener EEG for Speech Emotion Recognition Using Generative Adversarial Networks with Compressed Sensing

EEG Emotion Recognition Model Based on Attention and GAN

Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition

GANSER: A Self-supervised Data Augmentation Framework for EEG-based Emotion Recognition

Data Augmentation for EEG-Based Emotion Recognition Using Generative Adversarial Networks

A Graph Neural Network for EEG-Based Emotion Recognition With Contrastive Learning and Generative Adversarial Neural Network Data Augmentation

Semi-supervised EEG emotion recognition model based on enhanced graph fusion and GCN

Transfer EEG Emotion Recognition by Combining Semi-Supervised Regression with Bipartite Graph Label Propagation

EEG Data Augmentation for Emotion Recognition with a Task-Driven GAN

DAGAM: A domain adversarial graph attention model for subject independent EEG-based emotion recognition

SFT-SGAT: A semi-supervised fine-tuning self-supervised graph attention network for emotion recognition and consciousness detection

EEG Emotion Recognition Based on GADF and AMB‐CNN Model

Emotion Classification from Multi-Band Electroencephalogram Data Using Dynamic Simplifying Graph Convolutional Network and Channel Style Recalibration Module

Semi-supervised bipartite graph construction with active EEG sample selection for emotion recognition

EEG-Based Subject-Independent Emotion Recognition Using Gated Recurrent Unit and Minimum Class Confusion

Cross-subject emotion recognition in brain-computer interface based on frequency band attention graph convolutional adversarial neural networks

Emotion Recognition Based on EEG Using Generative Adversarial Nets and Convolutional Neural Network

Dual-Encoder VAE-GAN With Spatiotemporal Features for Emotional EEG Data Augmentation

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition