Chemotherapy (CAP) prior to radiotherapy (RT) and surgery in marginally resectable stage III M0 non-small cell lung cancer.

A. Skarin,A. Malcolm,N. Leslie,P. Oliynyk,R. Overholt,E. Frei

Abstract:

What problem does this paper attempt to address?

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Zhen-Tao Liu,Qiao Xie,Min Wu,Wei-Hua Cao,Dan-Yun Li,Si-Han Li

DOI: https://doi.org/10.1109/tcds.2018.2868121

IF: 4.546

2019-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Electroencephalogram (EEG) emotion recognition based on a hybrid feature extraction method in empirical mode decomposition domain combining with optimal feature selection based on sequence backward selection is proposed, which can reflect subtle information of multiscale components of unstable and nonlinear EEG signals and remove the reductant features to improve the performance of emotion recognition. The proposal is tested on DEAP dataset, in which the emotional states in the Valance dimension and Arousal dimension are classified by both K-nearest neighbor and support vector machine, respectively. In the experiments, temporal windows of different length and three kinds of rhythms of EEG signal are taken into account for comparison, from which the results show that EEG signal with 1s temporal window achieves highest recognition accuracy of 86.46% in Valence dimension and 84.90% in Arousal dimension, respectively, which is superior to some state-of-the-art works. The proposed method would be applied to real-time emotion recognition in multimodal emotional communication-based humans-robots interaction system.
A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals

Guanghao Yin,Shouqian Sun,Dian Yu,Dejian Li,Kejun Zhang

DOI: https://doi.org/10.1145/3490686

IF: 4.094

2022-01-01

ACM Transactions on Multimedia Computing Communications and Applications

Abstract:Considerable attention has been paid for physiological signal-based emotion recognition in field of affective computing. For the reliability and user friendly acquisition, Electrodermal Activity (EDA) has great advantage in practical applications. However, the EDA-based emotion recognition with hundreds of subjects still lacks effective solution. In this paper, our work makes an attempt to fuse the subject individual EDA features and the external evoked music features. And we propose an end-to-end multimodal framework, the 1-dimensional residual temporal and channel attention network (RTCAN-1D). For EDA features, the novel convex optimization-based EDA (CvxEDA) method is applied to decompose EDA signals into pahsic and tonic signals for mining the dynamic and steady features. The channel-temporal attention mechanism for EDA-based emotion recognition is firstly involved to improve the temporal- and channel-wise representation. For music features, we process the music signal with the open source toolkit openSMILE to obtain external feature vectors. The individual emotion features from EDA signals and external emotion benchmarks from music are fused in the classifing layers. We have conducted systematic comparisons on three multimodal datasets (PMEmo, DEAP, AMIGOS) for 2-classes valance/arousal emotion recognition. Our proposed RTCAN-1D outperforms the existing state-of-the-art models, which also validate that our work provides an reliable and efficient solution for large scale emotion recognition. Our code has been released at this https URL.
Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

Baixi Xing,Hui Zhang,Kejun Zhang,Lekai Zhang,Xinda Wu,Xiaoying Shi,Shanghai Yu,Sanyuan Zhang

DOI: https://doi.org/10.1109/ACCESS.2019.2914872

IF: 3.9

2019-01-01

IEEE Access

Abstract:External stimulation, mood swing, and physiological arousal are closely related and induced by each other. The exploration of internal relations between these three aspects is interesting and significant. Currently, video is the most popular multimedia stimuli that can express rich emotional semantics by its visual and auditory features. Apart from the video features, human electroencephalography (EEG) features can provide useful information for video emotion recognition, as they are the direct and instant authentic feedback on human perception with individuality. In this paper, we collected a total of 39 participants' EEG data induced by watching emotional video clips and built a fusion dataset of EEG and video features. Subsequently, the machine-learning algorithms, including Liblinear, REPTree, XGBoost, MultilayerPerceptron, RandomTree, and RBFNetwork were applied to obtain the optimal model for video emotion recognition based on a multi-modal dataset. We discovered that using the data fusion of all-band EEG power spectrum density features and video audio-visual features can achieve the best recognition results. The video emotion classification accuracy achieves 96.79% for valence (Positive/Negative) and 97.79% for arousal (High/Low). The study shows that this method can be a potential method of video emotion indexing for video information retrieval.
Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Jiaheng Wang,Yueming Wang,Lin Yao

DOI: https://doi.org/10.7507/1001-5515.202012054

2021-01-01

Abstract:Emotion plays an important role in people's cognition and communication. By analyzing electroencephalogram (EEG) signals to identify internal emotions and feedback emotional information in an active or passive way, affective brain-computer interactions can effectively promote human-computer interaction. This paper focuses on emotion recognition using EEG. We systematically evaluate the performance of state-of-the-art feature extraction and classification methods with a public-available dataset for emotion analysis using physiological signals (DEAP). The common random split method will lead to high correlation between training and testing samples. Thus, we use block-wise fold cross validation. Moreover, we compare the accuracy of emotion recognition with different time window length. The experimental results indicate that 4 s time window is appropriate for sampling. Filter-bank long short-term memory networks (FBLSTM) using differential entropy features as input was proposed. The average accuracy of low and high in valance dimension, arousal dimension and combination of the four in valance-arousal plane is 78.8%, 78.4% and 70.3%, respectively. These results demonstrate the advantage of our emotion recognition model over the current studies in terms of classification accuracy. Our model might provide a novel method for emotion recognition in affective brain-computer interactions.
Electroencephalogram Emotion Recognition Based on Dispersion Entropy Feature Extraction Using Random Oversampling Imbalanced Data Processing

Xue-Wen Ding,Zhen-Tao Liu,Dan-Yun Li,Yong He,Min Wu

DOI: https://doi.org/10.1109/tcds.2021.3074811

IF: 4.546

2022-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Electroencephalogram (EEG) is the brain’s electrical activity measure, which can reflect people’s inner emotional states objectively. In this article, a dispersion entropy (DispEn) feature extraction-based EEG emotion recognition method is proposed. In feature extraction, the DispEn is computed for the four typical frequency bands, i.e., $\theta $ , $\alpha $ , $\beta $ , and $\gamma $ of EEG signals which are filtered from 32 channels. Furthermore, a random oversampling algorithm is employed to balance the data for the emotional labels to avoid majority biases. The proposed method not only has a better ability to characterize EEG signals but also has a faster recognition speed. In the experiments, the DEAP dataset is used to validate the effectiveness of the proposal, in which the DispEn is extracted from the undecomposed signal and four typical EEG rhythms are compared for emotion recognition by using a support vector machine (SVM). Besides, comparison experiments using DispEn, sample entropy (SampEn), permutation entropy (PerEn), and three other commonly used statistical features are performed. The experimental results show that the proposed method achieves recognition accuracy in high valence (HV)/low valence (LV) and high arousal (HA)/low arousal (LA) is 72.95% and 76.67%, respectively. The computation cost of DispEn feature extraction is ${O}(N)$ that better than some state-of-the-art methods.
Music emotion recognition based on temporal convolutional attention network using EEG

Yinghao Qiao,Jiajia Mu,Jialan Xie,Binghui Hu,Guangyuan Liu

DOI: https://doi.org/10.3389/fnhum.2024.1324897

IF: 3.473

2024-03-29

Frontiers in Human Neuroscience

Abstract:Music is one of the primary ways to evoke human emotions. However, the feeling of music is subjective, making it difficult to determine which emotions music triggers in a given individual. In order to correctly identify emotional problems caused by different types of music, we first created an electroencephalogram (EEG) data set stimulated by four different types of music (fear, happiness, calm, and sadness). Secondly, the differential entropy features of EEG were extracted, and then the emotion recognition model CNN-SA-BiLSTM was established to extract the temporal features of EEG, and the recognition performance of the model was improved by using the global perception ability of the self-attention mechanism. The effectiveness of the model was further verified by the ablation experiment. The classification accuracy of this method in the valence and arousal dimensions is 93.45% and 96.36%, respectively. By applying our method to a publicly available EEG dataset DEAP, we evaluated the generalization and reliability of our method. In addition, we further investigate the effects of different EEG bands and multi-band combinations on music emotion recognition, and the results confirm relevant neuroscience studies. Compared with other representative music emotion recognition works, this method has better classification performance, and provides a promising framework for the future research of emotion recognition system based on brain computer interface.

psychology,neurosciences
Electroencephalography Emotion Recognition Based on Rhythm Information Entropy Extraction

Zhen-Tao Liu,Xin Xu,Jinhua She,Zhaohui Yang,Dan Chen

DOI: https://doi.org/10.20965/jaciii.2024.p1095

2024-01-01

Journal of Advanced Computational Intelligence and Intelligent Informatics

Abstract:Electroencephalography (EEG) is a physiological signal directly generated by the central nervous system. Brain rhythm is closely related to a person's emotional state and is widely used for EEG emotion recognition. In previous studies, the rhythm specificity between different brain channels was seldom explored. In this paper, the rhythm specificity of brain channels is studied to improve the accuracy of EEG emotion recognition. Variational mode decomposition is used to decompose rhythm signals and enhance features, and two kinds of information entropy, i.e., differential entropy (DE) and dispersion entropy (DispEn) are extracted. The rhythm being used to get the best result of single channel emotion recognition is selected as the representative rhythm, and the remove one method is employed to obtain rhythm information entropy feature. In the experiment, the DEAP database was used for EEG emotion recognition in valence-arousal space. The results showed that the best result of rhythm DE feature classification in the valence dimension is 77.04%, and the best result of rhythm DispEn feature classification in the arousal dimension is 79.25%.
EEG emotion recognition using multichannel weighted multiscale permutation entropy

Zhong-Min Wang,Jia-Wen Zhang,Yan He,Jie Zhang,Zhong-Min Wang,Jia-Wen Zhang,Yan He,Jie Zhang

DOI: https://doi.org/10.1007/s10489-021-03070-2

IF: 5.3

2022-01-31

Applied Intelligence

Abstract:Electroencephalogram (EEG) signal is a time-varying and nonlinear spatial discrete signal, which has been widely used in the field of emotion recognition. Up to now, a large number of studies have chosen time–frequency domain features or extracted features through brain networks. However, partial spatial or time–frequency information of EEG signals will be lost when analyzing from a single point of view. At the same time, the network analysis based on EEG is largely affected by the inherent volume effect of EEG. Therefore, how to eliminate the influence of volume effect on brain network analysis and extract the features that can reflect both time–frequency information and spatial information is the problem we need to solve at present. In this paper, a feature fusion method that can better reflect the emotional state is proposed. This method uses multichannel weighted multiscale permutation entropy (MC-WMPE) as the feature. It not only takes into account the time–frequency and spatial information of EEG signals but also eliminates the inherent volume effect of EEG signals. We first calculate the multiscale permutation entropy (MPE) of the EEG signals in each channel and construct the brain functional network by calculating the Pearson correlation coefficient (PCC) between each channel. PageRank algorithm is used to sort the importance of nodes in the brain functional network, and the weight of each node is obtained to screen out the important channels in emotion recognition. Then the weights of each channel and the MPE are weighted combined to obtain MC-WMPE as the feature. The research shows that both temporal information and spatial information are of great significance in processing EEG signals. Moreover, the analysis of the frontal, parietal and occipital lobes is necessary for studying the activity state of the cerebral cortex under emotional stimulation. Finally, we carried out experiments on the DEAP and SEED database, and the highest accuracy rate of emotion recognition with this combination feature is 85.28% and 87.31%.

computer science, artificial intelligence
Electroencephalogram Emotion Recognition Using Variational Modal Decomposition Based Dispersion Entropy Feature Extraction

Si-Jun Hu,Zhen-Tao Liu,Xue-Wen Ding

DOI: https://doi.org/10.23919/ccc52363.2021.9549884

2021-01-01

Abstract:Electroencephalogram (EEG) emotion recognition has gained considerable attention due to its ability to reflect people's inner emotional states objectively and naturally. Feature extraction is a critical step in EEG emotion recognition because of non-stationarity and irregularity of EEG signals. A feature extraction method using Variational Modal Decomposition (VMD) to extract Dispersion Entropy (DispEn) is proposed in this paper. Raw EEG signal is decomposed into several components, and DispEn of each component is extracted in eight emotion-related channels. Our method was tested on DEAP dataset in which the EEG emotional states are accessed in Valence-Arousal emotional space. Four emotional states (i.e., HVHA, HVLA, LVHA, LVLA) are classified by Support Vector Machine (SVM). The experimental results show that the accuracy of emotion recognition is 77.87%, which demonstrates its effectiveness.
An innovative EEG-based emotion recognition using a single channel-specific feature from the brain rhythm code method

Jia Wen Li,Di Lin,Yan Che,Ju Jian Lv,Rong Jun Chen,Lei Jun Wang,Xian Xian Zeng,Jin Chang Ren,Hui Min Zhao,Xu Lu

DOI: https://doi.org/10.3389/fnins.2023.1221512

IF: 4.3

2023-07-21

Frontiers in Neuroscience

Abstract:Introduction: Efficiently recognizing emotions is a critical pursuit in brain–computer interface (BCI), as it has many applications for intelligent healthcare services. In this work, an innovative approach inspired by the genetic code in bioinformatics, which utilizes brain rhythm code features consisting of δ, θ, α, β, or γ, is proposed for electroencephalography (EEG)-based emotion recognition. Methods: These features are first extracted from the sequencing technique. After evaluating them using four conventional machine learning classifiers, an optimal channel-specific feature that produces the highest accuracy in each emotional case is identified, so emotion recognition through minimal data is realized. By doing so, the complexity of emotion recognition can be significantly reduced, making it more achievable for practical hardware setups. Results: The best classification accuracies achieved for the DEAP and MAHNOB datasets range from 83–92%, and for the SEED dataset, it is 78%. The experimental results are impressive, considering the minimal data employed. Further investigation of the optimal features shows that their representative channels are primarily on the frontal region, and associated rhythmic characteristics are typical of multiple kinds. Additionally, individual differences are found, as the optimal feature varies with subjects. Discussion: Compared to previous studies, this work provides insights into designing portable devices, as only one electrode is appropriate to generate satisfactory performances. Consequently, it would advance the understanding of brain rhythms, which offers an innovative solution for classifying EEG signals in diverse BCI applications, including emotion recognition.

neurosciences
Comparison of different feature extraction methods for EEG-based emotion recognition

Rab Nawaz,Kit Hwa Cheah,Humaira Nisar,Vooi Voon Yap

DOI: https://doi.org/10.1016/j.bbe.2020.04.005

IF: 5.687

2020-07-01

Biocybernetics and Biomedical Engineering

Abstract:EEG-based emotion recognition is a challenging and active research area in affective computing. We used three-dimensional (arousal, valence and dominance) model of emotion to recognize the emotions induced by music videos. The participants watched a video (1 min long) while their EEG was recorded. The main objective of the study is to identify the features that can best discriminate the emotions. Power, entropy, fractal dimension, statistical features and wavelet energy are extracted from the EEG signals. The effects of these features are investigated and the best features are identified. The performance of the two feature selection methods, Relief based algorithm and principle component analysis (PCA), is compared. PCA is adopted because of its improved performance and the efficacies of the features are validated using support vector machine, K-nearest neighbors and decision tree classifiers. Our system achieves an overall best classification accuracy of 77.62%, 78.96% and 77.60% for valence, arousal and dominance respectively. Our results demonstrated that time-domain statistical characteristics of EEG signals can efficiently discriminate different emotional states. Also, the use of three-dimensional emotion model is able to classify similar emotions that were not correctly classified by two-dimensional model (e.g. anger and fear). The results of this study can be used to support the development of real-time EEG-based emotion recognition systems.

engineering, biomedical
EEG emotion recognition approach using multi-scale convolution and feature fusion

Shan, Qingguo,Chen, Wenyun

DOI: https://doi.org/10.1007/s00371-024-03652-4

IF: 2.835

2024-09-20

The Visual Computer

Abstract:Electroencephalogram (EEG) signal has been widely applied in emotion recognition due to its objectivity and reflection of an individual's actual emotional state. However, current EEG-based emotion recognition methods still suffer from limitations such as single-feature extraction, missing local features, and low feature extraction rates, all of which affect emotion recognition accuracy. To address these challenges, we propose an EEG emotion recognition approach based on multi-scale convolution and feature fusion, aimed at integrating low-dimensional and high-dimensional EEG features to enhance classification performance. The proposed approach first extracts multi-scale features of EEG using a multi-scale convolutional neural network. Subsequently, it employs the convolutional block attention module to further refine the obtained multi-scale features, highlighting emotion-related high-quality features while suppressing unimportant features. Finally, emotion-related time series are extracted by long short-term memory (LSTM) networks to achieve time–space–frequency feature fusion of EEG. We conducted fivefold cross-validation on the DEAP and SEED datasets to demonstrate the effectiveness of the proposed approach. For the DEAP dataset, the proposed approach achieved average accuracies of 97.48% and 97.75% for valence and arousal dimensions, respectively, and 96.98% for the SEED dataset, outperforming other models in terms of recognition accuracy.

computer science, software engineering
EEG-Based Emotion Recognition for Hearing Impaired and Normal Individuals With Residual Feature Pyramids Network Based on Time–Frequency–Spatial Features

Qiang Gao,Yu Song,Junjie Liu,Zhongli Bai,Zhiyi Yang,Fazheng Hou,Jiayin Liu

DOI: https://doi.org/10.1109/TIM.2023.3240230

IF: 5.6

IEEE Transactions on Instrumentation and Measurement

Abstract:With the development of affective computing, discriminative feature selection is critical for electroencephalography (EEG) emotion recognition. In this article, we fused four EEG feature matrices constructed by the preprocessed signal, the differential entropy (DE), the symmetric difference, and the symmetric quotient based on the International 10–20 system, which integrates time-, frequency-, and spatial-domain information of EEG signals. For the feature classification model, we used the space-to-depth (S2D) layer instead of the convolutional neural network (CNN) as the backbone to reduce the calculation of the model without affecting the classification performance. The residual feature pyramid network (RFPN) was proposed to obtain the correlation of channels, and then, the deep multiscale semantic information of EEG feature maps is captured. The emotion classification strategy was evaluated by DEAP, SEED, SEED-IV, and our hearing-impaired EEG dataset (HIED). The classification accuracies were 93.56% (four-class, DEAP), 96.84% (three-class, SEED), 91.62% (four-class, SEED-IV), and 87.74% (six-class, HIED). Furthermore, we also found that the difference in emotional response between the left and right brain regions of hearing-impaired subjects is more obvious than that of normal subjects.

Computer Science,Medicine
A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

Vikrant Doma,Matin Pirouz

DOI: https://doi.org/10.1186/s40537-020-00289-7

2020-03-11

Journal Of Big Data

Abstract:Abstract Emotion recognition using brain signals has the potential to change the way we identify and treat some health conditions. Difficulties and limitations may arise in general emotion recognition software due to the restricted number of facial expression triggers, dissembling of emotions, or among people with alexithymia. Such triggers are identified by studying the continuous brainwaves generated by human brain. Electroencephalogram (EEG) signals from the brain give us a more diverse insight on emotional states that one may not be able to express. Brainwave EEG signals can reflect the changes in electrical potential resulting from communications networks between neurons. This research involves analyzing the epoch data from EEG sensor channels and performing comparative analysis of multiple machine learning techniques [namely Support Vector Machine (SVM), K-nearest neighbor, Linear Discriminant Analysis, Logistic Regression and Decision Trees each of these models] were tested with and without principal component analysis (PCA) for dimensionality reduction. Grid search was also utilized for hyper-parameter tuning for each of the tested machine learning models over Spark cluster for lowered execution time. The DEAP Dataset was used in this study, which is a multimodal dataset for the analysis of human affective states. The predictions were based on the labels given by the participants for each of the 40 1-min long excerpts of music. music. Participants rated each video in terms of the level of arousal, valence, like/dislike, dominance and familiarity. The binary class classifiers were trained on the time segmented, 15 s intervals of epoch data, individually for each of the 4 classes. PCA with SVM performed the best and produced an F1-score of 84.73% with 98.01% recall in the 30th to 45th interval of segmentation. For each of the time segments and “a binary training class” a different classification model converges to a better accuracy and recall than others. The results prove that different classification models must be used to identify different emotional states.

English Else
A study on the combination of functional connection features and Riemannian manifold in EEG emotion recognition

Minchao Wu,Rui Ouyang,Chang Zhou,Zitong Sun,Fan Li,Ping Li

DOI: https://doi.org/10.3389/fnins.2023.1345770

IF: 4.3

2024-01-16

Frontiers in Neuroscience

Abstract:Introduction: Affective computing is the core for Human-computer interface (HCI) to be more intelligent, where electroencephalogram (EEG) based emotion recognition is one of the primary research orientations. Besides, in the field of brain-computer interface, Riemannian manifold is a highly robust and effective method. However, the symmetric positive definiteness (SPD) of the features limits its application. Methods: In the present work, we introduced the Laplace matrix to transform the functional connection features, i.e., phase locking value (PLV), Pearson correlation coefficient (PCC), spectral coherent (COH), and mutual information (MI), to into semi-positive, and the max operator to ensure the transformed feature be positive. Then the SPD network is employed to extract the deep spatial information and a fully connected layer is employed to validate the effectiveness of the extracted features. Particularly, the decision layer fusion strategy is utilized to achieve more accurate and stable recognition results, and the differences of classification performance of different feature combinations are studied. What's more, the optimal threshold value applied to the functional connection feature is also studied. Results: The public emotional dataset, SEED, is adopted to test the proposed method with subject dependent cross-validation strategy. The result of average accuracies for the four features indicate that PCC outperform others three features. The proposed model achieve best accuracy of 91.05% for the fusion of PLV, PCC, and COH, followed by the fusion of all four features with the accuracy of 90.16%. Discussion: The experimental results demonstrate that the optimal thresholds for the four functional connection features always kept relatively stable within a fixed interval. In conclusion, the experimental results demonstrated the effectiveness of the proposed method.

neurosciences
EEG decoding for musical emotion with functional connectivity features

Jiayang Xu,Wenxia Qian,Liangliang Hu,Guangyuan Liao,Yin Tian

DOI: https://doi.org/10.1016/j.bspc.2023.105744

IF: 5.1

2023-11-23

Biomedical Signal Processing and Control

Abstract:Emotion refers to the subjective emotional experience that humans generate in specific situations, typically accompanied by physiological and psychological changes. In the field of emotions, multi-channel EEG emotional features can better reflect the collaborative mechanisms across multiple brain regions. Therefore, we propose a novel feature called asPLV (averaged sub-frequency phase locking value) based on the Morlet transform method to construct functional network edges. The proposed feature encompasses a comprehensive analysis of phase synchronization across sub-frequency bands spanning a wide range of frequencies and has the potential to reduce fluctuations arising from reliance on a single frequency band. We designed a music-evoked emotion experiment aimed at inducing corresponding emotions in participants while simultaneously recording their electroencephalogram (EEG) signals and extracted our proposed asPLV feature for classification. The results show that the proposed feature displays superior classification performance and generalization compared to other state-of-the-art methods. The proposed method is not only effective in successfully distinguishing between different emotions but also introduces a novel brain network metric to elucidate the collaboration and information exchange among emotion-related brain regions. Moreover, the asPLV feature could provide new insights for the development of an emotional brain-computer interface (BCI).

engineering, biomedical
Electroencephalogram Emotion Recognition Using Combined Features in Variational Mode Decomposition Domain

Zhen-Tao Liu,Si-Jun Hu,Jinhua She,Zhaohui Yang,Xin Xu

DOI: https://doi.org/10.1109/tcds.2022.3233858

IF: 4.546

2023-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Using Electroencephalogram (EEG) to recognize human emotion has attracted increasing attention. However, features extraction from EEG is a challenging work because it is a non-stationary continuous sequential signal. To obtain more pattern information, a combined features extraction method in Variational Mode Decomposition (VMD) domain is proposed, which can extract local features of EEG signals to overcome the effects caused by non-stationarity. This method first decomposes EEG into several components using VMD, and then combined features of Differential Entropy (DE) and Short-Time Energy (STE) are extracted from each component. To optimize combined features, the important features are selected by tree modes, and the feature set is dimensionally reduced by further using Linear Discriminant Analysis (LDA). Moreover, an XGBoost classifier with Bayesian optimization is presented to classify different emotional states. Binary-class and multi-class EEG emotion recognition are conducted on the DEAP dataset, from which the experimental results show that accuracy of binary-class classification is 81.77% for High/Low Valence and 80.47% for High/Low Arousal, and accuracy of 91.41%, 94.27%, 94.27% and 93.49% are obtained for HVHA, LVHA, LVLA and HVLA, respectively, which demonstrate its effectiveness.

robotics,computer science, artificial intelligence,neurosciences
Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.

Qi Li,Yunqing Liu,Quanyang Liu,Qiong Zhang,Fei Yan,Yimin Ma,Xinyu Zhang

DOI: https://doi.org/10.3390/e24121830

IF: 2.738

2022-01-01

Entropy

Abstract:As a major daily task for the popularization of artificial intelligence technology, more and more attention has been paid to the scientific research of mental state electroencephalogram (EEG) in recent years. To retain the spatial information of EEG signals and fully mine the EEG timing-related information, this paper proposes a novel EEG emotion recognition method. First, to obtain the frequency, spatial, and temporal information of multichannel EEG signals more comprehensively, we choose the multidimensional feature structure as the input of the artificial neural network. Then, a neural network model based on depthwise separable convolution is proposed, extracting the input structure's frequency and spatial features. The network can effectively reduce the computational parameters. Finally, we modeled using the ordered neuronal long short-term memory (ON-LSTM) network, which can automatically learn hierarchical information to extract deep emotional features hidden in EEG time series. The experimental results show that the proposed model can reasonably learn the correlation and temporal dimension information content between EEG multi-channel and improve emotion classification performance. We performed the experimental validation of this paper in two publicly available EEG emotional datasets. In the experiments on the DEAP dataset (a dataset for emotion analysis using EEG, physiological, and video signals), the mean accuracy of emotion recognition for arousal and valence is 95.02% and 94.61%, respectively. In the experiments on the SEED dataset (a dataset collection for various purposes using EEG signals), the average accuracy of emotion recognition is 95.49%.
EEG-Based Emotion Classification with Wavelet Entropy Feature

Xiaolin Song,Qiaoju Kang,Zekun Tian,Yi Yang,Sihao Yang,Qiang Gao,Yu Song

DOI: https://doi.org/10.1109/cac51589.2020.9326323

2020-01-01

Abstract:Traditional emotion recognition methods are mainly based on voice, expression and body movement. These physiological signals or facial expressions may hardly reveal inner emotions. In this paper, the wavelet entropy (WE) was utilized to represent the characteristics associated with emotional states. The average classification accuracies of positive, neutral and negative emotions are 70.65%, 70.53% and 70.28%, respectively. In order to demonstrate the effectiveness of the proposed method, the comparison experiments were carried out by the power spectrum density (PSD) feature and approximate entropy (ApEn) feature. The average classification accuracies are 70.49% (WE), 66.93% (PSD) and 64.44% (ApEn), respectively. The results indicate that the wavelet entropy feature performs better than the other two features for Electroencephalogram (EEG) based emotion recognition.
EEG Emotion Recognition Applied to the Effect Analysis of Music on Emotion Changes in Psychological Healthcare

Wenlong Liang,H. Liu,K. Ryu,K. Nam,T. Zhou,Ling Wang

DOI: https://doi.org/10.3390/ijerph20010378

IF: 4.614

2022-12-26

International Journal of Environmental Research and Public Health

Abstract:Music therapy is increasingly being used to promote physical health. Emotion semantic recognition is more objective and provides direct awareness of the real emotional state based on electroencephalogram (EEG) signals. Therefore, we proposed a music therapy method to carry out emotion semantic matching between the EEG signal and music audio signal, which can improve the reliability of emotional judgments, and, furthermore, deeply mine the potential influence correlations between music and emotions. Our proposed EER model (EEG-based Emotion Recognition Model) could identify 20 types of emotions based on 32 EEG channels, and the average recognition accuracy was above 90% and 80%, respectively. Our proposed music-based emotion classification model (MEC model) could classify eight typical emotion types of music based on nine music feature combinations, and the average classification accuracy was above 90%. In addition, the semantic mapping was analyzed according to the influence of different music types on emotional changes from different perspectives based on the two models, and the results showed that the joy type of music video could improve fear, disgust, mania, and trust emotions into surprise or intimacy emotions, while the sad type of music video could reduce intimacy to the fear emotion.

Medicine,Psychology

Chemotherapy (CAP) prior to radiotherapy (RT) and surgery in marginally resectable stage III M0 non-small cell lung cancer.

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Electroencephalogram Emotion Recognition Based on Dispersion Entropy Feature Extraction Using Random Oversampling Imbalanced Data Processing

Music emotion recognition based on temporal convolutional attention network using EEG

Electroencephalography Emotion Recognition Based on Rhythm Information Entropy Extraction

EEG emotion recognition using multichannel weighted multiscale permutation entropy

Electroencephalogram Emotion Recognition Using Variational Modal Decomposition Based Dispersion Entropy Feature Extraction

An innovative EEG-based emotion recognition using a single channel-specific feature from the brain rhythm code method

Comparison of different feature extraction methods for EEG-based emotion recognition

EEG emotion recognition approach using multi-scale convolution and feature fusion

EEG-Based Emotion Recognition for Hearing Impaired and Normal Individuals With Residual Feature Pyramids Network Based on Time–Frequency–Spatial Features

A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

A study on the combination of functional connection features and Riemannian manifold in EEG emotion recognition

EEG decoding for musical emotion with functional connectivity features

Electroencephalogram Emotion Recognition Using Combined Features in Variational Mode Decomposition Domain

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.

EEG-Based Emotion Classification with Wavelet Entropy Feature

EEG Emotion Recognition Applied to the Effect Analysis of Music on Emotion Changes in Psychological Healthcare