Abstract:Electroencephalogram (EEG) signal is a time-varying and nonlinear spatial discrete signal, which has been widely used in the field of emotion recognition. Up to now, a large number of studies have chosen time–frequency domain features or extracted features through brain networks. However, partial spatial or time–frequency information of EEG signals will be lost when analyzing from a single point of view. At the same time, the network analysis based on EEG is largely affected by the inherent volume effect of EEG. Therefore, how to eliminate the influence of volume effect on brain network analysis and extract the features that can reflect both time–frequency information and spatial information is the problem we need to solve at present. In this paper, a feature fusion method that can better reflect the emotional state is proposed. This method uses multichannel weighted multiscale permutation entropy (MC-WMPE) as the feature. It not only takes into account the time–frequency and spatial information of EEG signals but also eliminates the inherent volume effect of EEG signals. We first calculate the multiscale permutation entropy (MPE) of the EEG signals in each channel and construct the brain functional network by calculating the Pearson correlation coefficient (PCC) between each channel. PageRank algorithm is used to sort the importance of nodes in the brain functional network, and the weight of each node is obtained to screen out the important channels in emotion recognition. Then the weights of each channel and the MPE are weighted combined to obtain MC-WMPE as the feature. The research shows that both temporal information and spatial information are of great significance in processing EEG signals. Moreover, the analysis of the frontal, parietal and occipital lobes is necessary for studying the activity state of the cerebral cortex under emotional stimulation. Finally, we carried out experiments on the DEAP and SEED database, and the highest accuracy rate of emotion recognition with this combination feature is 85.28% and 87.31%.

EEG emotion recognition based on data-driven signal auto-segmentation and feature fusion

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

EEG-Based Emotion Recognition Fusing Spacial-Frequency Domain Features and Data-Driven Spectrogram-Like Features.

EEG-based Emotion Recognition with Feature Fusion Networks.

EEG emotion recognition approach using multi-scale convolution and feature fusion

HASTF: a hybrid attention spatio-temporal feature fusion network for EEG emotion recognition

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition

Study on multidimensional emotion recognition fusing dynamic brain network features in EEG signals

Dynamic differential entropy and brain connectivity features based EEG emotion recognition

EEG-Based Emotion Recognition by Exploiting Fused Network Entropy Measures of Complex Networks Across Subjects.

A Feature-Fused Convolutional Neural Network for Emotion Recognition from Multichannel EEG Signals

Emotion recognition with convolutional neural network and EEG-based EFDMs

EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM

EEG Emotion Recognition Based on Frequency and Channel Convolutional Attention

Emotion Recognition From Multi-Channel EEG via Deep Forest

EEG emotion recognition using multichannel weighted multiscale permutation entropy

Emotion Recognition Using the Fusion of Frontal 2-channel EEG Signals and Peripheral Physiological Signals.

EEG Emotion Recognition Based on 3-D Feature Representation and Dilated Fully Convolutional Networks

Electroencephalogram Emotion Recognition Based on 3D Feature Fusion and Convolutional Autoencoder.

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Fusion of EEG-Based Activation, Spatial, and Connection Patterns for Fear Emotion Recognition