Abstract:Abstract Objective. Previous studies on emotion recognition from electroencephalography (EEG) mainly rely on single-channel-based feature extraction methods, which ignore the functional connectivity between brain regions. Hence, in this paper, we propose a novel emotion-relevant critical subnetwork selection algorithm and investigate three EEG functional connectivity network features: strength, clustering coefficient, and eigenvector centrality. Approach. After constructing the brain networks by the correlations between pairs of EEG signals, we calculated critical subnetworks through the average of brain network matrices with the same emotion label to eliminate the weak associations. Then, three network features were conveyed to a multimodal emotion recognition model using deep canonical correlation analysis along with eye movement features. The discrimination ability of the EEG connectivity features in emotion recognition is evaluated on three public datasets: SEED, SEED-V, and DEAP. Main results . The experimental results reveal that the strength feature outperforms the state-of-the-art features based on single-channel analysis. The classification accuracies of multimodal emotion recognition are 95.08 ± 6.42 % on the SEED dataset, 84.51 ± 5.11 % on the SEED-V dataset, and 85.34 ± 2.90 % and 86.61 ± 3.76 % for arousal and valence on the DEAP dataset, respectively, which all achieved the best performance. In addition, the brain networks constructed with 18 channels achieve comparable performance with that of the 62-channel network and enable easier setups in real scenarios. Significance. The EEG functional connectivity networks combined with emotion-relevant critical subnetworks selection algorithm we proposed is a successful exploration to excavate the information between channels.

EEG-Based Emotion Recognition Using Convolutional Neural Network with Functional Connections.

Emotion recognition using effective connectivity and pre-trained convolutional neural networks in EEG signals

Convolutional Neural Networks on EEG-Based Emotion Recognition.

EEG-Based Emotion Recognition Using Partial Directed Coherence Dense Graph Propagation

EEG Signal Processing and Emotion Recognition Using Convolutional Neural Network

Parallel Sequence-Channel Projection Convolutional Neural Network for EEG-Based Emotion Recognition

A Channel-Fused Dense Convolutional Network for EEG-Based Emotion Recognition.

A Feature-Fused Convolutional Neural Network for Emotion Recognition from Multichannel EEG Signals

Investigating EEG-based functional connectivity patterns for multimodal emotion recognition

Emotion recognition with convolutional neural network and EEG-based EFDMs

Functional Connectivity Network Based Emotion Recognition Combining Sample Entropy

Emotion Recognition from EEG Signal Using CA-GCN

Graph Convolutional Neural Network for EEG Emotion Recognition

EEG-Based Emotion Recognition by Convolutional Neural Network with Multi-Scale Kernels

Emotion Recognition of EEG Signal Based on Improved Convolutional Neural Network

EEG emotion recognition approach using multi-scale convolution and feature fusion

EEG-Based Emotion Classification Using a Deep Neural Network and Sparse Autoencoder.

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features

Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks.

A Novel DE-CNN-BiLSTM Multi-Fusion Model for EEG Emotion Recognition

Deep Convolutional Neural Network For Emotion Recognition Using Eeg And Peripheral Physiological Signal