Abstract:In recent years, emotion recognition based on electroencephalography (EEG) signals has attracted plenty of attention. Most of the existing works focused on normal or depressed people. Due to the lack of hearing ability, it is difficult for hearing-impaired people to express their emotions through language in their social activities. In this work, we collected the EEG signals of hearing-impaired subjects when they were watching six kinds of emotional video clips (happiness, inspiration, neutral, anger, fear, and sadness) for emotion recognition. The biharmonic spline interpolation method was utilized to convert the traditional frequency domain features, Differential Entropy (DE), Power Spectral Density (PSD), and Wavelet Entropy (WE) into the spatial domain. The patch embedding (PE) method was used to segment the feature map into the same patch to obtain the differences in the distribution of emotional information among brain regions. For feature classification, a compact residual network with Depthwise convolution (DC) and Pointwise convolution (PC) is proposed to separate spatial and channel mixing dimensions to better extract information between channels. Dependent subject experiments based on 70% training sets and 30% testing sets were performed. The results showed that the average classification accuracies by PE (DE), PE (PSD), and PE (WE) were 91.75%, 85.53%, and 75.68%, respectively which were improved by 11.77%, 23.54%, and 16.61% compared with DE, PSD, and WE. Moreover, the comparison experiments were carried out on the SEED and DEAP datasets with PE (DE), which achieved average accuracies of 90.04% (positive, neutral, and negative) and 88.75% (high valence and low valence). By exploring the emotional brain regions, we found that the frontal, parietal, and temporal lobes of hearing-impaired people were associated with emotional activity compared to normal people whose main emotional brain area was the frontal lobe.

EEG-based Emotion Recognition in Chinese Emotional Words

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

A Survey on EEG Based Emotion Recognition

EEG-Based Emotion Recognition Fusing Spacial-Frequency Domain Features and Data-Driven Spectrogram-Like Features.

Emotion Recognition Based on EEG Signals Using LIBSVM as the Classifier

EEG-based Emotion Recognition Using Nonlinear Feature

Neural Patterns Between Chinese and Germans for EEG-based Emotion Recognition

Emotion recognition with convolutional neural network and EEG-based EFDMs

A Symbolic Representation Approach of EEG Signals for Emotion Recognition.

Electroencephalogram Emotion Recognition Using Combined Features in Variational Mode Decomposition Domain

Emotion recognition with residual network driven by spatial-frequency characteristics of EEG recorded from hearing-impaired adults in response to video clips

Research Progress of EEG-Based Emotion Recognition: A Survey

EEG-based emotion recognition using frequency domain features and support vector machines

A review of EEG features for emotion recognition

EEG-Based Emotion Recognition by Exploiting Fused Network Entropy Measures of Complex Networks Across Subjects.

A Novel Consciousness Emotion Recognition Method Using ERP Components and MMSE.

Mixed Emotion Recognition Based on EEG Signals

EMOTION RECOGNITION BASED ON REPRESENTATION DISSIMILARITY MATRIX

EEG-based Emotion Estimation Using Adaptive Tracking of Discriminative Frequency Components

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory