Abstract:In recent years, emotion recognition based on electroencephalography (EEG) signals has attracted plenty of attention. Most of the existing works focused on normal or depressed people. Due to the lack of hearing ability, it is difficult for hearing-impaired people to express their emotions through language in their social activities. In this work, we collected the EEG signals of hearing-impaired subjects when they were watching six kinds of emotional video clips (happiness, inspiration, neutral, anger, fear, and sadness) for emotion recognition. The biharmonic spline interpolation method was utilized to convert the traditional frequency domain features, Differential Entropy (DE), Power Spectral Density (PSD), and Wavelet Entropy (WE) into the spatial domain. The patch embedding (PE) method was used to segment the feature map into the same patch to obtain the differences in the distribution of emotional information among brain regions. For feature classification, a compact residual network with Depthwise convolution (DC) and Pointwise convolution (PC) is proposed to separate spatial and channel mixing dimensions to better extract information between channels. Dependent subject experiments based on 70% training sets and 30% testing sets were performed. The results showed that the average classification accuracies by PE (DE), PE (PSD), and PE (WE) were 91.75%, 85.53%, and 75.68%, respectively which were improved by 11.77%, 23.54%, and 16.61% compared with DE, PSD, and WE. Moreover, the comparison experiments were carried out on the SEED and DEAP datasets with PE (DE), which achieved average accuracies of 90.04% (positive, neutral, and negative) and 88.75% (high valence and low valence). By exploring the emotional brain regions, we found that the frontal, parietal, and temporal lobes of hearing-impaired people were associated with emotional activity compared to normal people whose main emotional brain area was the frontal lobe.

Emotion Recognition Based on Low-Cost In-Ear EEG.

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

An Efficient Machine Learning-Based Emotional Valence Recognition Approach Towards Wearable EEG

Electroencephalogram Emotion Recognition Based on Dispersion Entropy Feature Extraction Using Random Oversampling Imbalanced Data Processing

Wearable Wireless Dual-Channel EEG System for Emotion Recognition Based on Machine Learning

Eeg-Based Emotion Recognition in Music Listening

Emotion Recognition with Machine Learning Using EEG Signals

Design and Implementation of an Emotion Analysis System Based on EEG Signals

Affective Computing on Machine Learning-Based Emotion Recognition Using a Self-Made EEG Device

An EEG-Based Brain-Computer Interface for Emotion Recognition.

Emotion recognition with residual network driven by spatial-frequency characteristics of EEG recorded from hearing-impaired adults in response to video clips

Emotion Recognition of Subjects With Hearing Impairment Based on Fusion of Facial Expression and EEG Topographic Map

Selection of Optimal EEG Electrodes for Human Emotion Recognition

A Novel Spatio-Temporal Field for Emotion Recognition Based on EEG Signals

An innovative EEG-based emotion recognition using a single channel-specific feature from the brain rhythm code method

Consumer Grade Brain Sensing for Emotion Recognition

Emotion recognition with convolutional neural network and EEG-based EFDMs

Improving Emotion Analysis For Speech-Induced Eegs Through Eemd-Hht-Based Feature Extraction And Electrode Selection

A Portable HCI System‐oriented EEG Feature Extraction and Channel Selection for Emotion Recognition

EEG-Based Emotion Recognition Fusing Spacial-Frequency Domain Features and Data-Driven Spectrogram-Like Features.