Abstract:As a major daily task for the popularization of artificial intelligence technology, more and more attention has been paid to the scientific research of mental state electroencephalogram (EEG) in recent years. To retain the spatial information of EEG signals and fully mine the EEG timing-related information, this paper proposes a novel EEG emotion recognition method. First, to obtain the frequency, spatial, and temporal information of multichannel EEG signals more comprehensively, we choose the multidimensional feature structure as the input of the artificial neural network. Then, a neural network model based on depthwise separable convolution is proposed, extracting the input structure's frequency and spatial features. The network can effectively reduce the computational parameters. Finally, we modeled using the ordered neuronal long short-term memory (ON-LSTM) network, which can automatically learn hierarchical information to extract deep emotional features hidden in EEG time series. The experimental results show that the proposed model can reasonably learn the correlation and temporal dimension information content between EEG multi-channel and improve emotion classification performance. We performed the experimental validation of this paper in two publicly available EEG emotional datasets. In the experiments on the DEAP dataset (a dataset for emotion analysis using EEG, physiological, and video signals), the mean accuracy of emotion recognition for arousal and valence is 95.02% and 94.61%, respectively. In the experiments on the SEED dataset (a dataset collection for various purposes using EEG signals), the average accuracy of emotion recognition is 95.49%.

Long Short Term Memory Recurrent Neural Network Based Multimodal Dimensional Emotion Recognition

Continuous Multimodal Emotion Prediction Based on Long Short Term Memory Recurrent Neural Network

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals

Multimodal Continuous Emotion Recognition with Data Augmentation Using Recurrent Neural Networks

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Long Short Term Memory Recurrent Neural Network Based Encoding Method for Emotion Recognition in Video.

Multi-scale Temporal Modeling for Dimensional Emotion Recognition in Video

Audio Visual Emotion Recognition with Temporal Alignment and Perception Attention

Multi-resolution modulation-filtered cochleagram feature for LSTM-based dimensional emotion recognition from speech

Multi-modal Continuous Dimensional Emotion Recognition Using Recurrent Neural Network and Self-Attention Mechanism

A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wild

A Deep Bidirectional Long Short-Term Memory Based Multi-Scale Approach for Music Dynamic Emotion Prediction

Visual-Audio Emotion Recognition Based on Multi-Task and Ensemble Learning with Multiple Features

An Efficient LSTM Network for Emotion Recognition from Multichannel EEG Signals

Spatial-Temporal Recurrent Neural Network for Emotion Recognition

Multimodal Physiological Signal Emotion Recognition Based on Convolutional Recurrent Neural Network

Multimodal Utterance-level Affect Analysis using Visual, Audio and Text Features

Time-Delay Neural Network for Continuous Emotional Dimension Prediction from Facial Expression Sequences.

Dimensional emotion recognition using visual and textual cues

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.