Abstract:Studies in the area of neuroscience have revealed the relationship between emotional patterns and brain functional regions, demonstrating that the dynamic relationship between different brain regions is an essential factor affecting emotion recognition determined through electroencephalography (EEG). Moreover, in EEG emotion recognition, we can observe that clearer boundaries exist between coarse-grained emotions than those between fine-grained emotions, based on the same EEG data; this indicates the concurrence of large coarse- and small fine-grained emotion variations. The progressive classification process from coarse- to fine-grained categories may be helpful for EEG emotion recognition. Consequently, in this study, we proposed a progressive graph convolution network (PGCN) for capturing this inherent characteristic in EEG emotional signals and progressively learning the discriminative EEG features. To fit different EEG patterns, we constructed a dual-graph module to characterize the intrinsic relationship between different EEG channels, containing the dynamic functional connections and static spatial proximity information of brain regions from neuroscience research. Moreover, motivated by the observation of the relationship between coarse- and fine-grained emotions, we adopted a dual-head module that enabled the PGCN to progressively learn more discriminative EEG features, from coarse-grained (easy) to fine-grained categories (difficult), referring to the hierarchical characteristics of emotion. To verify the performance of our model, extensive experiments were conducted on three public datasets: SEED-IV, SEED-V, and MPED. The experiment results showed that the PGCN achieved a state-of-the-art performance. Furthermore, we explored the effect of different frequency bands based on our model, and visualized the activated brain regions. The experiment results revealed the relationship between human emotion and high-frequency EEG signals, as well as the importance of the frontal and temporal lobes for emotion expression.

Progressive Visual Content Understanding Network for Image Emotion Classification

A Multi-Stage Visual Perception Approach for Image Emotion Analysis

ARMNet: A Network for Image Dimensional Emotion Prediction Based on Affective Region Extraction and Multi-Channel Fusion

A supervised contrastive learning-based model for image emotion classification

Learning Multi-level Representations for Image Emotion Recognition in the Deep Convolutional Network

Concept-guided multi-level attention network for image emotion recognition

Image Emotion Analysis Based on Semantic Concepts

Stimuli-Aware Visual Emotion Analysis

Emotional Video Captioning With Vision-Based Emotion Interpretation Network

Progressive Graph Convolution Network for EEG Emotion Recognition

Learning multi-level representations for affective image recognition

Object aroused emotion analysis network for image sentiment analysis

Dependency Exploitation: A Unified CNN-RNN Approach for Visual Emotion Recognition

MDAN: Multi-level Dependent Attention Network for Visual Emotion Analysis

Multi-Level Context Pyramid Network for Visual Sentiment Analysis

Discovering Affective Regions in Deep Convolutional Neural Networks for Visual Sentiment Prediction.

Image Aesthetics Assessment With Emotion-Aware Multibranch Network

Fine-grained image emotion captioning based on Generative Adversarial Networks

Image Aesthetics Assessment Based on Hypernetwork of Emotion Fusion

EMONET: A Cross Database Progressive Deep Network for Facial Expression Recognition

Exploiting Emotional Concepts for Image Emotion Recognition