Abstract:Emotion recognition in conversation (ERC) has received increasing attention from researchers due to its wide range of <a class="link-external link-http" href="http://applications.As" rel="external noopener nofollow">this http URL</a> conversation has a natural graph structure,numerous approaches used to model ERC based on graph convolutional networks (GCNs) have yielded significant results.However,the aggregation approach of traditional GCNs suffers from the node information redundancy problem,leading to node discriminant information loss.Additionally,single-layer GCNs lack the capacity to capture long-range contextual information from the graph. Furthermore,the majority of approaches are based on textual modality or stitching together different modalities, resulting in a weak ability to capture interactions between modalities. To address these problems, we present the relational bilevel aggregation graph convolutional network (RBA-GCN), which consists of three modules: the graph generation module (GGM), similarity-based cluster building module (SCBM) and bilevel aggregation module (BiAM). First, GGM constructs a novel graph to reduce the redundancy of target node information.Then,SCBM calculates the node similarity in the target node and its structural neighborhood, where noisy information with low similarity is filtered out to preserve the discriminant information of the node. Meanwhile, BiAM is a novel aggregation method that can preserve the information of nodes during the aggregation process. This module can construct the interaction between different modalities and capture long-range contextual information based on similarity clusters. On both the IEMOCAP and MELD datasets, the weighted average F1 score of RBA-GCN has a 2.17$\sim$5.21\% improvement over that of the most advanced method.Our code is available at <a class="link-external link-https" href="https://github.com/luftmenscher/RBA-GCN" rel="external noopener nofollow">this https URL</a> and our article with the same name has been published in IEEE/ACM Transactions on Audio,Speech,and Language Processing,vol.31,2023

Recognizing Sentence Emotions Based On Polynomial Kernel Method Using Ren-Cecps

Learning Polynomial Function Based Neutral-Emotion Gmm Transformation For Emotional Speaker Recognition

Pitch envelope based frame level score reweighed algorithm for emotion robust speaker recognition.

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Syllable Level Speech Emotion Recognition Based on Formant Attention

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Speaker-Independent Speech Emotion Recognition Based On Cnn-Blstm And Multiple Svms

Cross-Corpus Speech Emotion Recognition Based on Hybrid Neural Networks

An EEG emotion recognition method based on transfer learning and echo state network for HilCPS

Semantic-Rich Facial Emotional Expression Recognition

Fuzzy speech emotion recognition considering semantic awareness

Multimodal Emotion Recognition from Raw Audio with Sinc-convolution

Association Extraction and Recognition of Multiple Emotion Expressed in Social Texts

Emotion Recognition using Machine Learning and ECG signals

RBA-GCN: Relational Bilevel Aggregation Graph Convolutional Network for Emotion Recognition

Speech emotion recognition: Features and classification models

A New Fuzzy Cognitive Map Learning Algorithm for Speech Emotion Recognition

Face Emotion Recognization Using Dataset Augmentation Based on Neural Network

How Speech is Recognized to Be Emotional - A Study Based on Information Decomposition

Conversational emotion recognition studies based on graph convolutional neural networks and a dependent syntactic analysis