Abstract:Recent analysis on speech emotion recognition has made considerable advances with the use of MFCCs spectrogram features and the implementation of neural network approaches such as convolutional neural networks (CNNs). Capsule networks (CapsNet) have gained gratitude as alternatives to CNNs with their larger capacities for hierarchical representation. To address these issues, this research introduces a text-independent and speaker-independent SER novel architecture, where a dual-channel long short-term memory compressed-CapsNet (DC-LSTM COMP-CapsNet) algorithm is proposed based on the structural features of CapsNet. Our proposed novel classifier can ensure the energy efficiency of the model and adequate compression method in speech emotion recognition, which is not delivered through the original structure of a CapsNet. Moreover, the grid search approach is used to attain optimal solutions. Results witnessed an improved performance and reduction in the training and testing running time. The speech datasets used to evaluate our algorithm are: Arabic Emirati-accented corpus, English speech under simulated and actual stress corpus, English Ryerson audio-visual database of emotional speech and song corpus, and crowd-sourced emotional multimodal actors dataset. This work reveals that the optimum feature extraction method compared to other known methods is MFCCs delta-delta. Using the four datasets and the MFCCs delta-delta, DC-LSTM COMP-CapsNet surpasses all the state-of-the-art systems, classical classifiers, CNN, and the original CapsNet. Using the Arabic Emirati-accented corpus, our results demonstrate that the proposed work yields average emotion recognition accuracy of 89.3% compared to 84.7%, 82.2%, 69.8%, 69.2%, 53.8%, 42.6%, and 31.9% based on CapsNet, CNN, support vector machine, multi-layer perceptron, k-nearest neighbor, radial basis function, and naive Bayes, respectively.

Topic-Enhanced Capsule Network for Multi-Label Emotion Classification.

A Hybrid Semantic-Topic Co-encoding Network for Social Emotion Classification

Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network

A Fusion Model for Multi-Label Emotion Classification Based on BERT and Topic Clustering

TC-Net: A Transformer Capsule Network for EEG-based emotion recognition

Novel Dual-Channel Long Short-Term Memory Compressed Capsule Networks for Emotion Recognition

A multi-modal and multi-scale emotion-enhanced inference model based on fuzzy recognition

Tree-Structured Neural Networks with Topic Attention for Social Emotion Classification

Sentiment Analysis Using Multi-Head Attention Capsules With Multi-Channel CNN and Bidirectional GRU

Capsule Network with Interactive Attention for Aspect-Level Sentiment Classification.

Multi-Label Emotion Tagging For Online News By Supervised Topic Model

EmoCaps: Emotion Capsule Based Model for Conversational Emotion Recognition

Emotion recognition from EEG based on multi-task learning with capsule network and attention mechanism

Multi-head attention fusion networks for multi-modal speech emotion recognition

Visual Enhancement Capsule Network for Aspect-based Multimodal Sentiment Analysis

An End-to-end Topic-Enhanced Self-Attention Network for Social Emotion Classification.

Semantic Enhancement Network Integrating Label Knowledge for Multi-modal Emotion Recognition

DA-CapsNet: A multi-branch capsule network based on adversarial domain adaption for cross-subject EEG emotion recognition

Attention-Based BiLSTM Network with Lexical Feature for Emotion Classification

MES-CTNet: A Novel Capsule Transformer Network Base on a Multi-Domain Feature Map for Electroencephalogram-Based Emotion Recognition

Latent Emotion Memory for Multi-Label Emotion Classification