Abstract:The importance of automated Facial Emotion Recognition (FER) grows the more common human-machine interactions become, which will only continue to increase dramatically with time. A common method to describe human sentiment or feeling is the categorical model the `7 basic emotions', consisting of `Angry', `Disgust', `Fear', `Happiness', `Sadness', `Surprise' and `Neutral'. The `Emotion Recognition in the Wild' (EmotiW) competition is now in its 7th year and has become the standard benchmark for measuring FER performance. The focus of this paper is the EmotiW sub-challenge of classifying videos in the `Acted Facial Expression in the Wild' (AFEW) dataset, consisting of both visual and audio modalities, into one of the above classes. Machine learning has exploded as a research topic in recent years, with advancements in `Deep Learning' a key part of this. Although Deep Learning techniques have been widely applied to the FER task by entrants in previous years, this paper has two main contributions: (i) to apply the latest `state-of-the-art' visual and temporal networks and (ii) exploring various methods of fusing features extracted from the visual and audio elements to enrich the information available to the final model making the prediction. There are a number of complex issues that arise when trying to classify emotions for `in-the-wild' video sequences, which the above two approaches attempt to directly address. There are some positive findings when comparing the results of this paper to past submissions, indicating that further research into the proposed methods and fine-tuning of the models deployed, could result in another step forwards in the field of automated FER.

Emotion Hunters at EMit: Categorical Emotion Detection combining BERT and ChatGPT models (short paper)

Emotion detection in psychological texts by fine-tuning BERT using emotion–cause pair extraction

EmotionX-HSU: Adopting Pre-trained BERT for Emotion Classification

Evaluating Arabic Emotion Recognition Task Using ChatGPT Models: A Comparative Analysis between Emotional Stimuli Prompt, Fine-Tuning, and In-Context Learning

Emotion Classification In Software Engineering Texts: A Comparative Analysis of Pre-trained Transformers Language Models

Bias in Emotion Recognition with ChatGPT

Tracking Emotional Dynamics in Chat Conversations: A Hybrid Approach using DistilBERT and Emoji Sentiment Analysis

Emotion Recognition under Consideration of the Emotion Component Process Model

Improving the Generalizability of Text-Based Emotion Detection by Leveraging Transformers with Psycholinguistic Features

Emotion Detection from Speech to Enrich Multimedia Content

Emotion Detection and Analysis on Social Media

A Wide Evaluation of ChatGPT on Affective Computing Tasks

Language Models as Emotional Classifiers for Textual Conversation

Multi-Modal Emotion Recognition Based on Wavelet Transform and BERT-RoBERTa: An Innovative Approach Combining Enhanced BiLSTM and Focus Loss Function

Fine-grained Affective Processing Capabilities Emerging from Large Language Models

Data Augmentation for Emotion Detection in Small Imbalanced Text Data

Design of Hybrid Deep Learning Model for Text-based Emotion Recognition

Automatic Emotion Experiencer Recognition

AI in Pursuit of Happiness, Finding Only Sadness: Multi-Modal Facial Emotion Recognition Challenge

A Unified Approach to Emotion Detection and Task-Oriented Dialogue Modeling

Multi-Modal Emotion Detection with Transfer Learning