Abstract:Human emotional states encompass both basic and compound facial expressions. However, current works primarily focus on basic expressions, consequently neglecting the broad spectrum of human emotions encountered in practical scenarios. Compound facial expressions involve the simultaneous manifestation of multiple emotions on an individual's face. This phenomenon reflects the complexity and richness of human states, where facial features dynamically convey a combination of feelings. This study embarks on a pioneering exploration of Compound Facial Expression Recognition (CFER), with a distinctive emphasis on leveraging the Label Distribution Learning (LDL) paradigm. This strategic application of LDL aims to address the ambiguity and complexity inherent in compound expressions, marking a significant departure from the dominant Single Label Learning (SLL) and Multi‐Label Learning (MLL) paradigms. Within this framework, we rigorously investigate the potential of LDL for a critical challenge in Facial Expression Recognition (FER): recognizing compound facial expressions in uncontrolled environments. We utilize the recently introduced RAF‐CE dataset, meticulously designed for compound expression assessment. By conducting a comprehensive comparative analysis pitting LDL against conventional SLL and MLL approaches on RAF‐CE, we aim to definitively establish LDL's superiority in handling this complex task. Furthermore, we assess the generalizability of LDL models trained on RAF‐CE by evaluating their performance on the EmotioNet and RAF‐DB Compound datasets. This demonstrates their effectiveness without domain adaptation. To solidify these findings, we conduct a comprehensive comparative analysis of 12 cutting‐edge LDL algorithms on RAF‐CE, S‐BU3DFE, and S‐JAFFE datasets, providing valuable insights into the most effective LDL techniques for FER in‐the‐wild.

Facial expression intensity estimation using label-distribution-learning-enhanced ordinal regression

Facial Expression Intensity Estimation Using Ordinal Information

Label Distribution Learning on Auxiliary Label Space Graphs for Facial Expression Recognition

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Facial Emotion Distribution Learning by Exploiting Low-Rank Label Correlations Locally

Adaptively Learning Facial Expression Representation via C-F Labels and Distillation

Label distribution learning for compound facial expression recognition in‐the‐wild: A comparative study

Facial Pose Estimation by Deep Learning from Label Distributions

Learning Expectation of Label Distribution for Facial Age and Attractiveness Estimation

Noisy label facial expression recognition via face-specific label distribution learning

Label Distribution Amendment with Emotional Semantic Correlations for Facial Expression Recognition

Towards Unbiased Label Distribution Learning for Facial Pose Estimation Using Anisotropic Spherical Gaussian

Unimodal-Concentrated Loss: Fully Adaptive Label Distribution Learning for Ordinal Regression

Robust Lightweight Facial Expression Recognition Network with Label Distribution Training

Deep Domain Adaptation for Ordinal Regression of Pain Intensity Estimation Using Weakly-Labelled Videos

Label Distribution Changing Learning with Sample Space Expanding

Adaptive Weighted Ranking-Oriented Label Distribution Learning

Enhanced Dual-Level Representations for Facial Expression Recognition

Ada-DF: An Adaptive Label Distribution Fusion Network For Facial Expression Recognition

LEED: Label-Free Expression Editing via Disentanglement

Label Distribution Learning: A Local Collaborative Mechanism