Abstract:Learning discriminative and robust representations is important for facial expression recognition (FER) due to subtly different emotional faces and their subjective annotations. Previous works usually address one representation solely because these two goals seem to be contradictory for optimization. Their performances inevitably suffer from challenges from the other representation. In this article, by considering this problem from two novel perspectives, we demonstrate that discriminative and robust representations can be learned in a unified approach, i.e., DR-FER, and mutually benefit each other. Moreover, we make it with the supervision from only original annotations. Specifically, to learn discriminative representations, we propose performing masked image modeling (MIM) as an auxiliary task to force our network to discover expression-related facial areas. This is the first attempt to employ MIM to explore discriminative patterns in a self-supervised manner. To extract robust representations, we present a category-aware self-paced learning schedule to mine high-quality annotated (easy) expressions and incorrectly annotated (hard) counterparts. We further introduce a retrieval similarity-based relabeling strategy to correct hard expression annotations, exploiting them more effectively. By enhancing the discrimination ability of the FER classifier as a bridge, these two learning goals significantly strengthen each other. Extensive experiments on several popular benchmarks demonstrate the superior performance of our DR-FER. Moreover, thorough visualizations and extra experiments on manually annotation-corrupted datasets show that our approach successfully accomplishes learning both discriminative and robust representations simultaneously.

Fer-MLP: Fast Expression Recognition Network Based on MLP

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

Facial expression recognition through multi-level features extraction and fusion

The Facial Expression Recognition Method Based on Image Fusion and CNN

An Improved SimAM Based CNN for Facial Expression Recognition

FERNet: A Deep CNN Architecture for Facial Expression Recognition in the Wild

Facial Expression Recognition Based on Multi-Scale Convolutional Vision Transformer

Video-based Facial Expression Recognition Using Graph Convolutional Networks.

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

3D-FERNet: A Facial Expression Recognition Network utilizing 3D information

A multi-scale multi-attention network for dynamic facial expression recognition

FER-Net: Facial Expression Recognition Using Densely Connected Convolutional Network

Adaptive multilayer perceptual attention network for facial expression recognition

xLSTM-FER: Enhancing Student Expression Recognition with Extended Vision Long Short-Term Memory Network

Multi-Attention Module for Dynamic Facial Emotion Recognition

FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space

Two-pathway attention network for real-time facial expression recognition

Robust Lightweight Facial Expression Recognition Network with Label Distribution Training

Fast and Efficient Facial Expression Recognition Using a Gabor Convolutional Network

FER-former: Multi-modal Transformer for Facial Expression Recognition