Abstract:Deep learning-based methods have been the key driving force behind much of the recent success of facial expression recognition (FER) systems. However, the need for large amounts of labelled data remains a challenge. Semi-supervised learning offers a way to overcome this limitation, allowing models to learn from a small amount of labelled data along with a large unlabelled dataset. While semi-supervised learning has shown promise in FER, most current methods from general computer vision literature have not been explored in the context of FER. In this work, we present a comprehensive study on 11 of the most recent semi-supervised methods, in the context of FER, namely Pi-model, Pseudo-label, Mean Teacher, VAT, UDA, MixMatch, ReMixMatch, FlexMatch, CoMatch, and CCSSL. Our investigation covers semi-supervised learning from in-distribution, out-of-distribution, unconstrained, and very small unlabelled data. Our evaluation includes five FER datasets plus one large face dataset for unconstrained learning. Our results demonstrate that FixMatch consistently achieves better performance on in-distribution unlabelled data, while ReMixMatch stands out among all methods for out-of-distribution, unconstrained, and scarce unlabelled data scenarios. Another significant observation is that with an equal number of labelled samples, semi-supervised learning delivers a considerable improvement over supervised learning, regardless of whether the unlabelled data is in-distribution, out-of-distribution, or unconstrained. We also conduct sensitivity analyses on critical hyper-parameters for the two best methods of each setting. To facilitate reproducibility and further development, we make our code publicly available at: <a class="link-external link-http" href="http://github.com/ShuvenduRoy/SSL_FER_OOD" rel="external noopener nofollow">this http URL</a>.

Scalable Semi-Supervised Clustering for Face Recognition with Insufficient Labelled Samples

Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples

Boosting Semi-Supervised Face Recognition with Raw Faces

Video-based Semi-supervised Face Recognition Using Clustering

Self-Training-Based Face Recognition Using Semi-Supervised Linear Discriminant Analysis and Affinity Propagation

ClusterFace: Clustering-Driven Deep Face Recognition.

Exploring the Boundaries of Semi-Supervised Facial Expression Recognition using In-Distribution, Out-of-Distribution, and Unconstrained Data

ClusterFace: Joint Clustering and Classification for Set-Based Face Recognition

Semi-supervised support vector learning for face recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

Cost-Sensitive Semi-Supervised Discriminant Analysis for Face Recognition.

Boosting Semi-Supervised Face Recognition With Noise Robustness

Confidence-Based Simple Graph Convolutional Networks for Face Clustering

Face Clustering via Early Stopping and Edge Recall

Efficient Large-Scale Face Clustering Using an Online Mixture of Gaussians

A novel semi-supervised face recognition for video

Recognition and Retrieval of Face Images by Semi-supervised Learning

A face recognition system using convolutional feature extraction with linear collaborative discriminant regression classification

VirFace<sup>∞:</sup> A Semi-Supervised Method for Enhancing Face Recognition via Unlabeled Shallow Data

A Novel Semi-Supervised Learning for Face Recognition

Boosting Unconstrained Face Recognition with Auxiliary Unlabeled Data