Abstract:Effective expression feature representations generated by a triplet-based deep metric learning are highly advantageous for facial expression recognition (FER). The performance of triplet-based deep metric learning is contingent upon identifying the best threshold for triplet loss. Threshold validation, however, is tough and challenging, as the ideal threshold changes among datasets and even across classes within the same dataset. In this paper, we present the multi-threshold deep metric learning technique, which not only avoids the difficult threshold validation but also vastly increases the capacity of triplet loss learning to construct expression feature representations. We find that each threshold of the triplet loss intrinsically determines a distinctive distribution of inter-class variations and corresponds, thus, to a unique expression feature representation. Therefore, rather than selecting a single optimal threshold from a valid threshold range, we thoroughly sample thresholds across the range, allowing the representation characteristics manifested by thresholds within the range to be fully extracted and leveraged for FER. To realize this approach, we partition the embedding layer of the deep metric learning network into a collection of slices and model training these embedding slices as an end-to-end multi-threshold deep metric learning problem. Each embedding slice corresponds to a sample threshold and is learned by enforcing the corresponding triplet loss, yielding a set of distinct expression features, one for each embedding slice. It makes the embedding layer, which is composed of a set of slices, a more informative and discriminative feature, hence enhancing the FER accuracy. Extensive evaluations demonstrate the superior performance of the proposed approach on both posed and spontaneous facial expression datasets.

Adaptive discriminative metric learning for facial expression recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Spontaneous facial expression recognition: A robust metric learning approach

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Metric Learning with Adaptive Density Discrimination

A Scalable Metric Learning-Based Voting Method for Expression Recognition

Adaptive Metric Learning For People Re-Identification

Identity-aware Facial Expression Recognition via Deep Metric Learning based on Synthesized Images

Class-specific discriminative metric learning for scene recognition

Scalable Angular Discriminative Deep Metric Learning for Face Recognition

Dynamic Multi-Channel Metric Network for Joint Pose-Aware and Identity-Invariant Facial Expression Recognition

Transfer Model Collaborating Metric Learning and Dictionary Learning for Cross-Domain Facial Expression Recognition.

Discriminant Auto Encoders for Face Recognition with Expression and Pose Variations

Metric learning for facial kinship verification

Self-adaptive feature learning based on a priori knowledge for facial expression recognition

Discriminative Multimetric Learning for Kinship Verification

Sparse Modified Marginal Fisher Analysis for Facial Expression Recognition

Multi-threshold Deep Metric Learning for Facial Expression Recognition

Facial Expression Recognition with Face Mask Using Attention Mechanism and Metric Loss

Discriminative Tracking by Metric Learning