Abstract:As one representative framework of self-supervised learning (SSL), contrastive learning (CL) has drawn enormous attention in the representation learning area. By pulling together a “positive” example and an anchor, as well as pushing away many “negative” examples from the anchor, CL is able to generate high-quality representations for the data of different modalities. Therefore, the qualities of selected positive and negative examples are critical for the performance of CL-based models. However, due to the assumption of label unavailability, most existing work follows the paradigm of contrastive instance discrimination, which treats each input instance as an individual category. Therefore, they focused more on positive example generation and designed plenty of data augmentation strategies. For negative examples, they just leverage the in-batch negative sampling strategy. We argue that this negative sampling strategy will easily select false negatives and inhibit the capability of CL, which we also believe is one of the reasons why a large size of negatives is needed in CL. Apart from using annotated labels, we try to tackle this problem in an unsupervised manner. We propose to integrate expectation maximization (EM) into the selection of negative examples and develop a novel EM-enhanced negative sampling strategy (EMCRL) to distinguish false negatives from true ones for CL performance improvement. Specifically, EMCRL employs EM to estimate the distribution of ground-truth relations between each sample and corresponding in-batch negatives and then optimizes model parameters with the estimations. Considering the sensitivity of EM algorithm to the parameter initialization, we propose to add a random flip into the distribution estimation to enhance the robustness of the learning process. Extensive experiments over several advanced models on sentence representation and image representation tasks demonstrate the effectiveness of EMCRL . Our method is easy to implement, and the code is publicly available at https://github.com/zhangkunzk/EMCRL_pytorch .

Structural self-contrast learning based on adaptive weighted negative samples for facial expression recognition

Synthetic Hard Negative Samples for Contrastive Learning

Pose-disentangled Contrastive Learning for Self-supervised Facial Representation

Contrastive Learning with Hallucinating Data for Long-Tailed Face Recognition.

A Symmetrical Siamese Network Framework with Contrastive Learning for Pose-Robust Face Recognition.

SCL-FExR: supervised contrastive learning approach for facial expression Recognition

Weight-Adapted Convolution Neural Network for Facial Expression Recognition

Cross-Layer Contrastive Learning of Latent Semantics for Facial Expression Recognition

Revisiting Self-Supervised Contrastive Learning for Facial Expression Recognition

Contrastive Attraction and Contrastive Repulsion for Representation Learning

Weakly-Supervised Text-driven Contrastive Learning for Facial Behavior Understanding

Self-Paced Neutral Expression-Disentangled Learning for Facial Expression Recognition

Rethinking Pseudo-Labeling for Semi-Supervised Facial Expression Recognition with Contrastive Self-Supervised Learning.

Occluded Facial Expression Recognition Using Self-supervised Learning

Supervised Contrastive Attentive Learning for Facial Expression Recognition in the Wild

SSA-ICL: Multi-domain adaptive attention with intra-dataset continual learning for Facial expression recognition

Tion for negative-free symmetric contrastive learning

SSLCL: an Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations

EMCRL: EM-Enhanced Negative Sampling Strategy for Contrastive Representation Learning

Empower Smart Cities with Sampling-Wise Dynamic Facial Expression Recognition Via Frame-Sequence Contrastive Learning

Facial Expression Recognition with Contrastive Learning and Uncertainty-Guided Relabeling