Abstract:Auto face annotation, which aims to detect human faces from a facial image and assign them proper human names, is a fundamental research problem and beneficial to many real-world applications. In this work, we address this problem by investigating a retrieval-based annotation scheme of mining massive web facial images that are freely available over the Internet. In particular, given a facial image, we first retrieve the top n similar instances from a large-scale web facial image database using content-based image retrieval techniques, and then use their labels for auto annotation. Such a scheme has two major challenges: 1) how to retrieve the similar facial images that truly match the query, and 2) how to exploit the noisy labels of the top similar facial images, which may be incorrect or incomplete due to the nature of web images. In this paper, we propose an effective Weak Label Regularized Local Coordinate Coding (WLRLCC) technique, which exploits the principle of local coordinate coding by learning sparse features, and employs the idea of graph-based weak label regularization to enhance the weak labels of the similar facial images. An efficient optimization algorithm is proposed to solve the WLRLCC problem. Moreover, an effective sparse reconstruction scheme is developed to perform the face annotation task. We conduct extensive empirical studies on several web facial image databases to evaluate the proposed WLRLCC algorithm from different aspects. The experimental results validate its efficacy. We share the two constructed databases "WDB" (714,454 images of 6,025 people) and "ADB" (126,070 images of 1,200 people) with the public. To further improve the efficiency and scalability, we also propose an offline approximation scheme (AWLRLCC) which generally maintains comparable results but significantly reduces the annotation time.

Weakly-supervised Deep Self-Learning for Face Recognition

Weakly supervised multiscale-inception learning for web-scale face recognition

Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding

Mining Weakly Labeled Web Facial Images for Search-Based Face Annotation

Leveraging Semi-Supervised Learning to Enhance Data Mining for Image Classification under Limited Labeled Data

Self-Training-Based Face Recognition Using Semi-Supervised Linear Discriminant Analysis and Affinity Propagation

Attend in groups: a weakly-supervised deep learning framework for learning from web data

VirFace ∞ : A Semi-Supervised Method for Enhancing Face Recognition via Unlabeled Shallow Data

Unlabeled Data Assistant: Improving Mask Robustness for Face Recognition

Weakly-Supervised Text-driven Contrastive Learning for Facial Behavior Understanding

Wavelet-enhanced Weakly Supervised Local Feature Learning for Face Forgery Detection

Self-attention learning network for face super-resolution

Improving face recognition with domain adaptation

ClusterFace: Clustering-Driven Deep Face Recognition.

Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation

VirFace<sup>∞:</sup> A Semi-Supervised Method for Enhancing Face Recognition via Unlabeled Shallow Data

Boosting Semi-Supervised Face Recognition with Raw Faces

Weakly Supervised Dual Learning for Facial Action Unit Recognition

Weakly Supervised Fine-grained Recognition Based on Combined Learning for Small Data and Coarse Label

A Novel Semi-Supervised Learning for Face Recognition

Robust Face Recognition via Multimodal Deep Face Representation