Abstract:Auto face annotation, which aims to detect human faces from a facial image and assign them proper human names, is a fundamental research problem and beneficial to many real-world applications. In this work, we address this problem by investigating a retrieval-based annotation scheme of mining massive web facial images that are freely available over the Internet. In particular, given a facial image, we first retrieve the top n similar instances from a large-scale web facial image database using content-based image retrieval techniques, and then use their labels for auto annotation. Such a scheme has two major challenges: 1) how to retrieve the similar facial images that truly match the query, and 2) how to exploit the noisy labels of the top similar facial images, which may be incorrect or incomplete due to the nature of web images. In this paper, we propose an effective Weak Label Regularized Local Coordinate Coding (WLRLCC) technique, which exploits the principle of local coordinate coding by learning sparse features, and employs the idea of graph-based weak label regularization to enhance the weak labels of the similar facial images. An efficient optimization algorithm is proposed to solve the WLRLCC problem. Moreover, an effective sparse reconstruction scheme is developed to perform the face annotation task. We conduct extensive empirical studies on several web facial image databases to evaluate the proposed WLRLCC algorithm from different aspects. The experimental results validate its efficacy. We share the two constructed databases "WDB" (714,454 images of 6,025 people) and "ADB" (126,070 images of 1,200 people) with the public. To further improve the efficiency and scalability, we also propose an offline approximation scheme (AWLRLCC) which generally maintains comparable results but significantly reduces the annotation time.

Automatic Localization and Annotation of Facial Features Using Machine Learning Techniques

Bayesian Shape Localization for Face Recognition Using Global and Local Textures.

Machine Learning Approach for Face Image Retrieval

Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding

Multistage and Multi-features Medical Image Retrieval System

Learning to Name Faces

A Pca Based Automatic Image Categorization Approach Using Dominant Color Features

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Fuzzy Approach for Semantic Face Image Retrieval

A New Deep Learning Method for Multi-label Facial Expression Recognition Based on Local Constraint Features

FANS: Face Annotation by Searching Large-scale Web Facial Images.(2013). Research Collection School Of Information Systems

Intelligent Face Image Retrieval Using Eigenpaxels and Learning Similarity Metrics

Face identification using reference-based features with message passing model

A Survey on Facial Features Localization

Study and application on automatic tagging algorithm of image semantic information

Content-based Image Retrieval Via a Hierarchical-Local-feature Extraction Scheme

Content-based suspect identification system

Human Facial Feature Localisation by Gabor Filter and Clustering

Fully Automatic 3D Facial Expression Recognition Using Local Depth Features

Automatic 2.5-D Facial Landmarking and Emotion Annotation for Social Interaction Assistance

Harris Operator and K-means Clustering-based Facial Features Localization on Infrared Images