Abstract:Auto face annotation, which aims to detect human faces from a facial image and assign them proper human names, is a fundamental research problem and beneficial to many real-world applications. In this work, we address this problem by investigating a retrieval-based annotation scheme of mining massive web facial images that are freely available over the Internet. In particular, given a facial image, we first retrieve the top n similar instances from a large-scale web facial image database using content-based image retrieval techniques, and then use their labels for auto annotation. Such a scheme has two major challenges: 1) how to retrieve the similar facial images that truly match the query, and 2) how to exploit the noisy labels of the top similar facial images, which may be incorrect or incomplete due to the nature of web images. In this paper, we propose an effective Weak Label Regularized Local Coordinate Coding (WLRLCC) technique, which exploits the principle of local coordinate coding by learning sparse features, and employs the idea of graph-based weak label regularization to enhance the weak labels of the similar facial images. An efficient optimization algorithm is proposed to solve the WLRLCC problem. Moreover, an effective sparse reconstruction scheme is developed to perform the face annotation task. We conduct extensive empirical studies on several web facial image databases to evaluate the proposed WLRLCC algorithm from different aspects. The experimental results validate its efficacy. We share the two constructed databases "WDB" (714,454 images of 6,025 people) and "ADB" (126,070 images of 1,200 people) with the public. To further improve the efficiency and scalability, we also propose an offline approximation scheme (AWLRLCC) which generally maintains comparable results but significantly reduces the annotation time.

A New Image Labeling Method Based on Content-Based Image Retrieval and Conditional Random Field

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Image labeling based on fully-connected conditional random field

Conditional Random Fields for Image Labeling

A new Laplacian mixture conditional random field model for image labeling

Conditional Random Fields for Image Region Labeling with Global Observation.

A Retrieval System For 3d Multi-Phase Contrast-Enhanced Ct Images Of Focal Liver Lesions Based On Combined Bags Of Visual Words And Texture Words

Semi-supervised learning for image annotation based on conditional random fields

Context-based conditional random fields as recurrent neural networks for image labeling

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Deep Neural Networks In Fully Connected CRF For Image Labeling With Social Network Metadata

Ensemble Approach Based on Conditional Random Field for Multi-Label Image and Video Annotation

Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding

Automatic Indexing Model Based on Conditional Random Fields

Image Annotation by Large-Scale Content-Based Image Retrieval

Exploiting Unlabeled Data In Content-Based Image Retrieval

Image Region Labeling by Exploring Contextual Information of Visual Spatial and Semantic Concepts

Multilabel Neighborhood Propagation for Region-Based Image Retrieval

Label Transfer Between Images And 3d Shapes Via Local Correspondence Encoding

A comprehensive study on learning to rank for content-based image retrieval