Abstract:Auto face annotation, which aims to detect human faces from a facial image and assign them proper human names, is a fundamental research problem and beneficial to many real-world applications. In this work, we address this problem by investigating a retrieval-based annotation scheme of mining massive web facial images that are freely available over the Internet. In particular, given a facial image, we first retrieve the top n similar instances from a large-scale web facial image database using content-based image retrieval techniques, and then use their labels for auto annotation. Such a scheme has two major challenges: 1) how to retrieve the similar facial images that truly match the query, and 2) how to exploit the noisy labels of the top similar facial images, which may be incorrect or incomplete due to the nature of web images. In this paper, we propose an effective Weak Label Regularized Local Coordinate Coding (WLRLCC) technique, which exploits the principle of local coordinate coding by learning sparse features, and employs the idea of graph-based weak label regularization to enhance the weak labels of the similar facial images. An efficient optimization algorithm is proposed to solve the WLRLCC problem. Moreover, an effective sparse reconstruction scheme is developed to perform the face annotation task. We conduct extensive empirical studies on several web facial image databases to evaluate the proposed WLRLCC algorithm from different aspects. The experimental results validate its efficacy. We share the two constructed databases "WDB" (714,454 images of 6,025 people) and "ADB" (126,070 images of 1,200 people) with the public. To further improve the efficiency and scalability, we also propose an offline approximation scheme (AWLRLCC) which generally maintains comparable results but significantly reduces the annotation time.

Laplacian Eigenmaps Regularized Feature Mapping for Image Annotation

Laplacian Eigenmap for Image Retrieval

Multi-graph Laplacian Feature Mapping Incorporating Tag Information for Image Annotation.

Face recognition using laplacianfaces.

Graph Regularized Low-Rank Feature Mapping for Multi-Label Learning with Application to Image Annotation

Semi-supervised dual low-rank feature mapping for multi-label image annotation

Graph regularized low-rank feature learning for robust multi-label image annotation

A Manifold Laplacian Regularized Semi-Supervised Sparse Image Classification Method with a Variant Trace Lasso Norm

$P$ -Laplacian Regularization for Scene Recognition

The image annotation algorithm using convolutional features from intermediate layer of deep learning

Incremental Laplacian Eigenmaps by Preserving Adjacent Information Between Data Points

Ensemble p-Laplacian Regularization for Remote Sensing Image Recognition

An Improved Laplacian Eigenmaps Algorithm for Nonlinear Dimensionality Reduction

Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding

Manifold learning technique for remote sensing image classification

A survey on Laplacian eigenmaps based manifold learning methods.

Sparse Feature Selection Based on Graph Laplacian for Web Image Annotation

Face Recognition Using Two Dimensional Laplacian EigenMap

Learning Regularized Multi-View Structured Sparse Representation For Image Annotation

Local Image Tagging Via Graph Regularized Joint Group Sparsity

Utilization of Rotation-Invariant Uniform LBP Histogram Distribution and Statistics of Connected Regions in Automatic Image Annotation Based on Multi-Label Learning.