Abstract:The automatic image annotation is an effective computer operation that predicts the annotation of an unknown image by automatically learning potential relationships between the semantic concept space and the visual feature space in the annotation image dataset. Usually, the auto-labeling image includes the processing: learning processing and labeling processing. Existing image annotation methods that employ convolutional features of deep learning methods have a number of limitations, including complex training and high space/time expenses associated with the image annotation procedure. Accordingly, this paper proposes an innovative method in which the visual features of the image are presented by the intermediate layer features of deep learning, while semantic concepts are represented by mean vectors of positive samples. Firstly, the convolutional result is directly output in the form of low-level visual features through the mid-level of the pre-trained deep learning model, with the image being represented by sparse coding. Secondly, the positive mean vector method is used to construct visual feature vectors for each text vocabulary item, so that a visual feature vector database is created. Finally, the visual feature vector similarity between the testing image and all text vocabulary is calculated, and the vocabulary with the largest similarity used for annotation. Experiments on the datasets demonstrate the effectiveness of the proposed method; in terms of F1 score, the proposed method’s performance on the Corel5k dataset and IAPR TC-12 dataset is superior to that of MBRM, JEC-AF, JEC-DF, and 2PKNN with end-to-end deep features.

Content and Context-Based Multi-Label Image Annotation.

A Semantic Context Model For Automatic Image Annotation

Correlative multi-label multi-instance image annotation

Image Region Labeling by Exploring Contextual Information of Visual Spatial and Semantic Concepts

Multi-modal Feature Fusion for Geographic Image Annotation.

Exploiting Spatial Context Constraints for Automatic Image Region Annotation.

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Multi-Modal Image Annotation with Multi-Instance Multi-Label LDA.

Utilization of Rotation-Invariant Uniform LBP Histogram Distribution and Statistics of Connected Regions in Automatic Image Annotation Based on Multi-Label Learning.

Structured Max-Margin Learning for Multi-Label Image Annotation

The image annotation algorithm using convolutional features from intermediate layer of deep learning

Automatic Image Annotation Based-On Model Space

Central Attention with Multi-Graphs for Image Annotation

Spatial-Context-Aware Deep Neural Network for Multi-Class Image Classification

Context Modeling Based Automatic Image Annotation System

Image Annotation by Large-Scale Content-Based Image Retrieval

AN EM-BASED UNSUPERVISED REGIONS ANNOTATION ALGORITHM FOR MULTI-LABELS OF IMAGE

Spatially-Aware Context Neural Networks.

Multi-label learning by Image-to-Class distance for scene classification and image annotation

Correlative Multi-Label Video Annotation.