Abstract:The automatic image annotation is an effective computer operation that predicts the annotation of an unknown image by automatically learning potential relationships between the semantic concept space and the visual feature space in the annotation image dataset. Usually, the auto-labeling image includes the processing: learning processing and labeling processing. Existing image annotation methods that employ convolutional features of deep learning methods have a number of limitations, including complex training and high space/time expenses associated with the image annotation procedure. Accordingly, this paper proposes an innovative method in which the visual features of the image are presented by the intermediate layer features of deep learning, while semantic concepts are represented by mean vectors of positive samples. Firstly, the convolutional result is directly output in the form of low-level visual features through the mid-level of the pre-trained deep learning model, with the image being represented by sparse coding. Secondly, the positive mean vector method is used to construct visual feature vectors for each text vocabulary item, so that a visual feature vector database is created. Finally, the visual feature vector similarity between the testing image and all text vocabulary is calculated, and the vocabulary with the largest similarity used for annotation. Experiments on the datasets demonstrate the effectiveness of the proposed method; in terms of F1 score, the proposed method’s performance on the Corel5k dataset and IAPR TC-12 dataset is superior to that of MBRM, JEC-AF, JEC-DF, and 2PKNN with end-to-end deep features.

An Image Annotation and Refinement Model Based on Visual Content and Semantic Correlation

Image Annotation Refinement Using Semantic Similarity Correlation

Semi-Supervised Learning Model Based Efficient Image Annotation

Improve Image Annotation by Combining Multiple Models

A Semantic Context Model For Automatic Image Annotation

An Algorithm for the Automatic Annotation Refinement on Large-Scale Web Images

Image Semantic Automatic Annotation by Relevance Feedback

Improve Web Image Retrieval by Refining Image Annotations

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

A web-based approach for image annotation

Image Semantic Description and Automatic Semantic Annotation

Automatic Image Annotation Based-On Model Space

Kill Two Birds with One Stone: Weakly-Supervised Neural Network for Image Annotation and Tag Refinement

The image annotation algorithm using convolutional features from intermediate layer of deep learning

Automatic image annotation by an iterative approach: incorporating keyword correlations and region matching

Image Captioning with Attribute Refinement.

New Query Refinement and Semantics Integrated Image Retrieval System with Semiautomatic Annotation Scheme.

Automatic image semantic annotation based on image-keyword document model

Automatic image annotation based on salient regions

Improving Web Image Retrieval Using Image Annotations and Inference Network

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.