Abstract:The automatic image annotation is an effective computer operation that predicts the annotation of an unknown image by automatically learning potential relationships between the semantic concept space and the visual feature space in the annotation image dataset. Usually, the auto-labeling image includes the processing: learning processing and labeling processing. Existing image annotation methods that employ convolutional features of deep learning methods have a number of limitations, including complex training and high space/time expenses associated with the image annotation procedure. Accordingly, this paper proposes an innovative method in which the visual features of the image are presented by the intermediate layer features of deep learning, while semantic concepts are represented by mean vectors of positive samples. Firstly, the convolutional result is directly output in the form of low-level visual features through the mid-level of the pre-trained deep learning model, with the image being represented by sparse coding. Secondly, the positive mean vector method is used to construct visual feature vectors for each text vocabulary item, so that a visual feature vector database is created. Finally, the visual feature vector similarity between the testing image and all text vocabulary is calculated, and the vocabulary with the largest similarity used for annotation. Experiments on the datasets demonstrate the effectiveness of the proposed method; in terms of F1 score, the proposed method’s performance on the Corel5k dataset and IAPR TC-12 dataset is superior to that of MBRM, JEC-AF, JEC-DF, and 2PKNN with end-to-end deep features.

Multi-label Image Ranking Based on Deep Convolutional Features

Research on Image Classification Method of Features of Combinatorial Convolution

The image annotation algorithm using convolutional features from intermediate layer of deep learning

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

Semantic Embedded Deep Neural Network: A Generic Approach to Boost Multi-Label Image Classification Performance

A Baseline for Multi-Label Image Classification Using An Ensemble of Deep Convolutional Neural Networks

Rank-Consistency Multi-Label Deep Hashing.

Disentangling, Embedding and Ranking Label Cues for Multi-Label Image Recognition

Deep Ranking for Image Zero-Shot Multi-Label Classification.

GA-Based Weighted Ensemble Learning for Multi-Label Aerial Image Classification Using Convolutional Neural Networks and Vision Transformers

Multi-label Image Annotation Based on Convolutional Neural Network

Multilabel Recognition Algorithm With Multigraph Structure

A multi-label image classification method combining multi-stage image semantic information and label relevance

CNN: Single-label to Multi-label

Multilabel Convolutional Network With Feature Denoising and Details Supplement

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Embedding Label Structures for Fine-Grained Feature Representation

A Survey on Fine-grained Image Categorization Using Deep Convolutional Features

Deep Co-Image-Label Hashing for Multi-Label Image Retrieval

Multi-label Ranking: Mining Multi-label and Label Ranking Data

Rank-Consistency Deep Hashing for Scalable Multi-Label Image Search