Abstract:Nowadays, a huge number of images are available. However, retrieving a required image for an ordinary user is a challenging task in computer vision systems. During the past two decades, many types of research have been introduced to improve the performance of the automatic annotation of images, which are traditionally focused on content-based image retrieval. Although, recent research demonstrates that there is a semantic gap between content-based image retrieval and image semantics understandable by humans. As a result, existing research in this area has caused to bridge the semantic gap between low-level image features and high-level semantics. The conventional method of bridging the semantic gap is through the automatic image annotation (AIA) that extracts semantic features using machine learning techniques. In this paper, we propose a novel AIA model based on the deep learning feature extraction method. The proposed model has three phases, including a feature extractor, a tag generator, and an image annotator. First, the proposed model extracts automatically the high and low-level features based on dual-tree continues wavelet transform (DT-CWT), singular value decomposition, distribution of color ton, and the deep neural network. Moreover, the tag generator balances the dictionary of the annotated keywords by a new log-entropy auto-encoder (LEAE) and then describes these keywords by word embedding. Finally, the annotator works based on the long-short-term memory (LSTM) network in order to obtain the importance degree of specific features of the image. The experiments conducted on two benchmark datasets confirm that the superiority of the proposed model compared to the previous models in terms of performance criteria.

Integrating visual classifier ensemble with term extraction for Automatic Image Annotation

Automatic Image Annotation Based on Wordnet and Hierarchical Ensembles

Hybrid Generative/Discriminative Learning for Automatic Image Annotation

Multi-Modal Multi-Label Semantic Indexing Of Images Based On Hybrid Ensemble Learning

The image annotation algorithm using convolutional features from intermediate layer of deep learning

Multi-Modal Multi-Label Semantic Indexing of Images Using Unlabeled Data

Automatic image annotation via local multi-label classification

Automatic Image Annotations by Mining Web Image Data

Automatic image annotation by incorporating feature hierarchy and boosting to scale up SVM classifiers.

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Context Modeling Based Automatic Image Annotation System

Automatic web image annotation via web-scale image semantic space learning

An Effective Automatic Image Annotation Model Via Attention Model and Data Equilibrium

CNN-feature based automatic image annotation method

Effective Automatic Image Annotation Via Integrated Discriminative and Generative Models

Web Image Annotation Based On Automatically Obtained Noisy Training Set

The Image Annotation Method by Convolutional Features from Intermediate Layer of Deep Learning Based on Internet of Things

Automatic Image Annotation Based-On Model Space

Web and personal image annotation by mining label correlation with relaxed visual graph embedding.

An Automatic Video Annotation Method Based on Multiple Complementary Classifiers

Semi-automatic Dynamic Auxiliary-Tag-aided Image Annotation