Abstract:Deep convolution neural networks (CNNs) have demonstrated advanced performance on single-label image classification, and various progress also has been made to apply CNN methods on multilabel image classification, which requires annotating objects, attributes, scene categories, etc., in a single shot. Recent state-of-the-art approaches to the multilabel image classification exploit the label dependencies in an image, at the global level, largely improving the labeling capacity. However, predicting small objects and visual concepts is still challenging due to the limited discrimination of the global visual features. In this paper, we propose a regional latent semantic dependencies model (RLSD) to address this problem. The utilized model includes a fully convolutional localization architecture to localize the regions that may contain multiple highly dependent labels. The localized regions are further sent to the recurrent neural networks to characterize the latent semantic dependencies at the regional level. Experimental results on several benchmark datasets show that our proposed model achieves the best performance compared to the state-of-the-art models, especially for predicting small objects occurring in the images. Also, we set up an upper bound model (RLSD+ft-RPN) using bounding-box coordinates during training, and the experimental results also show that our RLSD can approach the upper bound without using the bounding-box annotations, which is more realistic in the real world.

Supervised LDA for Image Annotation

Integrating Image Segmentation And Annotation Using Supervised Plsa

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Using Local Discriminant Topic To Improve Generative Model Based Image Annotation

Semi-supervised topic modeling for image annotation.

Regularized Semi-Supervised Latent Dirichlet Allocation for Visual Concept Learning

A Hybrid Supervised-unsupervised Method on Image Topic Visualization with Convolutional Neural Network and LDA

A Semantic Context Model For Automatic Image Annotation

Scene Classification Using Class-Supervised Local-Space-constraint Latent Dirichlet Allocation

A Supervised Neural Autoregressive Topic Model for Simultaneous Image Classification and Annotation

Multi-Modal Image Annotation with Multi-Instance Multi-Label LDA.

Image Region Labeling by Exploring Contextual Information of Visual Spatial and Semantic Concepts

Multilabel Image Classification with Regional Latent Semantic Dependencies

Training-Free Semantic Segmentation via LLM-Supervision

Weakly-supervised Region Annotation for Understanding Scene Images

Semi-supervised learning for image annotation based on conditional random fields

Synergy-Guided Regional Supervision of Pseudo Labels for Semi-Supervised Medical Image Segmentation

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Automatic Image Annotation Based on Topic-Based Smoothing

Exploiting Spatial Context Constraints for Automatic Image Region Annotation.

Web-Scale Image Annotation