Abstract:Visually sensitive regions in the scene are thought to be important for scene categorization. In this paper, we propose to utilize the important visually sensitive information represented by deep features for scene categorization. Specifically, the context relationship between the objects and the surroundings is fully utilized as the main basis for judging the content of the scene, and combining with the deep convolution neural networks (CNNs), a scene categorization model based on deep visually sensitive features is constructed. First, the saliency regions of the scene images are marked according to the context-based saliency detection algorithm. Then, the original images and the corresponding visually sensitive region detection images are superimposed to obtain the visually sensitive region enhancement images. Second, the deep convolution features of the original images, the visually sensitive region detection images, and the visually sensitive region enhancement images are extracted through the deep CNNs pre-trained on the large-scale scene dataset Places. Finally, considering that the deep features extracted by different layers of the convolution network have different capabilities of discrimination, the fusion features are generated from multiple convolution layers to construct visually sensitive CNN model (VS-CNN). In order to verify the effectiveness of the proposed model, the experiments are conducted on the five standard scene datasets, i.e., LabelMe, UIUC-Sports, Scene-15, MIT67, and SUN. The experimental results show that the proposed model is effective and has good adaptability. Especially, our categorization performance is superior to many state-of the-art methods for a complex indoor scene.

Category Constrained Learning Model for Scene Classification

Scene Classification Using Class-Supervised Local-Space-constraint Latent Dirichlet Allocation

Context Aware Topic Model for Scene Recognition

Natural Scene Classification Based on Integrated Topic Simplex

Supervised labeled latent Dirichlet allocation for document categorization

Coordinate CNNs and LSTMs to Categorize Scene Images with Multi-Views and Multi-Levels of Abstraction.

Learning Two-Pathway Convolutional Neural Networks for Categorizing Scene Images

Scene Categorization with Class Extendibility and Effective Discriminative Ability

Scene and place recognition using a hierarchical latent topic model.

Hybrid Generative/discriminative Scene Classification Strategy Based on Latent Dirichlet Allocation for High Spatial Resolution Remote Sensing Imagery.

Model2Scene: Learning 3D Scene Representation via Contrastive Language-CAD Models Pre-training

Scene Categorization Model Using Deep Visually Sensitive Features

Latent Topic Visual Language Model for Object Categorization.

Scene Recognition by Jointly Modeling Latent Topics.

Learning Discriminative Visual Dictionary for Natural Scene Categorization

Category-Specific Scene Categorization

Scene Categorization by Deeply Learning Gaze Behavior in a Semisupervised Context

Correspondence with category Latent Dirichlet Allocation for image annotation

Text Categorization Based on Topic Model.

Large-Scale Weakly Supervised Object Localization Via Latent Category Learning

Scene Categorization Through Using Objects Represented by Deep Features.