Abstract:Visually sensitive regions in the scene are thought to be important for scene categorization. In this paper, we propose to utilize the important visually sensitive information represented by deep features for scene categorization. Specifically, the context relationship between the objects and the surroundings is fully utilized as the main basis for judging the content of the scene, and combining with the deep convolution neural networks (CNNs), a scene categorization model based on deep visually sensitive features is constructed. First, the saliency regions of the scene images are marked according to the context-based saliency detection algorithm. Then, the original images and the corresponding visually sensitive region detection images are superimposed to obtain the visually sensitive region enhancement images. Second, the deep convolution features of the original images, the visually sensitive region detection images, and the visually sensitive region enhancement images are extracted through the deep CNNs pre-trained on the large-scale scene dataset Places. Finally, considering that the deep features extracted by different layers of the convolution network have different capabilities of discrimination, the fusion features are generated from multiple convolution layers to construct visually sensitive CNN model (VS-CNN). In order to verify the effectiveness of the proposed model, the experiments are conducted on the five standard scene datasets, i.e., LabelMe, UIUC-Sports, Scene-15, MIT67, and SUN. The experimental results show that the proposed model is effective and has good adaptability. Especially, our categorization performance is superior to many state-of the-art methods for a complex indoor scene.

Discovering Scene Categories by Information Projection and Cluster Sampling

Adaptive Scene Category Discovery With Generative Learning and Compositional Sampling

Categorizing Scenes by Exploring Scene Part Information Without Constructing Explicit Models

Scene categorization via supervised subspace modeling and sparse representation

Scene Categorization Based on Heterogeneous Features.

Learning a Probabilistic Topology Discovering Model for Scene Categorization.

Discovering Video Shot Categories by Unsupervised Stochastic Graph Partition

Boosting Classifiers for Scene Category Recognition.

Image Categorization Based On Spatial Visual Vocabulary Model

Multi-scale sparse representation based scene categorization

Unsupervised Image Categorization by Hypergraph Partition

Scene Classification Based on Category-Specific Representations Created Through Prototype Feature Selection.

Scene Categorization Through Using Objects Represented by Deep Features.

Scene parsing by data-driven cluster sampling

Learning Two-Pathway Convolutional Neural Networks for Categorizing Scene Images

Scene Categorization Through Combining Lbp and Sift Features Effectively

Research on the Robust Image Representation Scheme for Natural Scene Categorization

Coordinate CNNs and LSTMs to Categorize Scene Images with Multi-Views and Multi-Levels of Abstraction.

Feature selection based codebooks construction for scene categorization

Scene Categorization by Deeply Learning Gaze Behavior in a Semisupervised Context

Scene Categorization Model Using Deep Visually Sensitive Features