Abstract:Effectively recognizing different sceneries with complex backgrounds and varied lighting conditions plays an important role in modern AI systems. Competitive performance has recently been achieved by the deep scene categorization models. However, these models implicitly hypothesize that the image-level labels are 100% correct, which is too restrictive. Practically, the image-level labels for massive-scale scenery sets are usually calculated by external predictors such as ImageNet-CN. These labels can easily become contaminated because no predictors are completely accurate. This article proposes a new deep architecture that calculates scene categories by hierarchically deriving stable templates, which are discovered using a generative model. Specifically, we first construct a semantic space by incorporating image-level labels using subspace embedding. Afterward, it is noticeable that in the semantic space, the superpixel distributions from identically labeled images remain unchanged, regardless of the image-level label noises. On the basis of this observation, a probabilistic generative model learns the stable templates for each scene category. To deeply represent each scenery category, a novel aggregation network is developed to statistically concatenate the CNN features learned from scene annotations predicted by HSA. Finally, the learned deep representations are integrated into an image kernel, which is subsequently incorporated into a multiclass SVM for distinguishing scene categories. Thorough experiments have shown the performance of our method. As a byproduct, an empirical study of 33 SIFT-flow categories shows that the learned stable templates remain almost unchanged under a nearly 36% image label contamination rate.

A Visual Semantic Template of Background for Scene Image

Semantic Image Segmentation Based on Spatial Context Relations

Study on Image Description Methods

Decoding Image Semantics Based On Image Background And Salient Objects

A Method of Main-Region Extraction for Semantic Image Retrieve

Semantic Template: A Robust Approach To Support Content-Based Image Retrieval

Evaluating Bag-of-visual-words Representations in Scene Classification

A Semantic-Based Image Retrieval System: VisEngine

Research On Methodology Of Image Semantic Understanding

Visual Vocabulary Optimization with Spatial Context for Image Annotation and Classification

Apply Semantic Template to Support Content-Based Image Retrieval

Image Retrieval Using Object Template

Learning AND-OR Templates for Professional Photograph Parsing and Guidance

Deeply Encoding Stable Patterns From Contaminated Data for Scenery Image Recognition

A Novel Robust Background Modeling Algorithm for Complex Natural Scenes

Semantic Image Matting

Visual language modeling for image classification.

Research on the Method of Video Semantic Scene Constructing Based on SVM

Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation

Auto‐encoder‐based Shared Mid‐level Visual Dictionary Learning for Scene Classification Using Very High Resolution Remote Sensing Images

Background Building Method of Moving Objects Detection in Complex Scenes