Abstract:Convolutional neural networks (CNNs) have made remarkable progress on scene recognition, partially due to these recent large-scale scene datasets, such as the Places and Places2. Scene categories are often defined by multi-level information, including local objects, global layout, and background environment, thus leading to large intra-class variations. In addition, with the increasing number of scene categories, label ambiguity has become another crucial issue in large-scale classification. This paper focuses on large-scale scene recognition and makes two major contributions to tackle these issues. First, we propose a multi-resolution CNN architecture that captures visual content and structure at multiple levels. The multi-resolution CNNs are composed of coarse resolution CNNs and fine resolution CNNs, which are complementary to each other. Second, we design two knowledge guided disambiguation techniques to deal with the problem of label ambiguity: 1) we exploit the knowledge from the confusion matrix computed on validation data to merge ambiguous classes into a super category and 2) we utilize the knowledge of extra networks to produce a soft label for each image. Then, the super categories or soft labels are employed to guide CNN training on the Places2. We conduct extensive experiments on three large-scale image datasets (ImageNet, Places, and Places2), demonstrating the effectiveness of our approach. Furthermore, our method takes part in two major scene recognition challenges, and achieves the second place at the Places2 challenge in ILSVRC 2015, and the first place at the LSUN challenge in CVPR 2016. Finally, we directly test the learned representations on other scene benchmarks, and obtain the new state-of-the-art results on the MIT Indoor67 (86.7%) and SUN397 (72.0%). We release the code and models at https://github.com/wanglimin/MRCNN-Scene-Recognition.

Multi-class Indoor Semantic Segmentation with Deep Structured Model

In Defense Of Multi-Source Omni-Supervised Efficient Convnet For Robust Semantic Segmentation In Heterogeneous Unseen Domains

Learning Contextual Information For Indoor Semantic Segmentation

Learning Deep Cross-Scale Feature Propagation for Indoor Semantic Segmentation

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Semantic Segmentation of Very-High-Resolution Remote Sensing Images via Deep Multi-Feature Learning

Multimodal Recurrent Neural Networks with Information Transfer Layers for Indoor Scene Labeling

3D Semantic Segmentation Algorithm for Indoor Scenes based on Long-term Memory

Indoor Instance-Aware Semantic Mapping Using Instance Segmentation

Multi-resolution Cascaded Network with Depth-similar Residual Module for Real-time Semantic Segmentation on RGB-D Images.

Learning aggregated features and optimizing model for semantic labeling

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

A deep learning-based global and segmentation-based semantic feature fusion approach for indoor scene classification

Multi-type and Multi-level Feature Fusion Network for RGBD Indoor Semantic Segmentation

The Network of Attention-Aware Multimodal Fusion for RGB-D Indoor Semantic Segmentation Method

Exploiting Object-based and Segmentation-based Semantic Features for Deep Learning-based Indoor Scene Classification

Indoor Scene Segmentation with Semantic Cuboids

Indoor Scene Recognition by Fusing Map-Level and Frame-Level Decisions with CRF

Exploring Context with Deep Structured models for Semantic Segmentation

Knowledge Guided Disambiguation for Large-Scale Scene Classification with Multi-Resolution Cnns

Dual Attention Based Multi-scale Feature Fusion Network for Indoor RGBD Semantic Segmentation.