Abstract:Scene recognition is challenging due to the complicated spatial arrangement and varied object distribution inside the scene images. Deep learning methods, especially convolutional neural networks (CNNs), have boosted the performance of scene recognition significantly because of the multistage global feature learning ability. However, the CNNs ignore the local semantics and diverse relationships among local regions, which play an important role in scene recognition. In this paper, a region-based adaptive association learning framework is proposed to tackle these challenges. This framework contains two sub-networks to separately extract the features of semantic distribution and contextual arrangement, and deep fusion networks to fuse such features in a joint and boosting fashion. Firstly, we simplify the current CNN structure so that our feature extractor can maintain high-level spatial region representation ability. Then, we propose a novel regional correlation learning architecture to explore the arbitrary direction dependence of the region and the four directions' long-range strip context dependence of the region in different spatial dimensions. Moreover, we design different attention strategies which include context gating, recurrent attention, and gated attention to further refine the extracted regional relationships and highlight local semantic information. Finally, the collaborative relationship features are deeply fused and then fed into a classification layer so that the whole framework is optimized as a whole. Extensive experimental evaluations on both ocean scene and land scene datasets coming from some different fields show that the proposed method achieves better accurate prediction on scene recognition than other state-of-the-art models.

Regional Semantic Learning and Mapping Based on Convolutional Neural Network and Conditional Random Field

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Region-based Adaptive Association Learning for Robust Image Scene Recognition

Object-aware Semantic Mapping of Indoor Scenes Using Octomap

3d Semantic Mapping Based On Convolutional Neural Networks

Semantic Scene Mapping with Spatio-temporal Deep Neural Network for Robotic Applications

An Approach for Construct Semantic Map with Scene Classification and Object Semantic Segmentation

Learning Semantic Feature Map for Visual Content Recognition

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Indoor 3D Semantic Robot VSLAM Based on Mask Regional Convolutional Neural Network

Learning Contextual Information For Indoor Semantic Segmentation

Image Region Labeling by Exploring Contextual Information of Visual Spatial and Semantic Concepts

A Self-Learning-Update CNN Model for Semantic Segmentation of Remote Sensing Images

Image semantic segmentation based on FCN-CRF model

Indoor Scene Recognition by Fusing Map-Level and Frame-Level Decisions with CRF

MS-RRFSegNet: Multiscale Regional Relation Feature Segmentation Network for Semantic Segmentation of Urban Scene Point Clouds.

Indoor Environment Semantic Topological Mapping Based on Deep Learning.

Object-Oriented 3D Semantic Mapping Based on Instance Segmentation

RGB-D Based Semantic SLAM Framework for Rescue Robot

Real-time scene category of indoor robot based on semantic mapping