Abstract:Scene understanding of remote sensing images is of great significance in various applications. Its fundamental problem is how to construct representative features. Various convolutional neural network architectures have been proposed for automatically learning features from images. However, is the current way of configuring the same architecture to learn all the data while ignoring the differences between images the right one? It seems to be contrary to our intuition: it is clear that some images are easier to recognize, and some are harder to recognize. This problem is the gap between the characteristics of the images and the learning features corresponding to specific network structures. Unfortunately, the literature so far lacks an analysis of the two. In this paper, we explore this problem from three aspects: we first build a visual-based evaluation pipeline of scene complexity to characterize the intrinsic differences between images; then, we analyze the relationship between semantic concepts and feature representations, i.e., the scalability and hierarchy of features which the essential elements in CNNs of different architectures, for remote sensing scenes of different complexity; thirdly, we introduce CAM, a visualization method that explains feature learning within neural networks, to analyze the relationship between scenes with different complexity and semantic feature representations. The experimental results show that a complex scene would need deeper and multi-scale features, whereas a simpler scene would need lower and single-scale features. Besides, the complex scene concept is more dependent on the joint semantic representation of multiple objects. Furthermore, we propose the framework of scene complexity prediction for an image and utilize it to design a depth and scale-adaptive model. It achieves higher performance but with fewer parameters than the original model, demonstrating the potential significance of scene complexity.

Compressed Holistic Convolutional Neural Network-based Descriptors for Scene Recognition

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Locally Supervised Deep Hybrid Model for Scene Recognition

Self-Selection Salient Region-Based Scene Recognition Using Slight-Weight Convolutional Neural Network

Scene Classification Of High Resolution Remote Sensing Images Using Convolutional Neural Networks

Remote Sensing Scene Classification Using Sparse Representation-Based Framework with Deep Feature Fusion

Fusing Deep Local And Global Features For Remote Sensing Image Scene Classification

Attention-Aware Deep Feature Embedding for Remote Sensing Image Scene Classification

An End-to-End Trainable Multi-Column CNN for Scene Recognition in Extremely Changing Environment

An Improved Convolutional Neural Network-Based Scene Image Recognition Method

Weakly Supervised PatchNets : Learning Aggregated Patch Descriptors for Scene Recognition

Region-based Adaptive Association Learning for Robust Image Scene Recognition

Scene Change Detection VIA Deep Convolution Canonical Correlation Analysis Neural Network

Combing Triple-Part Features of Convolutional Neural Networks for Scene Classification in Remote Sensing

Scene recognition: A comprehensive survey

Global Descriptors of Convolution Neural Networks for Remote Scene Images Classification

What Do We Learn by Semantic Scene Understanding for Remote Sensing Imagery in CNN Framework?

Weakly Supervised PatchNets: Describing and Aggregating Local Patches for Scene Recognition

Scene Complexity: A New Perspective on Understanding the Scene Semantics of Remote Sensing and Designing Image-Adaptive Convolutional Neural Networks

Hybrid CNN and Dictionary-Based Models for Scene Recognition and Domain Adaptation.

An Efficient and Lightweight Convolutional Neural Network for Remote Sensing Image Scene Classification