Abstract:Learning efficient image representations is at the core of the scene classification task of remote sensing imagery. The existing methods for solving the scene classification task, based on either feature coding approaches with low-level hand-engineered features or unsupervised feature learning, can only generate mid-level image features with limited representative ability, which essentially prevents them from achieving better performance. Recently, the deep convolutional neural networks (CNNs), which are hierarchical architectures trained on large-scale datasets, have shown astounding performance in object recognition and detection. However, it is still not clear how to use these deep convolutional neural networks for high-resolution remote sensing (HRRS) scene classification. In this paper, we investigate how to transfer features from these successfully pre-trained CNNs for HRRS scene classification. We propose two scenarios for generating image features via extracting CNN features from different layers. In the first scenario, the activation vectors extracted from fully-connected layers are regarded as the final image features; in the second scenario, we extract dense features from the last convolutional layer at multiple scales and then encode the dense features into global image features through commonly used feature coding approaches. Extensive experiments on two public scene classification datasets demonstrate that the image features obtained by the two proposed scenarios, even with a simple linear classifier, can result in remarkable performance and improve the state-of-the-art by a significant margin. The results reveal that the features from pre-trained CNNs generalize well to HRRS datasets and are more expressive than the low- and mid-level features. Moreover, we tentatively combine features extracted from different CNN models for better performance.

In Defense of Fully Connected Layers in Visual Representation Transfer.

Visualizing and Comparing Convolutional Neural Networks

Towards Better Analysis of Deep Convolutional Neural Networks

Human-centric Transfer Learning Explanation Via Knowledge Graph [extended Abstract]

How convolutional neural network see the world - A survey of convolutional neural network visualization methods

On the Large-Scale Transferability of Convolutional Neural Networks.

Visualizing and Understanding Convolutional Networks

Understanding Neural Networks Through Deep Visualization

Graph Representation Learning for Infrared and Visible Image Fusion

Sparse Deep Transfer Learning for Convolutional Neural Network

Human Visual Pathways for Action Recognition versus Deep Convolutional Neural Networks: Representation Correspondence in Late but Not Early Layers

Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective

Good Practice in CNN Feature Transfer

Deeper Interpretability of Deep Networks

Adversarially-Trained Deep Nets Transfer Better: Illustration on Image Classification

Visualizing and comparing AlexNet and VGG using deconvolutional layers

Understanding Neural Network Through Neuron Level Visualization.

How Far Can We Go Without Convolution: Improving Fully-Connected Networks.

Visualizing Transform Relations of Multilayers in Deep Neural Networks for ISAR Target Recognition

Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery

Delving into Fully Convolutional Networks Activations for Visual Recognition.