Abstract:Learning efficient image representations is at the core of the scene classification task of remote sensing imagery. The existing methods for solving the scene classification task, based on either feature coding approaches with low-level hand-engineered features or unsupervised feature learning, can only generate mid-level image features with limited representative ability, which essentially prevents them from achieving better performance. Recently, the deep convolutional neural networks (CNNs), which are hierarchical architectures trained on large-scale datasets, have shown astounding performance in object recognition and detection. However, it is still not clear how to use these deep convolutional neural networks for high-resolution remote sensing (HRRS) scene classification. In this paper, we investigate how to transfer features from these successfully pre-trained CNNs for HRRS scene classification. We propose two scenarios for generating image features via extracting CNN features from different layers. In the first scenario, the activation vectors extracted from fully-connected layers are regarded as the final image features; in the second scenario, we extract dense features from the last convolutional layer at multiple scales and then encode the dense features into global image features through commonly used feature coding approaches. Extensive experiments on two public scene classification datasets demonstrate that the image features obtained by the two proposed scenarios, even with a simple linear classifier, can result in remarkable performance and improve the state-of-the-art by a significant margin. The results reveal that the features from pre-trained CNNs generalize well to HRRS datasets and are more expressive than the low- and mid-level features. Moreover, we tentatively combine features extracted from different CNN models for better performance.

On the Large-Scale Transferability of Convolutional Neural Networks.

Good Practice in CNN Feature Transfer

Sparse Deep Transfer Learning for Convolutional Neural Network

Transferability of Convolutional Neural Networks in Stationary Learning Tasks

Pay Attention to Convolution Filters: Towards Fast and Accurate Fine-Grained Transfer Learning

Cross-convolutional-layer Pooling for Generic Visual Recognition.

Compact Convolutional Neural Network Transfer Learning for Small-Scale Image Classification

A Study on CNN Transfer Learning for Image Classification

CNN Features Off-the-Shelf: An Astounding Baseline for Recognition

Towards Optimal CNN Descriptors for Large-Scale Image Retrieval

The Treasure Beneath Convolutional Layers: Cross-Convolutional-Iayer Pooling For Image Classification

Deep Convolutional Neural Network (CNN) for Large-Scale Images Classification

Solving Large-scale Spatial Problems with Convolutional Neural Networks

The Treasure beneath Convolutional Layers: Cross-convolutional-layer Pooling for Image Classification

Fusing Deep Convolutional Networks for Large Scale Visual Concept Classification

Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery

Scene Understanding Based on Multi-Scale Pooling of Deep Learning Features

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

Delving into Fully Convolutional Networks Activations for Visual Recognition.

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Towards Understanding the Transferability of Deep Representations