Abstract:Remote sensing image scene classification is one of the most challenging problems in understanding high-resolution remote sensing images. Deep learning techniques, especially the convolutional neural network (CNN), have improved the performance of remote sensing image scene classification due to the powerful perspective of feature learning and reasoning. However, several fully connected layers are always added to the end of CNN models, which is not efficient in capturing the hierarchical structure of the entities in the images and does not fully consider the spatial information that is important to classification. Fortunately, capsule network (CapsNet), which is a novel network architecture that uses a group of neurons as a capsule or vector to replace the neuron in the traditional neural network and can encode the properties and spatial information of features in an image to achieve equivariance, has become an active area in the classification field in the past two years. Motivated by this idea, this paper proposes an effective remote sensing image scene classification architecture named CNN-CapsNet to make full use of the merits of these two models: CNN and CapsNet. First, a CNN without fully connected layers is used as an initial feature maps extractor. In detail, a pretrained deep CNN model that was fully trained on the ImageNet dataset is selected as a feature extractor in this paper. Then, the initial feature maps are fed into a newly designed CapsNet to obtain the final classification result. The proposed architecture is extensively evaluated on three public challenging benchmark remote sensing image datasets: the UC Merced Land-Use dataset with 21 scene categories, AID dataset with 30 scene categories, and the NWPU-RESISC45 dataset with 45 challenging scene categories. The experimental results demonstrate that the proposed method can lead to a competitive classification performance compared with the state-of-the-art methods.

Using Siamese Capsule Networks for Remote Sensing Scene Classification

Remote Sensing Image Scene Classification Using CNN-CapsNet

Remote Sensing Scene Image Classification Model Based on Multi-Scale Features and Attention Mechanism

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Remote Sensing Scene Classification by Gated Bidirectional Network

3D Convolutional Siamese Network for Few-Shot Hyperspectral Classification

Hyperspectral Remote Sensing Image Classification Using Deep Convolutional Capsule Network

A Discriminative Learned CNN Embedding for Remote Sensing Image Scene Classification

Scene Recognition Using Deep Softpool Capsule Network Based on Residual Diverse Branch Block

Spatial Information Considered Network for Scene Classification

Channel-Attention-Based DenseNet Network for Remote Sensing Image Scene Classification

RS-CapsNet: an Advanced Capsule Network.

Rotation Invariance Regularization for Remote Sensing Image Scene Classification with Convolutional Neural Networks

Physiology and measurement of uterine activity and their clinical applications.

A Non-Local Capsule Neural Network For Hyperspectral Remote Sensing Image Classification

Remote Sensing Image Scene Classification in Hybrid Classical–Quantum Transferring CNN with Small Samples

Multilevel Capsule Weighted Aggregation Network Based on a Decoupled Dynamic Filter for Remote Sensing Scene Classification

SD-CapsNet: A Siamese Dense Capsule Network for SAR Image Registration with Complex Scenes

Pseudo-Siamese Capsule Network for Aerial Remote Sensing Images Change Detection

Semi-Supervised Scene Classification for Remote Sensing Images Based on CNN and Ensemble Learning.

Capsule Attention Module-Based CapsNet for Hyperspectral Image Classification