Abstract:Aerial scene classification is an active and challenging problem in high-resolution remote sensing imagery understanding. Deep learning models, especially convolutional neural networks (CNNs), have achieved prominent performance in this field. The extraction of deep features from the layers of a CNN model is widely used in these CNN-based methods. Although the CNN-based approaches have obtained great success, there is still plenty of room to further increase the classification accuracy. As a matter of fact, the fusion with other features has great potential for leading to the better performance of aerial scene classification. Therefore, we propose two effective architectures based on the idea of feature-level fusion. The first architecture, i.e., texture coded two-stream deep architecture, uses the raw RGB network stream and the mapped local binary patterns (LBP) coded network stream to extract two different sets of features and fuses them using a novel deep feature fusion model. In the second architecture, i.e., saliency coded two-stream deep architecture, we employ the saliency coded network stream as the second stream and fuse it with the raw RGB network stream using the same feature fusion model. For sake of validation and comparison, our proposed architectures are evaluated via comprehensive experiments with three publicly available remote sensing scene datasets. The classification accuracies of saliency coded two-stream architecture with our feature fusion model achieve 97.79%, 98.90%, 94.09%, 95.99%, 85.02%, and 87.01% on the UC-Merced dataset (50% and 80% training samples), the Aerial Image Dataset (AID) (20% and 50% training samples), and the NWPU-RESISC45 dataset (10% and 20% training samples), respectively, overwhelming state-of-the-art methods.

APDC-Net: Attention Pooling-Based Convolutional Network for Aerial Scene Classification

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Multiple instance dense connected convolution neural network for aerial image scene classification

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Deep Feature Fusion for High-Resolution Aerial Scene Classification

Channel-Attention-Based DenseNet Network for Remote Sensing Image Scene Classification

Attention GANs: Unsupervised Deep Feature Learning for Aerial Scene Classification.

CSDS: End-to-End Aerial Scenes Classification With Depthwise Separable Convolution and an Attention Mechanism

Dense Connectivity Based Two-Stream Deep Feature Fusion Framework for Aerial Scene Classification

An Aerial Image Segmentation Approach Based on Enhanced Multi-Scale Convolutional Neural Network

APNet: Accurate Positioning Deformable Convolution for UAV Image Object Detection

Semantic Segmentation of Aerial Imagery Via Split-Attention Networks with Disentangled Nonlocal and Edge Supervision

A Remote-Sensing Scene-Image Classification Method Based on Deep Multiple-Instance Learning with a Residual Dense Attention ConvNet

Local Semantic Enhanced ConvNet for Aerial Scene Recognition

AtICNet: Semantic Segmentation with Atrous Spatial Pyramid Pooling in Image Cascade Network

Pre-Trained Alexnet Architecture With Pyramid Pooling And Supervision For High Spatial Resolution Remote Sensing Image Scene Classification

Global-Local Attention Network for Aerial Scene Classification

DeepScene: Scene classification via convolutional neural network with spatial pyramid pooling

Attention-based DenseNet network for multi-source remote sensing classification

A Deep Neural Network Combined With Context Features for Remote Sensing Scene Classification

DPANET:Dual Pooling Attention Network for Semantic Segmentation