Abstract:Aerial scene classification is an active and challenging problem in high-resolution remote sensing imagery understanding. Deep learning models, especially convolutional neural networks (CNNs), have achieved prominent performance in this field. The extraction of deep features from the layers of a CNN model is widely used in these CNN-based methods. Although the CNN-based approaches have obtained great success, there is still plenty of room to further increase the classification accuracy. As a matter of fact, the fusion with other features has great potential for leading to the better performance of aerial scene classification. Therefore, we propose two effective architectures based on the idea of feature-level fusion. The first architecture, i.e., texture coded two-stream deep architecture, uses the raw RGB network stream and the mapped local binary patterns (LBP) coded network stream to extract two different sets of features and fuses them using a novel deep feature fusion model. In the second architecture, i.e., saliency coded two-stream deep architecture, we employ the saliency coded network stream as the second stream and fuse it with the raw RGB network stream using the same feature fusion model. For sake of validation and comparison, our proposed architectures are evaluated via comprehensive experiments with three publicly available remote sensing scene datasets. The classification accuracies of saliency coded two-stream architecture with our feature fusion model achieve 97.79%, 98.90%, 94.09%, 95.99%, 85.02%, and 87.01% on the UC-Merced dataset (50% and 80% training samples), the Aerial Image Dataset (AID) (20% and 50% training samples), and the NWPU-RESISC45 dataset (10% and 20% training samples), respectively, overwhelming state-of-the-art methods.

Two-stream Contextualized CNN for Fine-Grained Image Classification

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

The Application of Two-Level Attention Models in Deep Convolutional Neural Network for Fine-Grained Image Classification

Dual attention guided multi-scale CNN for fine-grained image classification

Fine-Grained Image Classification Via Combining Vision And Language

Evaluating Two-Stream CNN for Video Classification

Dense Connectivity Based Two-Stream Deep Feature Fusion Framework for Aerial Scene Classification

Channel Interaction Networks for Fine-Grained Image Categorization

Context-aware Coarse-to-fine Network for Single Image Desnowing

Context Encoding for Semantic Segmentation

Part Attentioned Fine-Grained Categorization Using Context Sensitive Flow

Deep Context-Aware Kernel Networks

A Deep Neural Network Combined With Context Features for Remote Sensing Scene Classification

2 Related Work Following the success of deep neural networks for image classification

A Survey on Fine-grained Image Categorization Using Deep Convolutional Features

Deep Salient Object Detection with Contextual Information Guidance

Research on Fine-Grained Image Recognition Based on Foreground Extraction and Convolutional Neural Networks

Context-aware Attentional Pooling (CAP) for Fine-grained Visual Classification

Contextual Convolutional Networks

Evolving Convolutional Neural Network And Its Application In Fine-Grained Visual Categorization

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.