Abstract:Aerial scene classification is an active and challenging problem in high-resolution remote sensing imagery understanding. Deep learning models, especially convolutional neural networks (CNNs), have achieved prominent performance in this field. The extraction of deep features from the layers of a CNN model is widely used in these CNN-based methods. Although the CNN-based approaches have obtained great success, there is still plenty of room to further increase the classification accuracy. As a matter of fact, the fusion with other features has great potential for leading to the better performance of aerial scene classification. Therefore, we propose two effective architectures based on the idea of feature-level fusion. The first architecture, i.e., texture coded two-stream deep architecture, uses the raw RGB network stream and the mapped local binary patterns (LBP) coded network stream to extract two different sets of features and fuses them using a novel deep feature fusion model. In the second architecture, i.e., saliency coded two-stream deep architecture, we employ the saliency coded network stream as the second stream and fuse it with the raw RGB network stream using the same feature fusion model. For sake of validation and comparison, our proposed architectures are evaluated via comprehensive experiments with three publicly available remote sensing scene datasets. The classification accuracies of saliency coded two-stream architecture with our feature fusion model achieve 97.79%, 98.90%, 94.09%, 95.99%, 85.02%, and 87.01% on the UC-Merced dataset (50% and 80% training samples), the Aerial Image Dataset (AID) (20% and 50% training samples), and the NWPU-RESISC45 dataset (10% and 20% training samples), respectively, overwhelming state-of-the-art methods.

Adaptive weights learning in CNN feature fusion for crime scene investigation image classification

A Novel Feature Fusion with Self-adaptive Weight Method Based on Deep Learning for Image Classification

Suspect Multifocus Image Fusion Based on Sparse Denoising Autoencoder Neural Network for Police Multimodal Big Data Analysis

Infrared and Visible Image Fusion Based on a Two-Stage Class Conditioned Auto-Encoder Network.

An Infrared and Visible Image Fusion Method Based on Adaptive Weight Learning

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

An adaptive weighting multimodal fusion classification system for steel plate surface defect

Dense Connectivity Based Two-Stream Deep Feature Fusion Framework for Aerial Scene Classification

Dynamic Feature Fusion for Semantic Edge Detection

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

AFCANet: An adaptive feature concatenate attention network for multi-focus image fusion

Adaptive spatial and frequency experts fusion network for medical image fusion

Multi-focus image fusion with a deep convolutional neural network

Improving the Performance of Image Fusion Based on Visual Saliency Weight Map Combined with CNN.

An Adaptive Multilayer Feature Fusion Strategy for Remote Sensing Scene Classification

Multiscale network based on feature fusion for fire disaster detection in complex scenes

Dual-Domain Fusion Convolutional Neural Network for Contrast Enhancement Forensics

A multi-information fusion anomaly detection model based on convolutional neural networks and AutoEncoder

Adjacent-level Feature Cross-Fusion with 3D CNN for Remote Sensing Image Change Detection.

Decision-Level Fusion with a Pluginable Importance Factor Generator for Remote Sensing Image Scene Classification

Hyperspectral anomaly detection based on adaptive weighting method combined with autoencoder and convolutional neural network