Abstract:The advancement in satellite image sensors has enabled the acquisition of high-resolution remote sensing (HRRS) images. However, interpreting these images accurately and obtaining the computational power needed to do so is challenging due to the complexity involved. This manuscript proposed a multi-stream convolutional neural network (CNN) fusion framework that involves multi-scale and multi-CNN integration for HRRS image recognition. The pre-trained CNNs were used to learn and extract semantic features from multi-scale HRRS images. Feature extraction using pre-trained CNNs is more efficient than training a CNN from scratch or fine-tuning a CNN. Discriminative canonical correlation analysis (DCCA) was used to fuse deep features extracted across CNNs and image scales. DCCA reduced the dimension of the features extracted from CNNs while providing a discriminative representation by maximizing the within-class correlation and minimizing the between-class correlation. The proposed model has been evaluated on NWPU-RESISC45 and UC Merced datasets. The accuracy associated with DCCA was 10% and 6% higher than discriminant correlation analysis (DCA) in the NWPU-RESISC45 and UC Merced datasets. The advantage of DCCA was better demonstrated in the NWPU-RESISC45 dataset due to the incorporation of richer within-class variability in this dataset. While both DCA and DCCA minimize between-class correlation, only DCCA maximizes the within-class correlation and, therefore, attains better accuracy. The proposed framework achieved higher accuracy than all state-of-the-art frameworks involving unsupervised learning and pre-trained CNNs and 2–3% higher than the majority of fine-tuned CNNs. The proposed framework offers computational time advantages, requiring only 13 s for training in NWPU-RESISC45, compared to a day for fine-tuning the existing CNNs. Thus, the proposed framework achieves a favourable balance between efficiency and accuracy in HRRS image recognition.

Merging recovery feature network to faster RCNN for low-resolution images detection

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Hybrid dilated multilayer faster RCNN for object detection

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

RSCNN: A CNN-Based Method to Enhance Low-Light Remote-Sensing Images

Deconv R-Cnn For Small Object Detection On Remote Sensing Images

M2F2-RCNN: Multi-functional faster RCNN based on multi-scale feature fusion for region search in remote sensing images

RCNet: Reverse Feature Pyramid and Cross-scale Shift Network for Object Detection

Residual Dense Network for Image Restoration

Deep Convolutional Feature Enhancement for Remote Sensing Object Detection

Classifier Shared Deep Network with Multi-Hierarchy Loss for Low Resolution Face Recognition

R-FCN plus plus : Towards Accurate Region-Based Fully Convolutional Networks for Object Detection

Deeply Recursive Low- and High-Frequency Fusing Networks for Single Image Super-Resolution

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

A Multi-Scale Target Detection Method Using an Improved Faster Region Convolutional Neural Network Based on Enhanced Backbone and Optimized Mechanisms

Multi-branch feature fusion and refinement network for salient object detection

An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images

CR-FPN: channel relation feature pyramid network for object detection

Improving Object Detection in YOLOv8n with the C2f-f Module and Multi-Scale Fusion Reconstruction

LatLRR-CNN: an Infrared and Visible Image Fusion Method Combining Latent Low-Rank Representation and CNN.