Abstract:The advancement in satellite image sensors has enabled the acquisition of high-resolution remote sensing (HRRS) images. However, interpreting these images accurately and obtaining the computational power needed to do so is challenging due to the complexity involved. This manuscript proposed a multi-stream convolutional neural network (CNN) fusion framework that involves multi-scale and multi-CNN integration for HRRS image recognition. The pre-trained CNNs were used to learn and extract semantic features from multi-scale HRRS images. Feature extraction using pre-trained CNNs is more efficient than training a CNN from scratch or fine-tuning a CNN. Discriminative canonical correlation analysis (DCCA) was used to fuse deep features extracted across CNNs and image scales. DCCA reduced the dimension of the features extracted from CNNs while providing a discriminative representation by maximizing the within-class correlation and minimizing the between-class correlation. The proposed model has been evaluated on NWPU-RESISC45 and UC Merced datasets. The accuracy associated with DCCA was 10% and 6% higher than discriminant correlation analysis (DCA) in the NWPU-RESISC45 and UC Merced datasets. The advantage of DCCA was better demonstrated in the NWPU-RESISC45 dataset due to the incorporation of richer within-class variability in this dataset. While both DCA and DCCA minimize between-class correlation, only DCCA maximizes the within-class correlation and, therefore, attains better accuracy. The proposed framework achieved higher accuracy than all state-of-the-art frameworks involving unsupervised learning and pre-trained CNNs and 2–3% higher than the majority of fine-tuned CNNs. The proposed framework offers computational time advantages, requiring only 13 s for training in NWPU-RESISC45, compared to a day for fine-tuning the existing CNNs. Thus, the proposed framework achieves a favourable balance between efficiency and accuracy in HRRS image recognition.

A Late Fusion Approach for Harnessing Multi-Cnn Model High-Level Features

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

A FEATURE EMBEDDING STRATEGY FOR HIGH-LEVEL CNN REPRESENTATIONS FROM MULTIPLE CONVNETS

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Multi-Modal Image Fusion Via Deep Laplacian Pyramid Hybrid Network

Fusing features of deep convolution neural networks to achieve the scene classification of remote sensing image

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

Multi-FusNet: fusion mapping of features for fine-grained image retrieval networks

Structure-Aware Multimodal Feature Fusion for RGB-D Scene Classification and Beyond

A multi-path adaptive fusion network for multimodal brain tumor segmentation

DeepFuse Neural Networks

HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion

Hybrid FusionNet: A Hybrid Feature Fusion Framework for Multisource High-Resolution Remote Sensing Image Classification

A Joint Convolutional Cross ViT Network for Hyperspectral and Light Detection and Ranging Fusion Classification

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

Image and Encoded Text Fusion for Multi-Modal Classification

FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mamba

Multi-branch feature fusion and refinement network for salient object detection

MVF-Net: A Multi-view Fusion Network for Event-based Object Classification

Fusing Multi-Stream Deep Networks for Video Classification

THFuse: An Infrared and Visible Image Fusion Network using Transformer and Hybrid Feature Extractor