Abstract:The advancement in satellite image sensors has enabled the acquisition of high-resolution remote sensing (HRRS) images. However, interpreting these images accurately and obtaining the computational power needed to do so is challenging due to the complexity involved. This manuscript proposed a multi-stream convolutional neural network (CNN) fusion framework that involves multi-scale and multi-CNN integration for HRRS image recognition. The pre-trained CNNs were used to learn and extract semantic features from multi-scale HRRS images. Feature extraction using pre-trained CNNs is more efficient than training a CNN from scratch or fine-tuning a CNN. Discriminative canonical correlation analysis (DCCA) was used to fuse deep features extracted across CNNs and image scales. DCCA reduced the dimension of the features extracted from CNNs while providing a discriminative representation by maximizing the within-class correlation and minimizing the between-class correlation. The proposed model has been evaluated on NWPU-RESISC45 and UC Merced datasets. The accuracy associated with DCCA was 10% and 6% higher than discriminant correlation analysis (DCA) in the NWPU-RESISC45 and UC Merced datasets. The advantage of DCCA was better demonstrated in the NWPU-RESISC45 dataset due to the incorporation of richer within-class variability in this dataset. While both DCA and DCCA minimize between-class correlation, only DCCA maximizes the within-class correlation and, therefore, attains better accuracy. The proposed framework achieved higher accuracy than all state-of-the-art frameworks involving unsupervised learning and pre-trained CNNs and 2–3% higher than the majority of fine-tuned CNNs. The proposed framework offers computational time advantages, requiring only 13 s for training in NWPU-RESISC45, compared to a day for fine-tuning the existing CNNs. Thus, the proposed framework achieves a favourable balance between efficiency and accuracy in HRRS image recognition.

Fisher Subspace Tree Classifier Based on Neural Networks

Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique—Subtropical Area for Example

An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN)

Deep Linear Discriminant Analysis on Fisher Networks: A Hybrid Architecture for Person Re-identification

HCFNN: High-order Coverage Function Neural Network for Image Classification

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Deep FisherNet for Object Classification

Hybrid of the Approximate Neural Network with Sparse Ram and Fisher'S Linear Discriminant for Face Recognition

Face Recognition Based on Adaptively Weighted Fisherface

Multi-classification deep neural networks for identification of fish species using camera captured images

Learning Deep Classifiers With Deep Features

Improvement of face recognition performance using a new hybrid subspace classifier

Hybrid Dimensionality Reduction Forest with Pruning for High-Dimensional Data Classification

A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification

A Novel Classification Method Using the Combination of FDPS and Flexible Neural Tree

A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-dimensional Data Classification

HDTFF-Net: Hierarchical Deep Texture Features Fusion Network for High-resolution Remote Sensing Scene Classification

Divergence Regulated Encoder Network for Joint Dimensionality Reduction and Classification

A class density approximation neural network for improving the generalization of Fisherface.

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

Enhanced fish species classification using dynamic multilayer perceptron and transformer encoders with extra distribution data