Abstract:The advancement in satellite image sensors has enabled the acquisition of high-resolution remote sensing (HRRS) images. However, interpreting these images accurately and obtaining the computational power needed to do so is challenging due to the complexity involved. This manuscript proposed a multi-stream convolutional neural network (CNN) fusion framework that involves multi-scale and multi-CNN integration for HRRS image recognition. The pre-trained CNNs were used to learn and extract semantic features from multi-scale HRRS images. Feature extraction using pre-trained CNNs is more efficient than training a CNN from scratch or fine-tuning a CNN. Discriminative canonical correlation analysis (DCCA) was used to fuse deep features extracted across CNNs and image scales. DCCA reduced the dimension of the features extracted from CNNs while providing a discriminative representation by maximizing the within-class correlation and minimizing the between-class correlation. The proposed model has been evaluated on NWPU-RESISC45 and UC Merced datasets. The accuracy associated with DCCA was 10% and 6% higher than discriminant correlation analysis (DCA) in the NWPU-RESISC45 and UC Merced datasets. The advantage of DCCA was better demonstrated in the NWPU-RESISC45 dataset due to the incorporation of richer within-class variability in this dataset. While both DCA and DCCA minimize between-class correlation, only DCCA maximizes the within-class correlation and, therefore, attains better accuracy. The proposed framework achieved higher accuracy than all state-of-the-art frameworks involving unsupervised learning and pre-trained CNNs and 2–3% higher than the majority of fine-tuned CNNs. The proposed framework offers computational time advantages, requiring only 13 s for training in NWPU-RESISC45, compared to a day for fine-tuning the existing CNNs. Thus, the proposed framework achieves a favourable balance between efficiency and accuracy in HRRS image recognition.

Multi-Feature Fusion Based Recognition and Relevance Analysis of Propagation Scenes for High-Speed Railway Channels

Multi-feature Fusion for High-Speed Railway Propagation Scene Recognition Based on LSTM Networks

Deep-Learning Based Scenario Identification for High-Speed Railway Propagation Channels.

Weighted Score Fusion Based LSTM Model for High-Speed Railway Propagation Scenario Identification

Deep-Learning Based Spatial-Temporal Channel Prediction for Smart High-Speed Railway Communication Networks

Investigation of Cross-Correlation Characteristics for Multi-Link Channels in High-Speed Railway Scenarios

Efficient Dual-Stream Fusion Network for Real-Time Railway Scene Understanding

Deep Learning Based Channel Prediction for Massive MIMO Systems in High-Speed Railway Scenarios

Densely Multi-scale Fusion Network for Lightweight and Accurate Semantic Segmentation of Railway Scenes

Real-Time Positioning of Autonomous High-Speed Trains: Combining AI-based Perception and Multi-Source Sensor Data

Semantic Segmentation of Railway Scene Based on Reticulated Multi-scale and Bidirectional Channel Attention

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

Joint Channel Characteristics in High-Speed Railway Multi-Link Propagation Scenarios: Measurement, Analysis, and Modeling

Image Fusion Methods in High-Speed Railway Scenes: A Survey

Analysis of Nonstationary Characteristics for High-Speed Railway Scenarios

Measurements and Analysis of Short-Term Fading Behavior in High-Speed Railway Communication Networks.

Video-based Adaptive Railway Recognition in Complex Scene

Novel Registration and Fusion Algorithm for Multimodal Railway Images with Different Field of Views

Multi-sequence spatio-temporal feature fusion network for peak-hour passenger flow prediction in urban rail transit

Channel Modeling Based on Random Propagation Graphs for High Speed Railway Scenarios

Railway Train Location and Multi-scale Data Fusion