Abstract:Leveraging multi-view remote sensing images in scene classification tasks significantly enhances the precision of such classifications. This approach, however, poses challenges due to the simultaneous use of multi-view images, which often leads to a misalignment between the visual content and semantic labels, thus complicating the classification process. In addition, as the number of image viewpoints increases, the quality problem for remote sensing images further limits the effectiveness of multi-view image classification. Traditional scene classification methods predominantly employ SoftMax deep learning techniques, which lack the capability to assess the quality of remote sensing images or to provide explicit explanations for the network's predictive outcomes. To address these issues, this paper introduces a novel end-to-end multi-view decision fusion network specifically designed for remote sensing scene classification. The network integrates information from multi-view remote sensing images under the guidance of image credibility and uncertainty, and when the multi-view image fusion process encounters conflicts, it greatly alleviates the conflicts and provides more reasonable and credible predictions for the multi-view scene classification results. Initially, multi-scale features are extracted from the multi-view images using convolutional neural networks (CNNs). Following this, an asymptotic adaptive feature fusion module (AAFFM) is constructed to gradually integrate these multi-scale features. An adaptive spatial fusion method is then applied to assign different spatial weights to the multi-scale feature maps, thereby significantly enhancing the model's feature discrimination capability. Finally, an evidence decision fusion module (EDFM), utilizing evidence theory and the Dirichlet distribution, is developed. This module quantitatively assesses the uncertainty in the multi-perspective image classification process. Through the fusing of multi-perspective remote sensing image information in this module, a rational explanation for the prediction results is provided. The efficacy of the proposed method was validated through experiments conducted on the AiRound and CV-BrCT datasets. The results show that our method not only improves single-view scene classification results but also advances multi-view remote sensing scene classification results by accurately characterizing the scene and mitigating the conflicting nature of the fusion process.

Multi-view SAR Image Classification Through Decision Fusion of Adaptive Dictionary Learning and CNN

Coupled Dictionary Learning for Target Recognition in SAR Images

Decision Fusion Strategies For Sar Image Target Recognition

A multi-view stable feature extraction network for SAR target recognition

SAR Image Fusion Classification Based on the Decision-Level Combination of Multi-Band Information

Recognition of targets in SAR images using joint classification of deep features fused by multi-canonical correlation analysis

A Multiview Interclass Dissimilarity Feature Fusion SAR Images Recognition Network Within Limited Sample Condition

FEF-Net: A Deep Learning Approach to Multiview SAR Image Target Recognition

SAR Image Classification Using Fully Connected Conditional Random Fields Combined with Deep Learning and Superpixel Boundary Constraint

Multi-Modal Domain Fusion for Multi-modal Aerial View Object Classification

Multi-scale direction-aware SAR object detection network via global information fusion

Two-Stream Deep Fusion Network Based on VAE and CNN for Synthetic Aperture Radar Target Recognition

Simulation-assisted SAR Target Classification Based on Unsupervised Domain Adaptation and Model Interpretability Analysis

Convolutional Feature Aggregation Network With Self-Supervised Learning and Decision Fusion for SAR Target Recognition

Automatic Target Recognition in SAR Images Based on a Combination of CNN and SVM

SAR Target Recognition with the Fusion of LDA and ICA

SAR Target Classification Based on Integration of ASC Parts Model and Deep Learning Algorithm

SAR Target Recognition Using PCA, ICA and Gabor Wavelet Decision Fusion

Semantics-Assisted Multiview Fusion for SAR Automatic Target Recognition

Deep neural network based on attention and feature complementary fusion for synthetic aperture radar image classification with small samples

Multi-View Scene Classification Based on Feature Integration and Evidence Decision Fusion