Abstract:Leveraging multi-view remote sensing images in scene classification tasks significantly enhances the precision of such classifications. This approach, however, poses challenges due to the simultaneous use of multi-view images, which often leads to a misalignment between the visual content and semantic labels, thus complicating the classification process. In addition, as the number of image viewpoints increases, the quality problem for remote sensing images further limits the effectiveness of multi-view image classification. Traditional scene classification methods predominantly employ SoftMax deep learning techniques, which lack the capability to assess the quality of remote sensing images or to provide explicit explanations for the network's predictive outcomes. To address these issues, this paper introduces a novel end-to-end multi-view decision fusion network specifically designed for remote sensing scene classification. The network integrates information from multi-view remote sensing images under the guidance of image credibility and uncertainty, and when the multi-view image fusion process encounters conflicts, it greatly alleviates the conflicts and provides more reasonable and credible predictions for the multi-view scene classification results. Initially, multi-scale features are extracted from the multi-view images using convolutional neural networks (CNNs). Following this, an asymptotic adaptive feature fusion module (AAFFM) is constructed to gradually integrate these multi-scale features. An adaptive spatial fusion method is then applied to assign different spatial weights to the multi-scale feature maps, thereby significantly enhancing the model's feature discrimination capability. Finally, an evidence decision fusion module (EDFM), utilizing evidence theory and the Dirichlet distribution, is developed. This module quantitatively assesses the uncertainty in the multi-perspective image classification process. Through the fusing of multi-perspective remote sensing image information in this module, a rational explanation for the prediction results is provided. The efficacy of the proposed method was validated through experiments conducted on the AiRound and CV-BrCT datasets. The results show that our method not only improves single-view scene classification results but also advances multi-view remote sensing scene classification results by accurately characterizing the scene and mitigating the conflicting nature of the fusion process.

Self-Weighted Multi-View Metric Learning and Its Application for Remote Sensing Image Scene Classification

Image classification with multi-view multi-instance metric learning

MMI-ML: Maximize Mutual Information Between Different Views for Few-Shot Remote Sensing Image Classification

Few-Shot Remote Sensing Image Scene Classification Based on Metric Learning and Local Descriptors

Feature significance-based multibag-of-visual-words model for remote sensing image scene classification

Cross-scene Hyperspectral Image Classification Based on DWT and Manifold-Constrained Subspace Learning

Multi-view metric learning for visual classification

Multi-view hyperspectral image classification via weighted sparse representation

Multi-View Scene Classification Based on Feature Integration and Evidence Decision Fusion

When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs

Multi-class SVM based remote sensing image classification and its semi-supervised improvement scheme

Multi‐View Self‐Supervised Auxiliary Task for Few‐Shot Remote Sensing Classification

Kernelized Multiview Subspace Analysis By Self-Weighted Learning

Multi-View Ground-Based Cloud Recognition by Transferring Deep Visual Information

Looking Closer at the Scene: Multiscale Representation Learning for Remote Sensing Image Scene Classification

When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework

High-Order Distance-Based Multiview Stochastic Learning in Image Classification

SDL-MVS: View Space and Depth Deformable Learning Paradigm for Multi-View Stereo Reconstruction in Remote Sensing

Subspace-based self-weighted multiview fusion for instance retrieval

Towards robust classification of multi-view remote sensing images with partial data availability

Robust Self-Paced Incremental Learning for Multitemporal Remote Sensing Image Classification