Abstract:Leveraging multi-view remote sensing images in scene classification tasks significantly enhances the precision of such classifications. This approach, however, poses challenges due to the simultaneous use of multi-view images, which often leads to a misalignment between the visual content and semantic labels, thus complicating the classification process. In addition, as the number of image viewpoints increases, the quality problem for remote sensing images further limits the effectiveness of multi-view image classification. Traditional scene classification methods predominantly employ SoftMax deep learning techniques, which lack the capability to assess the quality of remote sensing images or to provide explicit explanations for the network's predictive outcomes. To address these issues, this paper introduces a novel end-to-end multi-view decision fusion network specifically designed for remote sensing scene classification. The network integrates information from multi-view remote sensing images under the guidance of image credibility and uncertainty, and when the multi-view image fusion process encounters conflicts, it greatly alleviates the conflicts and provides more reasonable and credible predictions for the multi-view scene classification results. Initially, multi-scale features are extracted from the multi-view images using convolutional neural networks (CNNs). Following this, an asymptotic adaptive feature fusion module (AAFFM) is constructed to gradually integrate these multi-scale features. An adaptive spatial fusion method is then applied to assign different spatial weights to the multi-scale feature maps, thereby significantly enhancing the model's feature discrimination capability. Finally, an evidence decision fusion module (EDFM), utilizing evidence theory and the Dirichlet distribution, is developed. This module quantitatively assesses the uncertainty in the multi-perspective image classification process. Through the fusing of multi-perspective remote sensing image information in this module, a rational explanation for the prediction results is provided. The efficacy of the proposed method was validated through experiments conducted on the AiRound and CV-BrCT datasets. The results show that our method not only improves single-view scene classification results but also advances multi-view remote sensing scene classification results by accurately characterizing the scene and mitigating the conflicting nature of the fusion process.

An Approach of Classification Based on Pixel Level and Decision Level Fusion of Multi-source Images in Remote Sensing

Classification of High Spatial Resolution Remote Sensing Images Based on Decision Fusion

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

The Realistic Fusion of Multi-spectral Images

An Effective Multi-model Fusion Method for SAR and Optical Remote Sensing Images

A Remote Sensing Image Fusion Method Combining Low-Level Visual Features and Parameter-Adaptive Dual-Channel Pulse-Coupled Neural Network

Deep Feature Fusion for High-Resolution Aerial Scene Classification

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

A pixel-level fusion method for multi-source optical remote sensing image combining the principal component analysis and curvelet transform

A Decision-Level Fusion Method Based On Convolutional Neural Networks For Remote Sensing Scene Classification

Multi-source Remote Sensing Image Fusion Based on Support Vector Machine

Comparison of Pixel-Based Fusion Between Multi-Spectral Data and High Spatial Resolution Data

A Decision Fusion Method for Land Cover Classification Using Multi-Sensor Data

Multi-source remote sensing data fusion: status and trends

Multiple Feature-Based Superpixel-Level Decision Fusion for Hyperspectral and LiDAR Data Classification

A Novel Remote Sensing Image Classification Scheme Based on Data Fusion, Multiple Features and Ensemble Learning

Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network

Multi-View Scene Classification Based on Feature Integration and Evidence Decision Fusion

Decision Fusion Based on Extended Multi-Attribute Profiles for Hyperspectral Image Classification.

SAR Image Fusion Classification Based on the Decision-Level Combination of Multi-Band Information

Remote Sensing Scene Classification Based on Decision-Level Fusion