Abstract:Leveraging multi-view remote sensing images in scene classification tasks significantly enhances the precision of such classifications. This approach, however, poses challenges due to the simultaneous use of multi-view images, which often leads to a misalignment between the visual content and semantic labels, thus complicating the classification process. In addition, as the number of image viewpoints increases, the quality problem for remote sensing images further limits the effectiveness of multi-view image classification. Traditional scene classification methods predominantly employ SoftMax deep learning techniques, which lack the capability to assess the quality of remote sensing images or to provide explicit explanations for the network's predictive outcomes. To address these issues, this paper introduces a novel end-to-end multi-view decision fusion network specifically designed for remote sensing scene classification. The network integrates information from multi-view remote sensing images under the guidance of image credibility and uncertainty, and when the multi-view image fusion process encounters conflicts, it greatly alleviates the conflicts and provides more reasonable and credible predictions for the multi-view scene classification results. Initially, multi-scale features are extracted from the multi-view images using convolutional neural networks (CNNs). Following this, an asymptotic adaptive feature fusion module (AAFFM) is constructed to gradually integrate these multi-scale features. An adaptive spatial fusion method is then applied to assign different spatial weights to the multi-scale feature maps, thereby significantly enhancing the model's feature discrimination capability. Finally, an evidence decision fusion module (EDFM), utilizing evidence theory and the Dirichlet distribution, is developed. This module quantitatively assesses the uncertainty in the multi-perspective image classification process. Through the fusing of multi-perspective remote sensing image information in this module, a rational explanation for the prediction results is provided. The efficacy of the proposed method was validated through experiments conducted on the AiRound and CV-BrCT datasets. The results show that our method not only improves single-view scene classification results but also advances multi-view remote sensing scene classification results by accurately characterizing the scene and mitigating the conflicting nature of the fusion process.

A Multi-View Model Fusion Network with Double Branch Structure

MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion

MVF-Net: A Multi-view Fusion Network for Event-based Object Classification

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Multi-View Active Sensing for Human-Robot Interaction via Hierarchically Connected Tree

Online video visual relation detection with hierarchical multi-modal fusion

A Late Fusion Approach for Harnessing Multi-Cnn Model High-Level Features

Deep Embedded Complementary and Interactive Information for Multi-View Classification

MMRDN: Consistent Representation for Multi-View Manipulation Relationship Detection in Object-Stacked Scenes

Efficient Bi-manipulation using RGBD Multi-model Fusion based on Attention Mechanism

Structure-Aware Multimodal Feature Fusion for RGB-D Scene Classification and Beyond

Multi-View Adaptive Fusion Network for 3D Object Detection

Deep spatiotemporal fusion network for vision-based robotic inspection of structures

Multi-View Vision Fusion Network: Can 2D Pre-Trained Model Boost 3D Point Cloud Data-Scarce Learning?

Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving

Multi-view scene matching with relation aware feature perception

Multi-View Scene Classification Based on Feature Integration and Evidence Decision Fusion

Towards Deeper and Better Multi-view Feature Fusion for 3D Semantic Segmentation

Multi-view dual attention network for 3D object recognition

AMCFCN: attentive multi-view contrastive fusion clustering net

Unifying Visual and Semantic Feature Spaces with Diffusion Models for Enhanced Cross-Modal Alignment