Abstract:Hyperspectral images (HSIs) and light detection and ranging (LiDAR) are two critical and frequently used types of remote sensing data, each containing rich spectral and elevation information. Fusing HSI and LiDAR can exploit the complementary properties of the two modalities for ground object classification. The performance of existing fusion classification methods is often limited by the difficulty of adapting feature extraction operators to complex spatial distributions, and the correlation and specificity between different modalities are not reasonably exploited. Therefore, the reinforcement learningbased markov edge decoupled fusion network (MEDFN) is proposed. This network can intelligently compose graphs based on different modal characteristics and tasks to adapt to complex spatial distributions; it can also suppress noise to complete fusion classification while fully utilizing complementary information of different modalities. First, a reinforcement learning-based graph construction subnetwork (RLGN) is proposed to learn a twomodal graph construction strategy suitable for classification tasks by transforming regular multimodal data into irregular graph data. Second, a multimodal edge attention module (MEAM) is proposed to extract edge features between spatial neighboring nodes and model the importance of each node, thereby capturing the spatial topology information encompassed in the multimodal data. Finally, the decoupled multimodal fusion module (DMFM) is proposed to decouple multimodal features into shared and unshared parts and enhance the model's ability to distinguish features by targeting the modal-shared feature between modalities and modal-specific feature. The experimental results based on three well-known HSI and LiDAR datasets demonstrate the effectiveness of the proposed MEDFN in fusion classification tasks.

A Novel Discount-Weighted Average Fusion Method Based on Reinforcement Learning for Conflicting Data

A Novel Decision Fusion Scheme with Feedback in Neyman-Pearson Detection Systems.

A novel multi-criteria conflict evidence combination method and its application to pattern recognition

Decision Fusion Transmitted over Fading Channels in Wireless Sensor Networks

A novel collaborative bearing fault diagnosis method based on multi-scale dynamic fusion network under speed fluctuating condition

A Novel Multi-Sensor Hybrid Fusion Framework

A novel conflict management considering the optimal discounting weights using the BWM method in Dempster-Shafer evidence theory

FedDRL: A Trustworthy Federated Learning Model Fusion Method Based on Staged Reinforcement Learning

A novel multi-classifier information fusion based on Dempster-Shafer theory: application to vibration-based fault detection

A novel multi-fidelity surrogate modeling method for non-hierarchical data fusion

Weighted assignment fusion algorithm of evidence conflict based on Euclidean distance and weighting strategy, and application in the wind turbine system

Bacterial Interdigital Scaly Erythema (Kitamura): A Possible New Clinical Entity

An improved evidence fusion algorithm in multi-sensor systems

Optimal Distributed Finite-Time Fusion Method for Multi-Sensor Networks under Dynamic Communication Weight

A Deep Learning Based Data Fusion Method for Degradation Modeling and Prognostics

ASLAM-FD: A multi-sensor adaptive collaborative fusion SLAM framework based on degradation detection and deep reinforcement learning

Data Fusion: Resolving Conflicts from Multiple Sources

A Novel Dynamic Fusion Approach Using Information Entropy for Interval-Valued Ordered Datasets

A Novel Conflict Measurement in Decision-Making and Its Application in Fault Diagnosis

Reinforcement Learning Based Markov Edge Decoupled Fusion Network for Fusion Classification of Hyperspectral and LiDAR

Multi-Sensor Weighted Fusion Based on Dempster-Shafer Theory