Intra- and Inter-source Interactive Representation Learning Network for Remote Sensing Images Classification

Wenping Ma,Yanshan Guo,Hao Zhu,Xiaoyu Yi,Wenhao Zhao,Yue Wu,Biao Hou,Licheng Jiao
DOI: https://doi.org/10.1109/tgrs.2024.3352816
IF: 8.2
2024-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Recently, remote sensing technology has developed faster and faster, and obtaining high-quality panchromatic (PAN) and multispectral (MS) images has become more accessible. The complementarity between them provides new opportunities in multi-source remote sensing image classification. However, solving the problem of the semantic gap between multi-source high-level features and, at the same time, utilizing the complementary properties between them to reduce inter-source information redundancy is still a challenge. This paper constructs an I 3 RL-Net for the multi-source remote sensing image classification task. Specifically, we design a cross-source interactive enhanced fusion module (CIEF-Module). For multi-level multi-source features, by strengthening the dependencies of intra-source features and conducting inter-source enhanced fusion, intra-source correlation features are refined, and the problem of the inter-source semantic gap can be effectively alleviated. During the cross-source interaction process, we design a complementary representation supervised learning strategy (CRSL-Strategy). According to the similarities and differences of multi-source features, it can adaptively promote complementary feature learning, thus generating a non-redundant multi-source representation. The method has been verified to be effective on multiple RS datasets. The code is open source at: https://github.com/Xidian-AIGroup190726/Ping-Pie-I3RL-Net.git.
What problem does this paper attempt to address?