Dual-Branch Domain Adaptation Few-Shot Learning for Hyperspectral Image Classification

Zhuowei Wang,Shihui Zhao,Genping Zhao,Xiaoyu Song
DOI: https://doi.org/10.1109/tgrs.2024.3356199
IF: 8.2
2024-02-07
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Cross-domain few-shot learning (FSL) often employs adversarial domain adaptation techniques to address the issue of data distribution discrepancies between the source and target domains. However, forcing the alignment of two distinct domains may lead to distortions in class distribution alignment and result in a decrease in classification performance in hyperspectral image (HSI) analysis. Moreover, existing cross-domain methods are often applied to satellite/airborne HSIs as both the source and target domains. It is rarely explored whether the same cross-domain methods can be applied for cross-applications where the source and target domain data could be both satellite/airborne HSIs with lower spatial resolution and unmanned aerial vehicle (UAV) HSIs with higher spatial resolution. To address these issues, this article proposes a novel domain-adaptive FSL network with dual branches, respectively, aiming at domain fusion and domain separation. The domain fusion branch uses a conditional adversarial network to align the global distributions of the two domains, while the domain separation branch introduces a gate mechanism for discriminative feature learning in each domain to achieve independent category distributions. During the experiment, the proposed method is evaluated by performing cross-transfer learning under the condition that low-spatial-resolution hyperspectral data and high-spatial-resolution hyperspectral data are used as source and target data alternately. The experimental results suggest that the proposed method not only mitigates the negative effects of forced alignment in domain fusion, but also holds potential for cross-domain transfer learning between low- and high-spatial-resolution HSIs.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?