Abstract:Hyperspectral datasets captured by airborne are one of the important data sources in the field of hyperspectral image fusion. However, the limited number of data samples often hinders the optimal performance of deep learning-based methods on these datasets. Domain adaptation is expected to alleviate the issue of data scarcity. However, there are two issues that need to be addressed in applying domain adaptation to hyperspectral image fusion, which are the heterogeneity and spatial degradation diversity of hyperspectral data. In this paper, we propose a domain adaptation hyperspectral image fusion network based on spatial-spectral domain separation. The model, constructed with three-dimensional convolutional layers, effectively addresses the challenge of hyperspectral data heterogeneity. Compared with 2D convolution, 3D convolution is able to consider both spatial and spectral dimensions and extract spatial-spectral features efficiently. Based on this, we design a domain-separation architecture to extract domain-invariant and domain-private features in the spatial-spectral domain. The architecture achieves domain adaptation by extracting domain-invariant features from both datasets to obtain the prior knowledge in the source dataset and apply it to the target dataset. Additionally, the spatial degradation of different datasets varies due to distinct shooting conditions during the acquisition. Therefore, the fusion algorithms should be robust to various degradation scenarios. To tackle this challenge, we design the Observation Module to predict degradation information and the Degradation Information Modulation Module to apply it to the input, thereby enhancing the network's robustness. Experiments on various datasets demonstrate that our method is qualitatively and quantitatively superior to state-of-the-art methods.

Domain Adaptation Based on Feature Fusion and Multi-Attention Mechanism

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

Deep Joint Two-Stream Wasserstein Auto-Encoder and Selective Attention Alignment for Unsupervised Domain Adaptation

Multiscale Attention-Based Subdomain Dynamic Adaptation for Cross-Domain Scene Classification

A Framework for Self-Supervised Federated Domain Adaptation

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Hierarchical Domain Adaptation with Local Feature Patterns

Joint Attention-Driven Domain Fusion and Noise-Tolerant Learning for Multi-Source Domain Adaptation

Intelligent fault diagnosis of double-aligned domain adaptation based on multi-structure fusion and multi-attention mechanism

Multi-modal Domain Adaptation Method Based on Parameter Fusion and Two-Step Alignment

Dual-Branch Domain Adaptation Few-Shot Learning for Hyperspectral Image Classification

Cross-domain feature enhancement for unsupervised domain adaptation

Multi-source unsupervised domain adaptation for object detection

Domain adaptation hyperspectral image fusion based on spatial-spectral domain separation

Structure-Aware Feature Fusion For Unsupervised Domain Adaptation

Attention-Based Multi-view Feature Fusion for Cross-Domain Recommendation

Domain Conditioned Adaptation Network

Universal Domain Adaptation via Compressive Attention Matching

Enhanced Unsupervised Domain Adaptation with Dual-Attention Between Classification and Domain Alignment.