Abstract:Unsupervised domain adaptation techniques, extensively studied in hyperspectral image (HSI) classification, aim to use labeled source domain data and unlabeled target domain data to learn domain invariant features for cross-scene classification. Compared to natural images, numerous spectral bands of HSIs provide abundant semantic information, but they also increase the domain shift significantly. In most existing methods, both explicit alignment and implicit alignment simply align feature distribution, ignoring domain information in the spectrum. We noted that when the spectral channel between source and target domains is distinguished obviously, the transfer performance of these methods tends to deteriorate. Additionally, their performance fluctuates greatly owing to the varying domain shifts across various datasets. To address these problems, a novel shift-sensitive spatial-spectral disentangling learning (S4DL) approach is proposed. In S4DL, gradient-guided spatial-spectral decomposition is designed to separate domain-specific and domain-invariant representations by generating tailored masks under the guidance of the gradient from domain classification. A shift-sensitive adaptive monitor is defined to adjust the intensity of disentangling according to the magnitude of domain shift. Furthermore, a reversible neural network is constructed to retain domain information that lies in not only in semantic but also the shallow-level detailed information. Extensive experimental results on several cross-scene HSI datasets consistently verified that S4DL is better than the state-of-the-art UDA methods. Our source code will be available at <a class="link-external link-https" href="https://github.com/xdu-jjgs/S4DL" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the domain adaptation problem in cross - scene hyperspectral image (HSI) classification, especially under the unsupervised domain adaptation (UDA) framework. Specifically, the paper aims to reduce the domain differences between different scenes by proposing a new method, thereby improving the generalization ability and transfer performance of the model in different scenes. ### Problem Background 1. **Domain Differences**: Hyperspectral images (HSI) have rich spectral information. However, due to factors such as illumination, seasonal changes, atmospheric conditions, and sensor differences, there are significant domain differences between HSIs of different scenes. These differences make it difficult for traditional classification models to be directly applied to other scenes, resulting in a decline in their portability and generalization ability. 2. **Limitations of Existing Methods**: - Existing UDA methods mainly deal with domain differences through explicit or implicit feature distribution alignment, but these methods ignore the domain information in the spectral dimension. - When the spectral channels between the source domain and the target domain are significantly different, the transfer performance of existing methods often deteriorates, and due to the large fluctuations in domain differences in different datasets and training stages, their performance is also unstable. ### Solutions Proposed in the Paper To solve the above problems, the paper proposes a new framework named S4DL (Shift - sensitive Spatial - Spectral Disentangling Learning). The main contributions of S4DL are as follows: 1. **Gradient - guided Spatial - Spectral Decomposition (GSSD)**: - By calculating the gradient contribution of each channel to domain classification, customized masks are generated to separate domain - specific and domain - invariant representations. - This method can extract domain - invariant features more precisely, thereby improving the cross - domain transfer ability of the model. 2. **Shift - sensitive Adaptive Monitor (SSAM)**: - Dynamically adjust the disentangling strength to adapt to changes in different datasets and training stages according to the magnitude of domain differences. - Continuously monitor the variance between domains through the Exponential Moving Average (EMA) strategy and dynamically fine - tune the alignment strategy. 3. **Reversible Feature Extractor (RFE)**: - A reversible neural network is constructed, which retains the domain information in low - level features, including not only semantic information but also shallow - level detailed information. - This helps to retain the low - level domain - invariant features while extracting high - level features, further improving the generalization ability of the model. ### Summary By proposing the S4DL framework, the paper solves the deficiencies of existing UDA methods in handling cross - scene classification of hyperspectral images, especially improving on the domain differences in the spectral dimension. Experimental results show that S4DL outperforms existing UDA methods on multiple cross - scene HSI datasets, verifying its effectiveness and superiority.

S4DL: Shift-sensitive Spatial-Spectral Disentangling Learning for Hyperspectral Image Unsupervised Domain Adaptation

Dictionary Learning-Based Feature-Level Domain Adaptation for Cross-Scene Hyperspectral Image Classification

Supervised Contrastive Learning-Based Unsupervised Domain Adaptation for Hyperspectral Image Classification

Adaptive Domain-Adversarial Few-Shot Learning for Cross-Domain Hyperspectral Image Classification

Confident Learning-Based Domain Adaptation for Hyperspectral Image Classification

Mind the Gap: Multilevel Unsupervised Domain Adaptation for Cross-Scene Hyperspectral Image Classification

Cross-Domain Few-Shot Learning Based on Feature Disentanglement for Hyperspectral Image Classification

S&GDA: An Unsupervised Domain Adaptive Semantic Segmentation Framework Considering Both Imaging Scene and Geometric Domain Shifts

A Structure-aware Framework of Unsupervised Cross-Modality Domain Adaptation via Frequency and Spatial Knowledge Distillation

HyUniDA: Breaking Label Set Constraints for Universal Domain Adaptation in Cross-Scene Hyperspectral Image Classification

Semi Supervised Heterogeneous Domain Adaptation via Disentanglement and Pseudo-Labelling

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images

Dual-Branch Domain Adaptation Few-Shot Learning for Hyperspectral Image Classification

Interdomain Collaboration Between Hyperspectral and VHR Remote Sensing Images: A Cross-Scene Few-Shot Learning Framework for Change Detection

Unsupervised Domain Adaptation for Cross-Scene Multispectral Point Cloud Classification

Adaptive Local Discriminant Analysis and Distribution Matching for Domain Adaptation in Hyperspectral Image Classification

Locality Robust Domain Adaptation for cross-scene hyperspectral image classification

Adversarial Domain Alignment With Contrastive Learning for Hyperspectral Image Classification

Universal Domain Adaptation for Hyperspectral Image Classification

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

Graph-Based Domain Adaptation Few-Shot Learning for Hyperspectral Image Classification