Abstract:A big challenge of hyperspectral image (HSI) classification is the small size of labeled pixels for training classifier. In real remote sensing applications, we always face the situation that an HSI scene is not labeled at all, or is with very limited number of labeled pixels, but we have sufficient labeled pixels in another HSI scene with the similar land cover classes. In this paper, we try to classify an HSI scene containing no labeled sample or only a few labeled samples with the help of a similar HSI scene having a relative large size of labeled samples. The former scene is defined as the target scene, while the latter one is the source scene. We name this classification problem as cross-scene classification. The main challenge of cross-scene classification is spectral shift, i.e., even for the same class in different scenes, their spectral distributions maybe have significant deviation. As all or most training samples are drawn from the source scene, while the prediction is performed in the target scene, the difference in spectral distribution would greatly deteriorate the classification performance. To solve this problem, we propose a dictionary learning-based feature-level domain adaptation technique, which aligns the spectral distributions between source and target scenes by projecting their spectral features into a shared low-dimensional embedding space by multitask dictionary learning. The basis atoms in the learned dictionary represent the common spectral components, which span a cross-scene feature space to minimize the effect of spectral shift. After the HSIs of two scenes are transformed into the shared space, any traditional HSI classification approach can be used. In this paper, sparse logistic regression (SRL) is selected as the classifier. Especially, if there are a few labeled pixels in the target domain, multitask SRL is used to further promote the classification performance. The experimental results on synthetic and real HSIs show the advantages of the proposed method for cross-scene classification.

Discriminative Vision Transformer for Heterogeneous Cross-Domain Hyperspectral Image Classification

Cross-Domain Hyperspectral Image Classification Based on Transformer

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

Deep Hierarchical Vision Transformer for Hyperspectral and LiDAR Data Classification

Dictionary Learning-Based Feature-Level Domain Adaptation for Cross-Scene Hyperspectral Image Classification

Domain‐invariant Attention Network for Transfer Learning Between Cross‐scene Hyperspectral Images

Hybrid Conv-ViT Network for Hyperspectral Image Classification

Investigation of Hierarchical Spectral Vision Transformer Architecture for Classification of Hyperspectral Imagery

3D-Convolution Guided Spectral-Spatial Transformer for Hyperspectral Image Classification

Hyperspectral Image Classification Using Groupwise Separable Convolutional Vision Transformer Network

Expeditious Hyperspectral Image Classification With Inner and Outer Layered Transformer Using Feature Enhancement

Multiview Transformer: Rethinking Spatial Information in Hyperspectral Image Classification

Hierarchical Attention Transformer for Hyperspectral Image Classification

Spectral–Spatial Feature Extraction for Hyperspectral Image Classification Using Enhanced Transformer with Large-Kernel Attention

Hyperspectral Image Transformer Classification Networks

CS2DT: Cross Spatial–Spectral Dense Transformer for Hyperspectral Image Classification

Spectral-Swin Transformer with Spatial Feature Extraction Enhancement for Hyperspectral Image Classification

Cascaded Convolution-Based Transformer With Densely Connected Mechanism for Spectral–Spatial Hyperspectral Image Classification

A Center-Masked Transformer for Hyperspectral Image Classification

Multimodal Fusion Transformer for Remote Sensing Image Classification