Abstract:Deep learning (DL) based methods represented by convolutional neural networks (CNNs) are widely used in hyperspectral image classification (HSIC). Some of these methods have strong ability to extract local information, but the extraction of long-range features is slightly inefficient, while others are just the opposite. For example, limited by the receptive fields, CNN is difficult to capture the contextual spectral-spatial features from a long-range spectral-spatial relationship. Besides, the success of DL-based methods is greatly attributed to numerous labeled samples, whose acquisition are time-consuming and cost-consuming. To resolve these problems, a hyperspectral classification framework based on multi-attention Transformer (MAT) and adaptive superpixel segmentation-based active learning (MAT-ASSAL) is proposed, which successfully achieves excellent classification performance, especially under the condition of small-size samples. Firstly, a multi-attention Transformer network is built for HSIC. Specifically, the self-attention module of Transformer is applied to model long-range contextual dependency between spectral-spatial embedding. Moreover, in order to capture local features, an outlook-attention module which can efficiently encode fine-level features and contexts into tokens is utilized to improve the correlation between the center spectral-spatial embedding and its surroundings. Secondly, aiming to train a excellent MAT model through limited labeled samples, a novel active learning (AL) based on superpixel segmentation is proposed to select important samples for MAT. Finally, to better integrate local spatial similarity into active learning, an adaptive superpixel (SP) segmentation algorithm, which can save SPs in uninformative regions and preserve edge details in complex regions, is employed to generate better local spatial constraints for AL. Quantitative and qualitative results indicate that the MAT-ASSAL outperforms seven state-of-the-art methods on three HSI datasets.

Few-Shot Open-Set Hyperspectral Image Classification with Adaptive Threshold Using Self-Supervised Multi-Task Learning

Few-Shot Open-Set Collaborative Classification of Multispectral and Hyperspectral Images with Adaptive Joint Similarity Metric

Generative Adversarial Network and Mutual-Point Learning Algorithm for Few-Shot Open-Set Classification of Hyperspectral Images

Few-Shot Hyperspectral Image Classification Based on Adaptive Subspaces and Feature Transformation

Few‐shot real scenes convolutional anchor clustering twin network for hyperspectral image classification

Heterogeneous Few-Shot Learning for Hyperspectral Image Classification

Self-Attention and Mutual-Attention for Few-Shot Hyperspectral Image Classification.

Hyperspectral Image Super-Resolution Classification With A Small Training Set Using Spectral Variation Extended Endmember Library

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

Spectral-Spatial Latent Reconstruction for Open-Set Hyperspectral Image Classification

Graph-Based Deep Multitask Few-Shot Learning for Hyperspectral Image Classification

Enhancing Semi-Supervised Few-Shot Hyperspectral Image Classification via Progressive Sample Selection

Self-Supervised Learning With Multiscale Densely Connected Network for Hyperspectral Image Classification

Hyperspectral Image Classification With Multi-Attention Transformer and Adaptive Superpixel Segmentation-Based Active Learning

A Hybrid Multitask Learning Network for Hyperspectral Image Classification With Few Labels

Multi-scale Attention-Based Few-Shot Hyperspectral Images Classification

Multistage Relation Network with Dual-Metric for Few-Shot Hyperspectral Image Classification

Cross-Domain Few-Shot Hyperspectral Image Classification With Cross-Modal Alignment and Supervised Contrastive Learning

Cross-Domain Self-Taught Network for Few-Shot Hyperspectral Image Classification

Spatial-Spectral-Semantic Cross-Domain Few-Shot Learning for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Multiscale Spatial and Spectral Feature Network.