Abstract:Convolutional long short-term memory (ConvLSTM) has received much attention for hyperspectral image (HSI) classification due to its ability of modeling long-range correlations, which, however, is vulnerable to too many parameters and insufficient training, limiting its classification accuracy, especially for small samples. Different from it, traditional hand-crafted methods extract the features with basic attributes of HSIs, which can provide the lack of details and interpretability of deep semantic features. However, existing methods fail to incorporate their complementarity for HSI classification. As such, a Pseudo complex-valued (CV) Deformable ConvLSTM Neural Network with mutual Attention learning (APDCLNN) is proposed, providing a new way to realize the collaborative learning of hand-crafted and deep features for HSI classification. First, a 2-D pseudo CV deformable ConvLSTM (PDConvLSTM2D) cell is designed using deformable convolution and complex operations, with which a spatial–spectral PDConvLSTM2D neural network (SSPDCL2DNN) is built to extract scale- and spectral-enhanced deep spatial–spectral features. Then, 3-D Gabor filter is used to extract hand-crafted features, and a mutual attention-based multimodality feature learning and fusion (MAMLF) module is designed to integrate them into deep features for training and optimization of SSPDCL2DNN. Finally, an attention loss subnetwork is designed to refine the classification results. As we know, this is the first attempt to apply the idea of mutual attention learning to fuse hand-crafted and deep features for HSI classification. Extensive experiments on three widely used HSI datasets show the advantages of our model over other deep methods in terms of both quantitative and visual quality.

Contrastive Mutual Learning with Pseudo-Label Smoothing for Hyperspectral Image Classification

Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification

Self-Supervised Learning with Learnable Sparse Contrastive Sampling for Hyperspectral Image Classification

Semisupervised deep learning using consistency regularization and pseudolabels for hyperspectral image classification

Hyperspectral Imagery Classification Based on Contrastive Learning

Combining Semi-Supervised and Active Learning for Hyperspectral Image Classification

HyperMLL: Toward Robust Hyperspectral Image Classification With Multisource Label Learning

HyperMLL: Toward Robust Hyperspectral Image Classification with Multi-source Label Learning

Enhancing Hyperspectral Image Prediction with Contrastive Learning in Low-Label Regime

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

Semi-Supervised Classification of Hyperspectral Images Based on Contrastive Learning Constraint

Semisupervised Hyperspectral Image Classification Via Discriminant Analysis and Robust Regression.

Enhancing Hyperspectral Image Classification: Leveraging Unsupervised Information With Guided Group Contrastive Learning

Adversarial Domain Alignment With Contrastive Learning for Hyperspectral Image Classification

Unlabeled Data Guided Partial Label Learning for Hyperspectral Image Classification

Weakly Supervised Classification of Hyperspectral Image Based on Complementary Learning.

Ternary Modality Contrastive Learning for Hyperspectral and LiDAR Data Classification

A Mutual Teaching Framework with Momentum Correction for Unsupervised Hyperspectral Image Change Detection

Pixel-Superpixel Contrastive Learning and Pseudo-Label Correction for Hyperspectral Image Clustering

Discriminative Pixel-Pairwise Constraint-Guided Extreme Learning Machine For Semi-Supervised Hyperspectral Image Classification

Pseudo Complex-Valued Deformable ConvLSTM Neural Network With Mutual Attention Learning for Hyperspectral Image Classification