Abstract:Recently, convolutional neural networks (CNNs) have been widely used in hyperspectral image (HSI) classification with appreciable performance. However, the current CNN-based HSI classification methods have limitations in exploiting the multiscale features and extracting sufficiently discriminative features, and usually, adopted dimensionality reduction method such as principal component analysis (PCA) leads to some or all of the physical information of the original band may be lost. To address the above problems, in this letter, we propose an adaptive multiscale feature attention network (AMFAN) for HSI classification. First, we use a band selection algorithm to perform data dimensionality reduction, which helps maintain the original characteristics of the image. Second, different from existing multiscale feature extraction methods that give features of different scales the same degree of importance, we propose an adaptive multiscale feature residual module (AMFRM) to give multiscale features different importance. Finally, due to the input of the HSI classification model based on deep learning (DL) being the patch cube, the only available initial information is the category of the center pixel. However, the patch often contains pixels different from the center pixel category, and existing attention mechanisms do not consider the impact of such pixels on the HSI classification, so we design a novel position attention module (PAM) to calculate the similarity between the center (target) pixel and surrounding pixels and then pay more attention to the pixels with high similarity to the center pixel. Besides, we also use a spectral attention module (SAM) to obtain more discriminative spectral features. Experimental results show that the proposed AMFAN effectively improves the classification accuracy and outperforms the state-of-the-art CNNs.

Simplified Nonlocal Network Based on Adaptive Projection Attention Method for Hyperspectral Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Hybrid 2D–3D convolution and pre-activated residual networks for hyperspectral image classification

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

Spatial–Spectral Feature Refinement for Hyperspectral Image Classification Based on Attention-Dense 3D-2D-CNN

AMFAN: Adaptive Multiscale Feature Attention Network for Hyperspectral Image Classification

Global and pyramid convolutional neural network with hybrid attention mechanism for hyperspectral image classification

Consolidated Convolutional Neural Network for Hyperspectral Image Classification

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

Local-Global Gated Convolutional Neural Network for Hyperspectral Image Classification

Subpixel Multilevel Scale Feature Learning and Adaptive Attention Constraint Fusion for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

Heterogeneous Spectral-Spatial Network with 3D Attention and MLP for Hyperspectral Image Classification Using Limited Training Samples

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

Hyperspectral image classification based on local feature decoupling and hybrid attention SpectralFormer network

Hybrid Dense Network With Attention Mechanism for Hyperspectral Image Classification

Integrating Hybrid Pyramid Feature Fusion and Coordinate Attention for Effective Small Sample Hyperspectral Image Classification

Hyperspectral image classification based on spectral and spatial information using ResNet with channel attention

Cnn-assisted multi-hop graph attention network for hyperspectral image classification