Abstract:Recently, convolutional neural networks (CNNs) have been widely used in hyperspectral image (HSI) classification with appreciable performance. However, the current CNN-based HSI classification methods have limitations in exploiting the multiscale features and extracting sufficiently discriminative features, and usually, adopted dimensionality reduction method such as principal component analysis (PCA) leads to some or all of the physical information of the original band may be lost. To address the above problems, in this letter, we propose an adaptive multiscale feature attention network (AMFAN) for HSI classification. First, we use a band selection algorithm to perform data dimensionality reduction, which helps maintain the original characteristics of the image. Second, different from existing multiscale feature extraction methods that give features of different scales the same degree of importance, we propose an adaptive multiscale feature residual module (AMFRM) to give multiscale features different importance. Finally, due to the input of the HSI classification model based on deep learning (DL) being the patch cube, the only available initial information is the category of the center pixel. However, the patch often contains pixels different from the center pixel category, and existing attention mechanisms do not consider the impact of such pixels on the HSI classification, so we design a novel position attention module (PAM) to calculate the similarity between the center (target) pixel and surrounding pixels and then pay more attention to the pixels with high similarity to the center pixel. Besides, we also use a spectral attention module (SAM) to obtain more discriminative spectral features. Experimental results show that the proposed AMFAN effectively improves the classification accuracy and outperforms the state-of-the-art CNNs.

Attention Network With Fractional-Ordered Mixed Geometric Features for Hyperspectral Image Classification

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

A Unified Attention Paradigm for Hyperspectral Image Classification

Spectral-Spatial-Sensorial Attention Network with Controllable Factors for Hyperspectral Image Classification

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

AMFAN: Adaptive Multiscale Feature Attention Network for Hyperspectral Image Classification

Center-similarity spectral-spatial attention network for hyperspectral image classification

Hyperspectral Image Classification via Deep Network with Attention Mechanism and Multigroup Strategy

A 3D Cascaded Spectral–Spatial Element Attention Network for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Hyperspectral Image Classification Based on 3-D Octave Convolution With Spatial–Spectral Attention Network

Hyperspectral Image Classification Based on Dual-Scale Dense Network with Efficient Channel Attentional Feature Fusion

Spatial Feature Enhancement and Attention-Guided Bidirectional Sequential Spectral Feature Extraction for Hyperspectral Image Classification

S3AM++: Integrating Differential Strategy into Spectral-Similarity-Based Spatial Attention Module for Hyperspectral Remote Sensing Image Classification

Centralized Attention Modules for Hyperspectral Remote Sensing Image Classification

Spatial–Spectral Feature Refinement for Hyperspectral Image Classification Based on Attention-Dense 3D-2D-CNN