Abstract:Recently, convolutional neural networks (CNNs) have been widely used in hyperspectral image (HSI) classification with appreciable performance. However, the current CNN-based HSI classification methods have limitations in exploiting the multiscale features and extracting sufficiently discriminative features, and usually, adopted dimensionality reduction method such as principal component analysis (PCA) leads to some or all of the physical information of the original band may be lost. To address the above problems, in this letter, we propose an adaptive multiscale feature attention network (AMFAN) for HSI classification. First, we use a band selection algorithm to perform data dimensionality reduction, which helps maintain the original characteristics of the image. Second, different from existing multiscale feature extraction methods that give features of different scales the same degree of importance, we propose an adaptive multiscale feature residual module (AMFRM) to give multiscale features different importance. Finally, due to the input of the HSI classification model based on deep learning (DL) being the patch cube, the only available initial information is the category of the center pixel. However, the patch often contains pixels different from the center pixel category, and existing attention mechanisms do not consider the impact of such pixels on the HSI classification, so we design a novel position attention module (PAM) to calculate the similarity between the center (target) pixel and surrounding pixels and then pay more attention to the pixels with high similarity to the center pixel. Besides, we also use a spectral attention module (SAM) to obtain more discriminative spectral features. Experimental results show that the proposed AMFAN effectively improves the classification accuracy and outperforms the state-of-the-art CNNs.

Attention-based Multi-Scale Network for Hyperspectral Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

A Multi-scale Network Based on Attention Mechanism for Hyperspectral Image Classification

Multiscale Densely Connected Attention Network for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Multibranch 3D-Dense Attention Network for Hyperspectral Image Classification

MS3Net: Multiscale Stratified-Split Symmetric Network with Quadra-View Attention for Hyperspectral Image Classification

Multi-Scale Spatial–Spectral Residual Attention Network for Hyperspectral Image Classification

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

Hyperspectral Image Classification Via Multi-Scale Multi-Angle Attention Network

Hyperspectral Image Classification Based on Multiscale Spatial and Spectral Feature Network.

Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search

Hyperspectral Image Classification based on Multi-Scale Convolutional Features and Multi-Attention Mechanisms

Compound Multiscale Weak Dense Network with Hybrid Attention for Hyperspectral Image Classification

Multiscale Feature Fusion Network Incorporating 3D Self-Attention for Hyperspectral Image Classification

A Cross-Channel Dense Connection and Multi-Scale Dual Aggregated Attention Network for Hyperspectral Image Classification

AMFAN: Adaptive Multiscale Feature Attention Network for Hyperspectral Image Classification

Multi-Direction Networks with Attentional Spectral Prior for Hyperspectral Image Classification.

Multiscale Densely-Connected Fusion Networks for Hyperspectral Images Classification

A Novel Classification Framework for Hyperspectral Image Classification Based on Multi-Scale Dense Network