Abstract:Recently, convolutional neural networks (CNNs) have been widely used in hyperspectral image (HSI) classification with appreciable performance. However, the current CNN-based HSI classification methods have limitations in exploiting the multiscale features and extracting sufficiently discriminative features, and usually, adopted dimensionality reduction method such as principal component analysis (PCA) leads to some or all of the physical information of the original band may be lost. To address the above problems, in this letter, we propose an adaptive multiscale feature attention network (AMFAN) for HSI classification. First, we use a band selection algorithm to perform data dimensionality reduction, which helps maintain the original characteristics of the image. Second, different from existing multiscale feature extraction methods that give features of different scales the same degree of importance, we propose an adaptive multiscale feature residual module (AMFRM) to give multiscale features different importance. Finally, due to the input of the HSI classification model based on deep learning (DL) being the patch cube, the only available initial information is the category of the center pixel. However, the patch often contains pixels different from the center pixel category, and existing attention mechanisms do not consider the impact of such pixels on the HSI classification, so we design a novel position attention module (PAM) to calculate the similarity between the center (target) pixel and surrounding pixels and then pay more attention to the pixels with high similarity to the center pixel. Besides, we also use a spectral attention module (SAM) to obtain more discriminative spectral features. Experimental results show that the proposed AMFAN effectively improves the classification accuracy and outperforms the state-of-the-art CNNs.

An Attention Based Lightweight Network for Hyperspectral Images Classification

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

ALPN: Active-Learning-Based Prototypical Network for Few-Shot Hyperspectral Imagery Classification

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

Cross-domain attention network for hyperspectral image classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Lightweight Tensor Attention-Driven ConvLSTM Neural Network for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

Hyperspectral Image Classification via Deep Network with Attention Mechanism and Multigroup Strategy

Spectral-Spatial-Sensorial Attention Network with Controllable Factors for Hyperspectral Image Classification

Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network

Center-similarity spectral-spatial attention network for hyperspectral image classification

Hybrid Dense Network With Attention Mechanism for Hyperspectral Image Classification

Spatial Proximity Feature Selection With Residual Spatial-Spectral Attention Network for Hyperspectral Image Classification.

A Cross-Channel Dense Connection and Multi-Scale Dual Aggregated Attention Network for Hyperspectral Image Classification

Objective evaluation-based efficient learning framework for hyperspectral image classification

Ultralightweight Feature-Compressed Multihead Self-Attention Learning Networks for Hyperspectral Image Classification

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

H2AN: Hierarchical Homogeneity-Attention Network for Hyperspectral Image Classification

AMFAN: Adaptive Multiscale Feature Attention Network for Hyperspectral Image Classification