Abstract:Recently, convolutional neural networks (CNNs) have been widely used in hyperspectral image (HSI) classification with appreciable performance. However, the current CNN-based HSI classification methods have limitations in exploiting the multiscale features and extracting sufficiently discriminative features, and usually, adopted dimensionality reduction method such as principal component analysis (PCA) leads to some or all of the physical information of the original band may be lost. To address the above problems, in this letter, we propose an adaptive multiscale feature attention network (AMFAN) for HSI classification. First, we use a band selection algorithm to perform data dimensionality reduction, which helps maintain the original characteristics of the image. Second, different from existing multiscale feature extraction methods that give features of different scales the same degree of importance, we propose an adaptive multiscale feature residual module (AMFRM) to give multiscale features different importance. Finally, due to the input of the HSI classification model based on deep learning (DL) being the patch cube, the only available initial information is the category of the center pixel. However, the patch often contains pixels different from the center pixel category, and existing attention mechanisms do not consider the impact of such pixels on the HSI classification, so we design a novel position attention module (PAM) to calculate the similarity between the center (target) pixel and surrounding pixels and then pay more attention to the pixels with high similarity to the center pixel. Besides, we also use a spectral attention module (SAM) to obtain more discriminative spectral features. Experimental results show that the proposed AMFAN effectively improves the classification accuracy and outperforms the state-of-the-art CNNs.

Hyperspectral Image Classification With Multiattention Fusion Network

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Hyperspectral Image Classification Based on Double-hop Graph Attention Multi-view Fusion Network

A Feature Embedding Network with Multiscale Attention for Hyperspectral Image Classification

Feature Fusion Network Model Based on Dual Attention Mechanism for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Multiscale Feature Fusion Network Incorporating 3D Self-Attention for Hyperspectral Image Classification

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Hyperspectral Image Classification Based on Multiscale Spatial and Spectral Feature Network.

AMFAN: Adaptive Multiscale Feature Attention Network for Hyperspectral Image Classification

Attention-based Multi-Scale Network for Hyperspectral Image Classification

A Multi-scale Network Based on Attention Mechanism for Hyperspectral Image Classification

Hyperspectral Image Classification Via Multi-Scale Multi-Angle Attention Network

Hyperspectral Image Classification Based on Dual-Scale Dense Network with Efficient Channel Attentional Feature Fusion

Deep Multilayer Fusion Dense Network for Hyperspectral Image Classification

Multi-attentive Hierarchical Dense Fusion Net for Fusion Classification of Hyperspectral and LiDAR Data

DMAF-NET: Deep Multi-Scale Attention Fusion Network for Hyperspectral Image Classification with Limited Samples

Hyperspectral Image Classification Using Multi-Branch-multi-scale Residual Fusion Network

Hyperspectral and Multi-source Heterogeneous Data Fusion Classification Based on Multiscale Multi-source Interaction Attention Network

Joint Classification of Hyperspectral and LiDAR Data Based on Heterogeneous Attention Feature Fusion Network