Abstract:In the last five years, deep learning has been introduced to tackle the hyperspectral image (HSI) classification and demonstrated good performance. In particular, the convolutional neural network (CNN)-based methods for HSI classification have made great progress. However, due to the high dimensionality of HSI and equal treatment of all bands, the performance of these methods is hampered by learning features from useless bands for classification. Moreover, for patchwise-based CNN models, equal treatment of spatial information from the pixel-centered neighborhood also hinders the performance of these methods. In this article, we propose an end-to-end residual spectral-spatial attention network (RSSAN) for HSI classification. The RSSAN takes raw 3-D cubes as input data without additional feature engineering. First, a spectral attention module is designed for spectral band selection from raw input data by emphasizing useful bands for classification and suppressing useless bands. Then, a spatial attention module is designed for the adaptive selection of spatial information by emphasizing pixels from the same class as the center pixel or those are useful for classification in the pixel-centered neighborhood and suppressing those from a different class or useless. Second, two attention modules are also used in the following CNN for adaptive feature refinement in spectral-spatial feature learning. Third, a sequential spectral-spatial attention module is embedded into a residual block to avoid overfitting and accelerate the training of the proposed model. Experimental studies demonstrate that the RSSAN achieved superior classification accuracy compared with the state of the art on three HSI data sets: Indian Pines (IN), University of Pavia (UP), and Kennedy Space Center (KSC).

Multi-Scale Spatial–Spectral Residual Attention Network for Hyperspectral Image Classification

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Attention-based Multi-Scale Network for Hyperspectral Image Classification

3-D Channel and Spatial Attention Based Multiscale Spatial-Spectral Residual Network for Hyperspectral Image Classification

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

A Multi-scale Network Based on Attention Mechanism for Hyperspectral Image Classification

Multiscale Densely Connected Attention Network for Hyperspectral Image Classification

MSLAN: A Two-Branch Multidirectional Spectral–Spatial LSTM Attention Network for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

MSRA-G: Combination of Multi-Scale Residual Attention Network and Generative Adversarial Networks for Hyperspectral Image Classification

SPECTRAL-SPATIAL MULTISCALE RESIDUAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION

Multiple Spectral Resolution 3D Convolutional Neural Network for Hyperspectral Image Classification

Spectral Super-Resolution of Multispectral Images Using Spatial–Spectral Residual Attention Network

Hyperspectral Image Classification Based on Multiscale Cross-Branch Response and Second-Order Channel Attention

Spatial Attention Guided Residual Attention Network for Hyperspectral Image Classification

MS3Net: Multiscale Stratified-Split Symmetric Network with Quadra-View Attention for Hyperspectral Image Classification

Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search

The Classification of Hyperspectral Images: A Double-Branch Multi-Scale Residual Network