Abstract:In the last five years, deep learning has been introduced to tackle the hyperspectral image (HSI) classification and demonstrated good performance. In particular, the convolutional neural network (CNN)-based methods for HSI classification have made great progress. However, due to the high dimensionality of HSI and equal treatment of all bands, the performance of these methods is hampered by learning features from useless bands for classification. Moreover, for patchwise-based CNN models, equal treatment of spatial information from the pixel-centered neighborhood also hinders the performance of these methods. In this article, we propose an end-to-end residual spectral-spatial attention network (RSSAN) for HSI classification. The RSSAN takes raw 3-D cubes as input data without additional feature engineering. First, a spectral attention module is designed for spectral band selection from raw input data by emphasizing useful bands for classification and suppressing useless bands. Then, a spatial attention module is designed for the adaptive selection of spatial information by emphasizing pixels from the same class as the center pixel or those are useful for classification in the pixel-centered neighborhood and suppressing those from a different class or useless. Second, two attention modules are also used in the following CNN for adaptive feature refinement in spectral-spatial feature learning. Third, a sequential spectral-spatial attention module is embedded into a residual block to avoid overfitting and accelerate the training of the proposed model. Experimental studies demonstrate that the RSSAN achieved superior classification accuracy compared with the state of the art on three HSI data sets: Indian Pines (IN), University of Pavia (UP), and Kennedy Space Center (KSC).

Visual Attention-Driven Hyperspectral Image Classification

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Parameter-Free Attention Network for Spectral–Spatial Hyperspectral Image Classification

AAtt-CNN: Automatic Attention-Based Convolutional Neural Networks for Hyperspectral Image Classification

A Spatial-Spectral-Temporal Attention Method for Hyperspectral Image Change Detection.

Spectral-Spatial Attention Networks For Hyperspectral Image Classification

Hierarchical Attention Networks for Hyperspectral Image Classification

Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification

AI-NET: Attention Inception Neural Networks for Hyperspectral Image Classification

Spatial Attention Guided Residual Attention Network for Hyperspectral Image Classification

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

Hyperspectral Image Classification Based on 3D Calibrated Attention

3-D Channel and Spatial Attention Based Multiscale Spatial-Spectral Residual Network for Hyperspectral Image Classification

A Unified Attention Paradigm for Hyperspectral Image Classification

Spectral-spatial Inverted Residual Attention Network for Hyperspectral Image Classification with Pre-Activation

A Multi-scale Network Based on Attention Mechanism for Hyperspectral Image Classification

Spectral-Spatial-Sensorial Attention Network with Controllable Factors for Hyperspectral Image Classification