Abstract:Recently there is a rising trend of employing convolutional neural network (CNN) for modeling the complex high-dimensional hyperspectral images in object-scale analysis. Compared with 1D CNN and 2D CNN for merely extracting spectral or spatial features, the 3D CNN naturally offers a more effective method for simultaneously extracting the integrated deep spectral-spatial features. Due to the convolution characteristics of operating within a local receptive field, computer vision studies had incorporated the attention mechanism into 2D CNN to exploit the relationship between features for adaptive feature refinement. No exploration has been reported on incorporating the attention mechanism into 3D CNN for model development of hyperspectral image in object-scale analysis. In this study, we investigated an improved 3D CNN architecture with attention modules embedded for adaptive feature refinement in object-scale hyperspectral image modeling. Besides the adapted channel attention, the band attention module was specially designed to learn the band-wise relationship. Based on the 3D ResNet architecture, various modifications on the arrangement and structure of channel and band attention modules were explored systematically for higher modeling performance. An exemplar hyperspectral image dataset of basil leaves for predicting their relative chlorophyll content (RCC), was applied to evaluate the proposed model. Comprehensive comparison experiments showed performance improvement after adding attention modules into the residual block of 3D ResNet, demonstrating the effectiveness of adaptive feature refinement along channel and band dimensions through the learned attention maps. The sequential channel-band attention module achieved the highest model performance, with testing determination coefficient (R2) of 0.8998. The results indicated the effectiveness of the channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis.

Hybrid Local and Nonlocal 3-D Attentive CNN for Hyperspectral Image Super-Resolution

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network.

Channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis

Multilevel Progressive Network with Nonlocal Channel Attention for Hyperspectral Image Super-Resolution

Hyperspectral Image Spatial Super-Resolution Via 3d Full Convolutional Neural Network

Dual 1d-2d Spatial-Spectral Cnn For Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution Via Convolutional Neural Network

Deep Hybrid 2-D–3-D CNN Based on Dual Second-Order Attention with Camera Spectral Sensitivity Prior for Spectral Super-Resolution

Learning Hyperspectral Images from RGB Images Via a Coarse-to-fine CNN.

Incorporating Attention Mechanism and Graph Regularization into Cnns for Hyperspectral Image Classification

An Efficient Residual Learning Neural Network for Hyperspectral Image Superresolution

3-D Channel and Spatial Attention Based Multiscale Spatial-Spectral Residual Network for Hyperspectral Image Classification

A Hybrid Spectral Attention-Enabled Multiscale Spatial–Spectral Learning Network for Hyperspectral Image Superresolution

A Spectral Grouping and Attention-Driven Residual Dense Network for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution Based on Spatial Correlation-Regularized Unmixing Convolutional Neural Network

A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images

Super-Resolution for Hyperspectral Remote Sensing Images Based on the 3D Attention-SRGAN Network

Deep Collaborative Attention Network for Hyperspectral Image Classification by Combining 2-D CNN and 3-D CNN

Image Super-Resolution Using Hybrid Attention Mechanism

Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification