Abstract:Recently there is a rising trend of employing convolutional neural network (CNN) for modeling the complex high-dimensional hyperspectral images in object-scale analysis. Compared with 1D CNN and 2D CNN for merely extracting spectral or spatial features, the 3D CNN naturally offers a more effective method for simultaneously extracting the integrated deep spectral-spatial features. Due to the convolution characteristics of operating within a local receptive field, computer vision studies had incorporated the attention mechanism into 2D CNN to exploit the relationship between features for adaptive feature refinement. No exploration has been reported on incorporating the attention mechanism into 3D CNN for model development of hyperspectral image in object-scale analysis. In this study, we investigated an improved 3D CNN architecture with attention modules embedded for adaptive feature refinement in object-scale hyperspectral image modeling. Besides the adapted channel attention, the band attention module was specially designed to learn the band-wise relationship. Based on the 3D ResNet architecture, various modifications on the arrangement and structure of channel and band attention modules were explored systematically for higher modeling performance. An exemplar hyperspectral image dataset of basil leaves for predicting their relative chlorophyll content (RCC), was applied to evaluate the proposed model. Comprehensive comparison experiments showed performance improvement after adding attention modules into the residual block of 3D ResNet, demonstrating the effectiveness of adaptive feature refinement along channel and band dimensions through the learned attention maps. The sequential channel-band attention module achieved the highest model performance, with testing determination coefficient (R2) of 0.8998. The results indicated the effectiveness of the channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis.

3D CNN with Localized Residual Connections for Hyperspectral Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis

Multi-scale 3D-convolutional neural network for hyperspectral image classification

Land-cover classification with hyperspectral remote sensing image using CNN and spectral band selection

Hyperspectral Image Classification: Artifacts of Dimension Reduction on Hybrid CNN

Consolidated Convolutional Neural Network for Hyperspectral Image Classification

Dual-Stream Spectral-Spatial Convolutional Neural Network for Hyperspectral Image Classification and Optimal Band Selection

Three-dimensional Densely Connected Convolutional Network for Hyperspectral Remote Sensing Image Classification

HybridSN: Exploring 3D-2D CNN Feature Hierarchy for Hyperspectral Image Classification

3D Convolutional Siamese Network for Few-Shot Hyperspectral Classification

Spatial-Spectral Classification Of Hyperspectral Remote Sensing Images Using 3D Cnn Based Lenet-5 Architecture

Hybrid convolutional neural network (CNN) for Kennedy Space Center hyperspectral image

Hyperspectral image classification using 3D-2D CNN with multi-scale information extraction and fusion module

Hybrid CNN Bi-LSTM neural network for Hyperspectral image classification

Attention 3D central difference convolutional dense network for hyperspectral image classification

Integrated 1D, 2D, and 3D CNNs Enable Robust and Efficient Land Cover Classification from Hyperspectral Imagery

Attention-Aware Pseudo-3-D Convolutional Neural Network for Hyperspectral Image Classification

SpectralNET: Exploring Spatial-Spectral WaveletCNN for Hyperspectral Image Classification

A new deep convolutional neural network for fast hyperspectral image classification

Effective hyperspectral image classification based on segmented PCA and 3D-2D CNN leveraging multibranch feature fusion