Abstract:Recently there is a rising trend of employing convolutional neural network (CNN) for modeling the complex high-dimensional hyperspectral images in object-scale analysis. Compared with 1D CNN and 2D CNN for merely extracting spectral or spatial features, the 3D CNN naturally offers a more effective method for simultaneously extracting the integrated deep spectral-spatial features. Due to the convolution characteristics of operating within a local receptive field, computer vision studies had incorporated the attention mechanism into 2D CNN to exploit the relationship between features for adaptive feature refinement. No exploration has been reported on incorporating the attention mechanism into 3D CNN for model development of hyperspectral image in object-scale analysis. In this study, we investigated an improved 3D CNN architecture with attention modules embedded for adaptive feature refinement in object-scale hyperspectral image modeling. Besides the adapted channel attention, the band attention module was specially designed to learn the band-wise relationship. Based on the 3D ResNet architecture, various modifications on the arrangement and structure of channel and band attention modules were explored systematically for higher modeling performance. An exemplar hyperspectral image dataset of basil leaves for predicting their relative chlorophyll content (RCC), was applied to evaluate the proposed model. Comprehensive comparison experiments showed performance improvement after adding attention modules into the residual block of 3D ResNet, demonstrating the effectiveness of adaptive feature refinement along channel and band dimensions through the learned attention maps. The sequential channel-band attention module achieved the highest model performance, with testing determination coefficient (R2) of 0.8998. The results indicated the effectiveness of the channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis.

3D Convolutional Attention Network for Automatically Extracting Ice Layers from Ice Sheet Radar Topological Sequences

Attention Multi-Scale Network for Automatic Layer Extraction of Ice Radar Topological Sequences

Channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis

Deep Tiered Image Segmentation For Detecting Internal Ice Layers in Radar Imagery

A Novel Deep Learning-Based Approach for Rift and Iceberg Recognition From ICESat-2 Data

Arctic Sea Ice Concentration Prediction Using Spatial Attention Deep Learning

IA-Net$:$ An Inception–Attention-Module-Based Network for Classifying Underwater Images From Others

DF-UHRNet: A Modified CNN-Based Deep Learning Method for Automatic Sea Ice Classification from Sentinel-1A/B SAR Images

Infrared Precipitation Estimation Using Convolutional Neural Network

A Multi-scale Dual Attention Network for the Automatic Classification of Polar Sea Ice and Open Water Based on Sentinel-1 SAR Images

The detection of Arctic sea ice linear kinematic features using LadderNet

A Novel ICESat-2 Signal Photon Extraction Method Based on Convolutional Neural Network

IceGCN: An Interactive Sea Ice Classification Pipeline for SAR Imagery Based on Graph Convolutional Network

IceDCST: A Dilated Convolutional Segmentation Transformer for Ice Crystals

Towards automated identification of ice features for surface vessels using deep learning

MT-IceNet -- A Spatial and Multi-Temporal Deep Learning Model for Arctic Sea Ice Forecasting

Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network

The Identification of Ice Floes and Calculation of Sea Ice Concentration Based on a Deep Learning Method

Multi-branch Spatio-Temporal Graph Neural Network For Efficient Ice Layer Thickness Prediction

Dense Nested Attention Network for Infrared Small Target Detection

A CNN Based on Multiple Attention Mechanisms for InSAR Phase Denoising