Abstract:Hyperspectral remote sensing can realize the simultaneous acquisition of spectral data and spatial images for the observation scene to satisfy the detection requirements for the composition and morphology of the target object,which is widely used in the fields of precision agriculture,geological survey,environmental monitoring,biology,and medicine.In recent years,benefiting from the powerful representation capabilities of spectral-spatial information,the HyperSpectral Image(HIS)classification methods based on convolutional neural networks have demonstrated superior classification performances to traditional methods.However,the convolutional operation,performed within fixed square windows following certain rules,encounters difficulties in adapting spectral-spatial feature extraction for different objects and spatial distributions and introduces irrelevant information from other categories,leading to information diffusion between different categories and misclassification of edge pixels.This paper proposes a hyperspectral image classification method based on multidirectional adaptive awareness to address this problem.This method integrates the spatial contextual information of different neighborhood ranges to improve the local spectral-spatial modeling capability of the model.First,the full-window filter of the regular convolution is split into side-window filters with different orientations to design the Side-Window Convolution(SWC)acquiring the directional spectral-spatial features.Therefore,multiple side-window filter kernels of different directions are integrated into a unified convolution architecture to construct the spectral-spatial separable multidirectional convolution(S3MDC).The direction-adaptive aware module(DAAM)is designed to assist S3MDC and build a multidirectional adaptive aware network(MDAAN)with dense connections for HIS classification.MDAAN can adaptively learn multidirectional spatial-spectral features,improve the representation of complex spectral-spatial structures,and compensate for the deficiency that SWC only captures spectral-spatial relationships in a single direction.Experiments were conducted on three public datasets,including Indian Pines,University of Pavia,and Kennedy Space Center.MDAAN achieves the overall highest classification accuracy of 97.67％(Indian pines,5％/class),99.40％(University of Pavia,1％/class),and 99.64％(Kennedy Space Center,5％/class),which is superior to other deep learning methods,verifying the effectiveness of the proposed model.First,compared with other deep learning methods,MDAAN can provide better classification performance.Second,MDAAN generalizes better with the small number of training samples to prove the stability of its classification performance.Finally,the ablation analysis of different convolutional models and DAAM demonstrates the effectiveness and necessity of S3MDC and the adaptive aware mechanisms for multidirectional features.

Hyperspectral Classification of Hazardous Materials Based on Deep Learning

Single Spectral Imagery and Faster R-CNN to Identify Hazardous and Noxious Substances Spills.

Stand-off hazardous materials identification based on near-infrared hyperspectral imaging combined with convolutional neural network

Enhancing substance identification by Raman spectroscopy using deep neural convolutional networks with an attention mechanism

On-site Visualized Classification of Transparent Hazards and Noxious Substances on a Water Surface by Multispectral Techniques.

Classification of Hyperspectral Images of Explosive Fragments Based on Spatial–Spectral Combination

Classification Based On Deep Convolutional Neural Networks With Hyperspectral Image

Deep Convolutional Neural Networks for Hyperspectral Image Classification

A Deep Stochastic Adaptive Fourier Decomposition Network for Hyperspectral Image Classification

Convolutional Neural Network Based Classification for Hyperspectral Data

Field Determination of Hazardous Chemicals in Public Security by Using a Hand-Held Raman Spectrometer and a Deep Architecture-Search Network.

Hyperspectral Image Classification Based on Residual Dense and Dilated Convolution

Dynamic Wide and Deep Neural Network for Hyperspectral Image Classification

Hyperspectral Remote Sensing Image Classification Based on Multidirectional Adaptive Aware Network

Research on Lightweight Disaster Classification Based on High-Resolution Remote Sensing Images

Active Deep Densely Connected Convolutional Network for Hyperspectral Image Classification

A 3D-2D Convolutional Neural Network and Transfer Learning for Hyperspectral Image Classification

Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification.

Transfer Learning-Based Hyperspectral Image Classification Using Residual Dense Connection Networks

A Deep Learning Approach for Pixel-level Material Classification via Hyperspectral Imaging

Deep Learning-Based Classification of Hyperspectral Data