Effective band selection of hyperspectral image by an attention mechanism-based convolutional network

Zengwei Zheng,Yi Liu,Mengzhu He,Dan Chen,Lin Sun,Fengle Zhu

DOI: https://doi.org/10.1039/d1ra07662k

IF: 4.036

2022-01-01

RSC Advances

Abstract:An attention mechanism-based 3D-CNN network was proposed to select the effective bands of hyperspectral images while carrying out the model training.

chemistry, multidisciplinary

What problem does this paper attempt to address?

Channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis

Fengle Zhu,Jianping Cai,Mengzhu He,Xiaoli Li

DOI: https://doi.org/10.1016/j.chemolab.2022.104537

IF: 4.175

2022-01-01

Chemometrics and Intelligent Laboratory Systems

Abstract:Recently there is a rising trend of employing convolutional neural network (CNN) for modeling the complex high-dimensional hyperspectral images in object-scale analysis. Compared with 1D CNN and 2D CNN for merely extracting spectral or spatial features, the 3D CNN naturally offers a more effective method for simultaneously extracting the integrated deep spectral-spatial features. Due to the convolution characteristics of operating within a local receptive field, computer vision studies had incorporated the attention mechanism into 2D CNN to exploit the relationship between features for adaptive feature refinement. No exploration has been reported on incorporating the attention mechanism into 3D CNN for model development of hyperspectral image in object-scale analysis. In this study, we investigated an improved 3D CNN architecture with attention modules embedded for adaptive feature refinement in object-scale hyperspectral image modeling. Besides the adapted channel attention, the band attention module was specially designed to learn the band-wise relationship. Based on the 3D ResNet architecture, various modifications on the arrangement and structure of channel and band attention modules were explored systematically for higher modeling performance. An exemplar hyperspectral image dataset of basil leaves for predicting their relative chlorophyll content (RCC), was applied to evaluate the proposed model. Comprehensive comparison experiments showed performance improvement after adding attention modules into the residual block of 3D ResNet, demonstrating the effectiveness of adaptive feature refinement along channel and band dimensions through the learned attention maps. The sequential channel-band attention module achieved the highest model performance, with testing determination coefficient (R2) of 0.8998. The results indicated the effectiveness of the channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis.
A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Mingtian Li,Yu Lu,Shixian Cao,Xinyu Wang,Shanjuan Xie

DOI: https://doi.org/10.3390/s23063190

2023-01-01

Abstract:Recently, convolution neural networks have been widely used in hyperspectral image classification and have achieved excellent performance. However, the fixed convolution kernel receptive field often leads to incomplete feature extraction, and the high redundancy of spectral information leads to difficulties in spectral feature extraction. To solve these problems, we propose a nonlocal attention mechanism of a 2D-3D hybrid CNN (2-3D-NL CNN), which includes an inception block and a nonlocal attention module. The inception block uses convolution kernels of different sizes to equip the network with multiscale receptive fields to extract the multiscale spatial features of ground objects. The nonlocal attention module enables the network to obtain a more comprehensive receptive field in the spatial and spectral dimensions while suppressing the information redundancy of the spectral dimension, making the extraction of spectral features easier. Experiments on two hyperspectral datasets, Pavia University and Salians, validate the effectiveness of the inception block and the nonlocal attention module. The results show that our model achieves an overall classification accuracy of 99.81% and 99.42% on the two datasets, respectively, which is higher than the accuracy of the existing model.
An Unsupervised Band Selection Method Based on Triple Constraints and Attention Network for Hyperspectral Imagery

Yufei Liu,Xiaorun Li

DOI: https://doi.org/10.1109/igarss52108.2023.10282978

2023-01-01

Abstract:The large number of bands contained in hyperspectral images (HSIs) can provide a wealth of information on regions of interest but also causes the "curse of dimensionality" and information redundancy. To address this issue, this paper proposes a novel band selection method based on triple constraints and attention network (TCANet-BS) for HSIs. The proposed TCANet-BS can make good use of band representativeness, band informativeness, and inter-band correlation when selecting bands. Specifically, TCANet-BS calculates band representativeness by taking advantage of the attention reconstruction network. Moreover, TCANet-BS obtains band informativeness and inter-band correlation through spectral information divergence and orthogonal subspace projection technique, respectively. Experimental results on the real-world hyperspectral dataset show that TCANet-BS can effectively improve classification accuracy compared with other advanced band selection methods.
Band Selection from Hyperspectral Images Using Attention-based Convolutional Neural Networks

Pablo Ribalta Lorenzo,Lukasz Tulczyjew,Michal Marcinkiewicz,Jakub Nalepa

DOI: https://doi.org/10.48550/arXiv.1811.02667

2020-01-09

Abstract:This paper introduces new attention-based convolutional neural networks for selecting bands from hyperspectral images. The proposed approach re-uses convolutional activations at different depths, identifying the most informative regions of the spectrum with the help of gating mechanisms. Our attention techniques are modular and easy to implement, and they can be seamlessly trained end-to-end using gradient descent. Our rigorous experiments showed that deep models equipped with the attention mechanism deliver high-quality classification, and repeatedly identify significant bands in the training data, permitting the creation of refined and extremely compact sets that retain the most meaningful features.

Computer Vision and Pattern Recognition,Machine Learning
Attend in Bands: Hyperspectral Band Weighting and Selection for Image Classification

Jing Wang,Jun Zhou,Weiqing Huang,Jackie Fang Chen

DOI: https://doi.org/10.1109/jstars.2019.2955097

IF: 4.715

2019-01-01

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:Hyperspectral remote sensing sensors have the ability to capture a wide range of spectrum of ground objects with hundreds to thousands of bands. The obtained hyperspectral images contain more detailed spectral information than conventional panchromatic or color images. However, redundant and noisy data could also be introduced into the images and may impair further processing of the data. Removing the redundancy and noisy bands becomes one of the most important preprocessing steps of hyperspectral imaging. As a feature selection method, an attention mechanism has been successfully used in computer vision and natural language processing to enable algorithms to concentrate on the most significant data. In this article, we propose a band attention network for hyperspectral image classification. This network can automatically learn to attend to the desired band set that maximizes the classification accuracy. With careful design, the band attention framework can undertake both band weighting and band selection tasks. When working in the band weighting mode, the proposed band attention framework can learn a band weighting vector that models the relationship between all the bands. For band selection, our network can be adapted as two different types of band selection networks that select the significant bands and discard the useless bands. In both tasks, the attention and classification can be learned end to end. The experimental results prove the effectiveness and advantages of the proposed work.
Dual-graph convolutional network based on band attention and sparse constraint for hyperspectral band selection

Jie Feng,Zhanwei Ye,Shuai Liu,Xiangrong Zhang,Jiantong Chen,Ronghua Shang,Licheng Jiao

DOI: https://doi.org/10.1016/j.knosys.2021.107428

2021-11-01

Abstract:Band selection is a research hotspot in hyperspectral image processing. The continuity of the spectral bands causes the adjacent bands to be highly correlated, and correlation among long-range bands is possible with hundreds of spectral bands. Most existing deep learning methods fail to make full use of the inter-band correlation for band selection. In this paper, a novel dual-graph convolutional network based on band attention and a sparse constraint is proposed for band selection. The network consists of two branches. In the attention branch, band-based dual graphs are constructed to encode the contextual correlation of adjacent bands and the structural correlation of long-range bands into non-Euclidean space. Subsequently, the graph convolution-based band attention mechanism is devised to aggregate the band information in the band-based dual graphs and to generate the attention map for all bands. The band attention map is sparsely constrained and embedded as a mask into the trunk branch. In the trunk branch, sample-based dual graphs are constructed to represent the topological information of the samples in the spectral and spatial domains. Furthermore, a dense graph convolutional network is designed to extract and fuse the spatial–spectral and topological features from the shallow to deep layers for classification. A soft-shifting optimization strategy is implemented by defining a new loss from full bands and selected bands to solve the optimization problem caused by the sparse constraint. In this manner, band selection, feature extraction, and classification can be combined into an end-to-end trainable network. The experimental results on representative hyperspectral image datasets demonstrate the superiority of the proposed method over current state-of-the-art band selection methods.

computer science, artificial intelligence
Spatial Proximity Feature Selection With Residual Spatial-Spectral Attention Network for Hyperspectral Image Classification.

Xinsheng Zhang,Zhaohui Wang

DOI: https://doi.org/10.1109/ACCESS.2023.3253627

IF: 3.9

2023-01-01

IEEE Access

Abstract:Over the past few years, deep learning has been introduced to tackle hyperspectral image (HSI) classification and demonstrated good performance. In particular, the convolutional neural network (CNN) based methods have progressed. However, due to the high dimensionality of HSI and equal treatment of all bands, the performances of CNN based methods are hampered. The labels of land-covers often differ between edge and the center pixels in pixel-centered spatial information. These edge pixels may weaken the discrimination of spatial features and reduce classification accuracy. Motivated by the attention mechanism of the human visual system, the spatial proximity feature selection with residual spatial-spectral attention network is proposed in this article. It contains a residual spatial attention module, a residual spectral attention module, and a spatial proximity feature selection module. The residual spatial attention module aims to select the crucial spatial information, which assigns weights to different features by measuring the similarity between the surrounding elements and their central ones. The residual spectral attention module is designed for spectral bands which are selected from raw input data by emphasizing the valuable bands and suppressing the valueless. According to the spatial distribution of features, the spatial proximity feature selection module is used to filter features effectively. Experiments on three public data sets demonstrate that the proposed network outperforms the state-of-the-art methods in comparison.
Faster hyperspectral image classification based on selective kernel mechanism using deep convolutional networks

Guandong Li,Chunju Zhang

DOI: https://doi.org/10.48550/arXiv.2202.06458

2022-02-14

Abstract:Hyperspectral imagery is rich in spatial and spectral information. Using 3D-CNN can simultaneously acquire features of spatial and spectral dimensions to facilitate classification of features, but hyperspectral image information spectral dimensional information redundancy. The use of continuous 3D-CNN will result in a high amount of parameters, and the computational power requirements of the device are high, and the training takes too long. This letter designed the Faster selective kernel mechanism network (FSKNet), FSKNet can balance this problem. It designs 3D-CNN and 2D-CNN conversion modules, using 3D-CNN to complete feature extraction while reducing the dimensionality of spatial and spectrum. However, such a model is not lightweight enough. In the converted 2D-CNN, a selective kernel mechanism is proposed, which allows each neuron to adjust the receptive field size based on the two-way input information scale. Under the Selective kernel mechanism, it mainly includes two components, se module and variable convolution. Se acquires channel dimensional attention and variable convolution to obtain spatial dimension deformation information of ground objects. The model is more accurate, faster, and less computationally intensive. FSKNet achieves high accuracy on the IN, UP, Salinas, and Botswana data sets with very small parameters.

Image and Video Processing,Computer Vision and Pattern Recognition
Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

Ningyang Li,Zhaohui Wang

DOI: https://doi.org/10.1109/icip42928.2021.9506338

2021-01-01

Abstract:Hyperspectral image classification has been a research hotspot in the field of remote sensing. Traditional methods are limited by their poor robustness. Recently, convolutional neural network, as the common architecture in deep learning, has achieved superior performance in feature extraction and becomes the mainstream method of hyperspectral image classification. However, due to the redundancy of hyperspectral image, the distinguishing spectral-spatial features for classification are often hard to acquire. In this paper, a novel spectral-spatial fused attention module is proposed for hyperspectral image classification. The module contains three parts. The first part is designed to extract the correlation among the bands. The second part aims to acquire the common spatial positions. Different from the former two parts, the stable spatial features and the contributions of neighborhoods to the center spectrum are explored in the last part. In addition, the identical modules are stacked sequentially in the proposed network to extract the significant spectral-spatial features. The experimental studies on two publicly available datasets reveal the effectiveness of the proposed method.
Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal.

Sen Jia,Zhen Ji,Yuntao Qian,Linlin Shen

DOI: https://doi.org/10.1109/jstars.2012.2187434

IF: 4.715

2012-01-01

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:The rich information available in hyperspectral imagery has provided significant opportunities for material classification and identification. Due to the problem of the "curse of dimensionality" (called Hughes phenomenon) posed by the high number of spectral channels along with small amounts of labeled training samples, dimensionality reduction is a necessary preprocessing step for hyperspectral data. Generally, in order to improve the classification accuracy, noise bands generated by various sources (primarily the sensor and the atmosphere) are often manually removed in advance. However, the removal of these bands may discard some important discriminative information, eventually degrading the classification accuracy. In this paper, we propose a new strategy to automatically select bands without manual band removal. Firstly, wavelet shrinkage is applied to denoise the spatial images of the whole data cube. Then affinity propagation, which is a recently proposed feature selection approach, is used to choose representative bands from the noise-reduced data. Experimental results on three real hyperspectral data collected by two different sensors demonstrate that the bands selected by our approach on the whole data (containing noise bands) could achieve higher overall classification accuracies than those by other state-of-the-art feature selection techniques on the manual-band-removal (MBR) data, even better than the bands identified by the proposed approach on the MBR data, indicating that the removed "noise" bands are valuable for hyperspectral classification, which should not be eliminated.
Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network

Cuiping Shi,Diling Liao,Tianyu Zhang,Liguo Wang

DOI: https://doi.org/10.3390/rs14030608

IF: 5

2022-01-27

Remote Sensing

Abstract:In recent years, due to its powerful feature extraction ability, the deep learning method has been widely used in hyperspectral image classification tasks. However, the features extracted by classical deep learning methods have limited discrimination ability, resulting in unsatisfactory classification performance. In addition, due to the limited data samples of hyperspectral images (HSIs), how to achieve high classification performance under limited samples is also a research hotspot. In order to solve the above problems, this paper proposes a deep learning network framework named the three-dimensional coordination attention mechanism network (3DCAMNet). In this paper, a three-dimensional coordination attention mechanism (3DCAM) is designed. This attention mechanism can not only obtain the long-distance dependence of the spatial position of HSIs in the vertical and horizontal directions, but also obtain the difference of importance between different spectral bands. In order to extract the spectral and spatial information of HSIs more fully, a convolution module based on convolutional neural network (CNN) is adopted in this paper. In addition, the linear module is introduced after the convolution module, which can extract more fine advanced features. In order to verify the effectiveness of 3DCAMNet, a series of experiments were carried out on five datasets, namely, Indian Pines (IP), Pavia University (UP), Kennedy Space Center (KSC), Salinas Valley (SV), and University of Houston (HT). The OAs obtained by the proposed method on the five datasets were 95.81%, 97.01%, 99.01%, 97.48%, and 97.69% respectively, 3.71%, 9.56%, 0.67%, 2.89% and 0.11% higher than the most advanced A2S2K-ResNet. Experimental results show that, compared with some state-of-the-art methods, 3DCAMNet not only has higher classification performance, but also has stronger robustness.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Hyperspectral Image Classification with Attention Aided CNNs

Renlong Hang,Zhu Li,Qingshan Liu,Pedram Ghamisi,Shuvra S. Bhattacharyya

DOI: https://doi.org/10.48550/arXiv.2005.11977

2020-06-12

Abstract:Convolutional neural networks (CNNs) have been widely used for hyperspectral image classification. As a common process, small cubes are firstly cropped from the hyperspectral image and then fed into CNNs to extract spectral and spatial features. It is well known that different spectral bands and spatial positions in the cubes have different discriminative abilities. If fully explored, this prior information will help improve the learning capacity of CNNs. Along this direction, we propose an attention aided CNN model for spectral-spatial classification of hyperspectral images. Specifically, a spectral attention sub-network and a spatial attention sub-network are proposed for spectral and spatial classification, respectively. Both of them are based on the traditional CNN model, and incorporate attention modules to aid networks focus on more discriminative channels or positions. In the final classification phase, the spectral classification result and the spatial classification result are combined together via an adaptively weighted summation method. To evaluate the effectiveness of the proposed model, we conduct experiments on three standard hyperspectral datasets. The experimental results show that the proposed model can achieve superior performance compared to several state-of-the-art CNN-related models.

Image and Video Processing,Computer Vision and Pattern Recognition
Hyperspectral Image Classification Based on a 3D Octave Convolution and 3D Multiscale Spatial Attention Network

Cuiping Shi,Jingwei Sun,Tianyi Wang,Liguo Wang

DOI: https://doi.org/10.3390/rs15010257

IF: 5

2023-01-02

Remote Sensing

Abstract:Convolutional neural networks are widely used in the field of hyperspectral image classification. After continuous exploration and research in recent years, convolutional neural networks have achieved good classification performance in the field of hyperspectral image classification. However, we have to face two main challenges that restrict the improvement of hyperspectral classification accuracy, namely, the high dimension of hyperspectral images and the small number of training samples. In order to solve these problems, in this paper, a new hyperspectral classification method is proposed. First, a three-dimensional octave convolution (3D-OCONV) is proposed. Subsequently, a dense connection structure of three-dimensional asymmetric convolution (DC-TAC) is designed. In the spectral branch, the spectral features are extracted through a combination of the 3D-OCONV and spectral attention modules, followed by the DC-TAC. In the spatial branch, a three-dimensional, multiscale spatial attention module (3D-MSSAM) is presented. The spatial information is fully extracted using the 3D-OCONV, 3D-MSSAM, and DC-TAC. Finally, the spectral and spatial information extracted from the two branches is fully fused with an interactive information fusion module. Compared to some state-of-the-art classification methods, the proposed method shows superior classification performance with a small number of training samples on four public datasets.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Band Attention Convolutional Networks For Hyperspectral Image Classification

Hongwei Dong,Lamei Zhang,Bin Zou

DOI: https://doi.org/10.48550/arXiv.1906.04379

2019-06-11

Abstract:Redundancy and noise exist in the bands of hyperspectral images (HSIs). Thus, it is a good property to be able to select suitable parts from hundreds of input bands for HSIs classification methods. In this letter, a band attention module (BAM) is proposed to implement the deep learning based HSIs classification with the capacity of band selection or weighting. The proposed BAM can be seen as a plug-and-play complementary component of the existing classification networks which fully considers the adverse effects caused by the redundancy of the bands when using convolutional neural networks (CNNs) for HSIs classification. Unlike most of deep learning methods used in HSIs, the band attention module which is customized according to the characteristics of hyperspectral images is embedded in the ordinary CNNs for better performance. At the same time, unlike classical band selection or weighting methods, the proposed method achieves the end-to-end training instead of the separated stages. Experiments are carried out on two HSI benchmark datasets. Compared to some classical and advanced deep learning methods, numerical simulations under different evaluation criteria show that the proposed method have good performance. Last but not least, some advanced CNNs are combined with the proposed BAM for better performance.

Computer Vision and Pattern Recognition
Spectral-Spatial-Temporal Attention Network for Hyperspectral Tracking.

Zhuanfeng Li,Xinhai Ye,Fengchao Xiong,Jianfeng Lu,Jun Zhou,Yuntao Qian

DOI: https://doi.org/10.1109/whispers52202.2021.9484032

2021-01-01

Abstract:Thanks to the abundant spectral bands, hyperspectral videos (HSVs) are able to describe objects at material level, i.e., the physical property, providing more benefits for object tracking than color videos. Considering limited HSV dataset for training, a band attention aware ensemble network was recently proposed for hyperspectral tracking, which leverages band attention to select several three-channel images for deep hyperspectral tracking. However, it fails to fully consider the joint spectral-spatial-temporal information in HSVs, compromising its tracking performance in challenging scenarios. To this end, we introduce a spectral-spatial-temporal attention neural network (SST-Net) for hyperspectral tracking in this paper. Specifically, the spatial attention with convolution and deconvolution structure focuses on the salient spatial features. Moreover, the temporal attention with an RNN structure is adopted to depict the temporal relationship among adjacent frames. By combining the spatial, spectral, and temporal attention, the band relationship can be better depicted thus valuable hyperspectral bands can be better selected for deep ensemble tracking. Experimental results show the improved effectiveness of SST-Net in tracking over serval alternative trackers.
A Band Selection Method with Masked Convolutional Autoencoder for Hyperspectral Image

Yufei Liu,Xiaorun Li,Ziqiang Hua,Chaoqun Xia,Liaoying Zhao

DOI: https://doi.org/10.1109/lgrs.2022.3178824

IF: 5.343

2022-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:Band selection (BS) is an effective means to solve the problems of spectral redundancy and Hughes phenomenon in hyperspectral images (HSIs). However, existing BS methods fail to consider the representativeness, redundancy, and information content of the selected bands simultaneously, and most of them lack consideration of the inherent nonlinear relationship between bands. To address these problems, we propose a novel unsupervised BS framework that can comprehensively consider band representativeness, redundancy, and information content (RRI) in this letter. The band representativeness is estimated by a convolutional autoencoder (AE), which can capture the inherent nonlinear relationship between the bands and leverage the spatial information of the HSI. The redundancy and the information content of a band subset are restricted and enhanced by the correlation coefficient and the information divergence (ID), respectively. Subsequently, RRI combines these three indicators as the subset evaluation criterion and utilizes an immune clone selection algorithm to search for the desired band subset. Experimental results verify that the proposed RRI method can provide higher classification accuracy than the competitors and is robust to noisy bands.
A Triple-Path Spectral–Spatial Network With Interleave-Attention for Hyperspectral Image Classification

Ziqing Deng,Yang Wang,Bing Zhang,Linwei Li,Jihong Wang,Lifeng Bian,Chen Yang

DOI: https://doi.org/10.1109/jstars.2022.3192470

IF: 4.715

2022-08-05

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:To exploit hyperspectral image's (HSI) spectral–spatial information and reduce network complexity, a triple-path convolution neural network with an interleave-attention mechanism is constructed for high-precision classification. A hybrid branch is proposed to capture joint features, which are later utilized as complementary information for purely spectral and spatial features. Furthermore, the interleave-attention mechanism is elaborately designed to increase the interaction of data from spectral, spatial, and joint branches as they propagate through the network for feature integration. Meanwhile, two attention modules are adopted in the corresponding branch to optimize extracted features for better feature representation. We utilize several real HSI datasets to evaluate network performance, which demonstrates that the proposed triple-path network can obtain very satisfactory performance with fewer parameters and low computational complexity.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geography, physical
Remote Sensing Image Classification Based on a Cross-Attention Mechanism and Graph Convolution

Weiwei Cai,Zhanguo Wei

DOI: https://doi.org/10.1109/lgrs.2020.3026587

IF: 5.343

2022-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:An attention mechanism assigns different weights to different features to help a model select the features most valuable for accurate classification. However, the traditional attention mechanism algorithm often allocates weights in a one-way fashion, which can result in a loss of feature information. To obtain better hyperspectral data classification results, a novel cross-attention mechanism and graph convolution integration algorithm are proposed in this letter. First, principal component analysis is used to reduce the dimensionality of hyperspectral images to obtain low-dimensional features that are more expressive. Second, the model uses a cross (horizontal and vertical directions) attention algorithm to allocate weights jointly based on its two strategies; then, it adopts a graph convolution algorithm to generate the directional relationships between the features. Finally, the generated deep features and the relationship between the deep features are used to complete the prediction of hyperspectral data. Experiments on three well-known hyperspectral data sets—Indian Pines, the University of Pavia, and Salinas—show that the proposed algorithm achieves better performances than do other well-known algorithms using different methods of training set division.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Band Selection for Hyperspectral Imagery: A New Approach Based on Complex Networks

Wei Xia,Bin Wang,Liming Zhang

DOI: https://doi.org/10.1109/LGRS.2012.2236819

2013-01-01

Abstract:In recent years, band selection is becoming a popular approach to reduce the dimensionality of hyperspectral data while preserving the desired information for target detection and classification analysis. This letter presents a new method for unsupervised band selection by transforming the hyperspectral data into complex networks. By analyzing the networks' topological feature corresponding to each band, one can easily evaluate the statistical characteristics and intrinsic properties of the signals. The proposed method searches for the network set which is most qualified for demarcating and identifying different substance signatures, and then, the network set's corresponding bands are regarded as the descried output results. This network measure is a new criterion for band selection. Experimental results demonstrate that the proposed method can acquire satisfactory results when compared with traditional methods.
Attention 3D central difference convolutional dense network for hyperspectral image classification

Mahmood Ashraf,Raed Alharthi,Lihui Chen,Muhammad Umer,Shtwai Alsubai,Ala Abdulmajid Eshmawi

DOI: https://doi.org/10.1371/journal.pone.0300013

IF: 3.7

2024-04-10

PLoS ONE

Abstract:Hyperspectral Images (HSI) classification is a challenging task due to a large number of spatial-spectral bands of images with high inter-similarity, extra variability classes, and complex region relationships, including overlapping and nested regions. Classification becomes a complex problem in remote sensing images like HSIs. Convolutional Neural Networks (CNNs) have gained popularity in addressing this challenge by focusing on HSI data classification. However, the performance of 2D-CNN methods heavily relies on spatial information, while 3D-CNN methods offer an alternative approach by considering both spectral and spatial information. Nonetheless, the computational complexity of 3D-CNN methods increases significantly due to the large capacity size and spectral dimensions. These methods also face difficulties in manipulating information from local intrinsic detailed patterns of feature maps and low-rank frequency feature tuning. To overcome these challenges and improve HSI classification performance, we propose an innovative approach called the Attention 3D Central Difference Convolutional Dense Network (3D-CDC Attention DenseNet). Our 3D-CDC method leverages the manipulation of local intrinsic detailed patterns in the spatial-spectral features maps, utilizing pixel-wise concatenation and spatial attention mechanism within a dense strategy to incorporate low-rank frequency features and guide the feature tuning. Experimental results on benchmark datasets such as Pavia University, Houston 2018, and Indian Pines demonstrate the superiority of our method compared to other HSI classification methods, including state-of-the-art techniques. The proposed method achieved 97.93% overall accuracy on the Houston-2018, 99.89% on Pavia University, and 99.38% on the Indian Pines dataset with the 25 × 25 window size.

multidisciplinary sciences

Effective band selection of hyperspectral image by an attention mechanism-based convolutional network

Channel and band attention embedded 3D CNN for model development of hyperspectral image in object-scale analysis

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

An Unsupervised Band Selection Method Based on Triple Constraints and Attention Network for Hyperspectral Imagery

Band Selection from Hyperspectral Images Using Attention-based Convolutional Neural Networks

Attend in Bands: Hyperspectral Band Weighting and Selection for Image Classification

Dual-graph convolutional network based on band attention and sparse constraint for hyperspectral band selection

Spatial Proximity Feature Selection With Residual Spatial-Spectral Attention Network for Hyperspectral Image Classification.

Faster hyperspectral image classification based on selective kernel mechanism using deep convolutional networks

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal.

Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network

Hyperspectral Image Classification with Attention Aided CNNs

Hyperspectral Image Classification Based on a 3D Octave Convolution and 3D Multiscale Spatial Attention Network

Band Attention Convolutional Networks For Hyperspectral Image Classification

Spectral-Spatial-Temporal Attention Network for Hyperspectral Tracking.

A Band Selection Method with Masked Convolutional Autoencoder for Hyperspectral Image

A Triple-Path Spectral–Spatial Network With Interleave-Attention for Hyperspectral Image Classification

Remote Sensing Image Classification Based on a Cross-Attention Mechanism and Graph Convolution

Band Selection for Hyperspectral Imagery: A New Approach Based on Complex Networks

Attention 3D central difference convolutional dense network for hyperspectral image classification