Abstract:Due to the detailed spectral information through hundreds of narrow spectral bands provided by hyperspectral image (HSI) data, it can be employed to accurately classify diverse materials of interest, which is one of the core applications of hyperspectral remote sensing technology. In recent years, with the rapid development of deep learning, convolutional neural networks (CNNs) have been successfully applied in many fields, including HSI classification. However, the random gradient descent-based parameter updating scheme is too general and leading to the inefficiency of CNN models. Moreover, the high dimensionality and limited training samples of HSI data also exacerbate the overfitting problem. To tackle these issues, in this article, a novel deep network with multilayer and multibranch architecture, named 3-D Gabor CNN (3DG-CNN), is proposed for HSI classification. More precisely, since the predefined 3-D Gabor filters in multiple scales and orientations could well characterize the internal spatial–spectral structure of HSI data from various perspectives, the 3-D Gabor-modulated kernels (3-D GMKs) are employed to replace the random initialization kernels. Moreover, the specially designed multibranch architecture enables the network to better integrating the scalable property of 3-D Gabor filters; thus, the representative ability and robustness of the extracted features can be greatly improved. Alternatively, the number of network parameters is substantially reduced due to the incorporation of 3-D Gabor modulation, relieving the training complexity and also alleviating the training process from overfitting. Experimental results on four real HSI datasets (including two newly released ones in the literature) have demonstrated that the proposed 3DG-CNN model can achieve better performance than several widely used machine-learning-based and deep-learning-based approaches. For the sake of reproducibility, the codes of the proposed 3DG-CNN model are available at http://jiasen.tech/papers/.

Bands Sensitive Convolutional Network for Hyperspectral Image Classification

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Deep Convolutional Neural Networks for Hyperspectral Image Classification

Hyperspectral Band Selection for Multispectral Image Classification with Convolutional Networks

Integrating Convolutional Neural Network and Gated Recurrent Unit for Hyperspectral Image Spectral-Spatial Classification.

Hyperspectral Image Classification Based on Multilevel Joint Feature Extraction Network

Consolidated Convolutional Neural Network for Hyperspectral Image Classification

Band Attention Convolutional Networks For Hyperspectral Image Classification

Hybrid 2D–3D convolution and pre-activated residual networks for hyperspectral image classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

An End-to-End Hyperspectral Image Classification Method Using Deep Convolutional Neural Network with Spatial Constraint

Two-Branch Convolutional Neural Network with Polarized Full Attention for Hyperspectral Image Classification

End-to-End Convolutional Network and Spectral-Spatial Transformer Architecture for Hyperspectral Image Classification

Cross-Attention Spectral–Spatial Network for Hyperspectral Image Classification

Hyperspectral Image Classification with a Dense Multi-Scale Residual Network

Dual-Stream Spectral-Spatial Convolutional Neural Network for Hyperspectral Image Classification and Optimal Band Selection

Hyperspectral image classification based on spectral and spatial information using ResNet with channel attention

3-D Gabor Convolutional Neural Network for Hyperspectral Image Classification

Hierarchical Multi-Scale Convolutional Neural Networks For Hyperspectral Image Classification

HAMNet: hyperspectral image classification based on hybrid neural network with attention mechanism and multi-scale feature fusion