Abstract:Due to the detailed spectral information through hundreds of narrow spectral bands provided by hyperspectral image (HSI) data, it can be employed to accurately classify diverse materials of interest, which is one of the core applications of hyperspectral remote sensing technology. In recent years, with the rapid development of deep learning, convolutional neural networks (CNNs) have been successfully applied in many fields, including HSI classification. However, the random gradient descent-based parameter updating scheme is too general and leading to the inefficiency of CNN models. Moreover, the high dimensionality and limited training samples of HSI data also exacerbate the overfitting problem. To tackle these issues, in this article, a novel deep network with multilayer and multibranch architecture, named 3-D Gabor CNN (3DG-CNN), is proposed for HSI classification. More precisely, since the predefined 3-D Gabor filters in multiple scales and orientations could well characterize the internal spatial–spectral structure of HSI data from various perspectives, the 3-D Gabor-modulated kernels (3-D GMKs) are employed to replace the random initialization kernels. Moreover, the specially designed multibranch architecture enables the network to better integrating the scalable property of 3-D Gabor filters; thus, the representative ability and robustness of the extracted features can be greatly improved. Alternatively, the number of network parameters is substantially reduced due to the incorporation of 3-D Gabor modulation, relieving the training complexity and also alleviating the training process from overfitting. Experimental results on four real HSI datasets (including two newly released ones in the literature) have demonstrated that the proposed 3DG-CNN model can achieve better performance than several widely used machine-learning-based and deep-learning-based approaches. For the sake of reproducibility, the codes of the proposed 3DG-CNN model are available at http://jiasen.tech/papers/.

Classification of hyperspectral images based on fused 3D inception and 3D-2D hybrid convolution

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Three-dimensional Densely Connected Convolutional Network for Hyperspectral Remote Sensing Image Classification

Hyperspectral Image Classification Based on 3D–2D Hybrid Convolution and Graph Attention Mechanism

Hyperspectral Image Classification Based on a 3D Octave Convolution and 3D Multiscale Spatial Attention Network

3D Convolutional Siamese Network for Few-Shot Hyperspectral Classification

Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks

Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network

An Enhanced Spectral Fusion 3D CNN Model for Hyperspectral Image Classification

Three-branch attention deep model for hyperspectral image classification using cross fusion

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification

A combination method of stacked autoencoder and 3D deep residual network for hyperspectral image classification

Hyperspectral Image Classification With Deep Learning Models

Hyperspectral Image Classification Based on Fusion of Convolutional Neural Network and Graph Network

Hyperspectral Image Classification Based on Dense Pyramidal Convolution and Multi-Feature Fusion

Hyperspectral Image Classification Using Feature Fusion Fuzzy Graph Broad Network

Hyperspectral image classification using 3D-2D CNN with multi-scale information extraction and fusion module

Hyperspectral Image Classification Based on 3-D Octave Convolution With Spatial–Spectral Attention Network

3-D Gabor Convolutional Neural Network for Hyperspectral Image Classification

Spatial–Spectral Feature Refinement for Hyperspectral Image Classification Based on Attention-Dense 3D-2D-CNN