Abstract:With the development of deep learning, the performance of hyperspectral image (HSI) classification has been greatly improved in recent years. The shortage of training samples has become a bottleneck for further improvement of performance. In this paper, we propose a novel convolutional neural network framework for the characteristics of hyperspectral image data, called HSI-CNN. Firstly, the spectral-spatial feature is extracted from a target pixel and its neighbors. Then, a number of one-dimensional feature maps, obtained by convolution operation on spectral-spatial features, are stacked into a two-dimensional matrix. Finally, the two-dimensional matrix considered as an image is fed into standard CNN. This is why we call it HSI-CNN. In addition, we also implements two depth network classification models, called HSI-CNN+XGBoost and HSI-CapsNet, in order to compare the performance of our framework. Experiments show that the performance of hyperspectral image classification is improved efficiently with HSI-CNN framework. We evaluate the model's performance using four popular HSI datasets, which are the Kennedy Space Center (KSC), Indian Pines (IP), Pavia University scene (PU) and Salinas scene (SA). As far as we concerned, HSI-CNN has got the state-of-art accuracy among all methods we have known on these datasets of 99.28%, 99.09%, 99.42%, 98.95% separately.

What problem does this paper attempt to address?

The problem this paper attempts to address is the lack of samples in hyperspectral image (HSI) classification. Specifically, although deep learning techniques have significantly improved the performance of hyperspectral image classification, the lack of training samples has become a bottleneck for further performance enhancement. To this end, the authors propose a new convolutional neural network framework (HSI-CNN) aimed at better utilizing the spatial and spectral information of hyperspectral images, thereby improving classification performance with a limited number of samples. ### Main Contributions: 1. **Proposed HSI-CNN Framework**: This framework extracts spectral-spatial features of the target pixel and its neighborhood, converts these features into a 2D matrix, and then inputs them into a standard convolutional neural network for classification. This design allows the network to effectively avoid overfitting in the case of a limited number of samples. 2. **Implemented HSI-CNN+XGBoost Method**: XGBoost is used as a substitute for the output layer of HSI-CNN to prevent overfitting. Experimental results show that this method not only avoids overfitting but also improves classification performance in some cases. 3. **Modified CapsNet Structure**: CapsNet is applied to hyperspectral image classification. Although experimental results show that its performance is not as good as HSI-CNN, this attempt provides new ideas for future research. ### Experimental Results: The authors evaluated the performance of HSI-CNN on four popular hyperspectral image datasets (KSC, IP, PU, and SA). The experimental results show that the classification accuracies of HSI-CNN on these datasets are 99.28%, 99.09%, 99.42%, and 98.95%, respectively, reaching the best-known levels. ### Conclusion: HSI-CNN effectively addresses the problem of insufficient samples in hyperspectral image classification by reorganizing data and utilizing spectral-spatial information. Additionally, the attempts to combine XGBoost and CapsNet also provide new directions for future research in hyperspectral image classification.

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Hyper-S3NN: Spatial–spectral Spiking Neural Network for Hyperspectral Image Classification

Consolidated Convolutional Neural Network for Hyperspectral Image Classification

Group Convolutional Neural Networks For Hyperspectral Image Classification

Hybrid 2D–3D convolution and pre-activated residual networks for hyperspectral image classification

A Hybrid Neural Network for Hyperspectral Image Classification

Deep CNN-based Hyperspectral Image Classification Using Discriminative Multiple Spatial-Spectral Feature Fusion

CNN and Transformer Hybrid Network for Hyperspectral Image Classification

Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

3-D Gabor Convolutional Neural Network for Hyperspectral Image Classification

Cross Spectral-Spatial Convolutional Network for Hyperspectral Image Classification

Classification of Hyperspectral Data Using a Multi-Channel Convolutional Neural Network

Spatial-Spectral Network for Hyperspectral Image Classification: A 3-D CNN and Bi-LSTM Framework

End-to-End Convolutional Network and Spectral-Spatial Transformer Architecture for Hyperspectral Image Classification

A Novel 2D-3D CNN with Spectral-Spatial Multi-Scale Feature Fusion for Hyperspectral Image Classification

Hyperspectral Image Classification Method Based on 2d–3d CNN and Multibranch Feature Fusion

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

Digging More in Neural World: An Efficient Approach for Hyperspectral Image Classification Using Convolutional Neural Network.

Spectral-Spatial Classification Of Hyperspectral Imagery With 3d Convolutional Neural Network

Hyperspectral Image Classification With Spatial Consistence Using Fully Convolutional Spatial Propagation Network

Learning Spatial–Spectral-Dimensional-Transformation-Based Features for Hyperspectral Image Classification