A Fast Dense Spectral-Spatial Convolution Network Framework for Hyperspectral Images Classification

Zhongmin Jiang,Shuguang Dou,Wenju Wang,Liujie Sun

DOI: https://doi.org/10.3390/rs10071068

IF: 5

2018-07-05

Remote Sensing

Abstract:Recent research shows that deep-learning-derived methods based on a deep convolutional neural network have high accuracy when applied to hyperspectral image (HSI) classification, but long training times. To reduce the training time and improve accuracy, in this paper we propose an end-to-end fast dense spectral–spatial convolution (FDSSC) framework for HSI classification. The FDSSC framework uses different convolutional kernel sizes to extract spectral and spatial features separately, and the “valid” convolution method to reduce the high dimensions. Densely-connected structures—the input of each convolution consisting of the output of all previous convolution layers—was used for deep learning of features, leading to extremely accurate classification. To increase speed and prevent overfitting, the FDSSC framework uses a dynamic learning rate, parametric rectified linear units, batch normalization, and dropout layers. These attributes enable the FDSSC framework to achieve accuracy within as few as 80 epochs. The experimental results show that with the Indian Pines, Kennedy Space Center, and University of Pavia datasets, the proposed FDSSC framework achieved state-of-the-art performance compared with existing deep-learning-based methods while significantly reducing the training time.

Environmental Science,Computer Science

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

The paper aims to address two main issues in Hyperspectral Image (HSI) classification:
1. **Long Training Time**: Existing deep learning-based methods, although achieving high accuracy in HSI classification, have excessively long training times.
2. **Improving Classification Accuracy**: Traditional machine learning methods have room for improvement in terms of accuracy in HSI classification.

To tackle these issues, the authors propose a Fast Dense Spectral-Spatial Convolution (FDSSC) framework to achieve faster training speeds and higher classification accuracy. Specifically, the framework has the following features:

1. **End-to-End Spectral-Spatial Convolution Network**: Unlike traditional feature engineering-based methods (such as SAE-LR, Makantasis's method, and the SSFC framework), the FDSSC framework fully utilizes Convolutional Neural Networks (CNN) to automatically learn spectral and spatial features, without the need for dimensionality reduction techniques like Principal Component Analysis (PCA), Random PCA (R-PCA), or Balanced Local Discriminant Embedding (BLDE).
2. **Deeper Network Structure**: Compared to other CNN-based deep learning methods (such as the SSFC framework and methods in references [11,12]), the FDSSC framework has a deeper structure, enabling it to learn more useful deep spectral and spatial features, thereby achieving higher classification accuracy.
3. **Reduced Training Time**: Despite having a deeper structure, the FDSSC framework can achieve optimal classification accuracy within 80 epochs, whereas SAE-LR requires 600,000 epochs, and the SSRN framework requires 200 epochs.

Through these improvements, the FDSSC framework not only significantly reduces training time but also achieves state-of-the-art classification performance.