Abstract:Feature extraction is of significance for hyperspectral image (HSI) classification. Compared with conventional hand-crafted feature extraction, deep learning can automatically learn features with discriminative information. However, two issues exist in applying deep learning to HSIs. One issue is how to jointly extract spectral features and spatial features, and the other one is how to train the deep model when training samples are scarce. In this paper, a deep convolutional neural network with two-branch architecture is proposed to extract the joint spectral-spatial features from HSIs. The two branches of the proposed network are devoted to features from the spectral domain as well as the spatial domain. The learned spectral features and spatial features are then concatenated and fed to fully connected layers to extract the joint spectral-spatial features for classification. When the training samples are limited, we investigate the transfer learning to improve the performance. Low and mid-layers of the network are pretrained and transferred from other data sources; only top layers are trained with limited training samples extracted from the target scene. Experiments on Airborne Visible/Infrared Imaging Spectrometer and Reflective Optics System Imaging Spectrometer data demonstrate that the learned deep joint spectral-spatial features are discriminative, and competitive classification results can be achieved when compared with state-of-the-art methods. The experiments also reveal that the transferred features boost the classification performance.

Hyperspectral Image Classification Using Two-Channel Deep Convolutional Neural Network

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification

Classification of Hyperspectral Data Using a Multi-Channel Convolutional Neural Network

Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

Classification of Hyperspectral Images Based on Two-Channel Convolutional Neural Network Combined with Support Vector Machine Algorithm

Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images Via Convolutional Neural Networks

Deep Convolutional Neural Networks for Hyperspectral Image Classification

Deep CNN-based Hyperspectral Image Classification Using Discriminative Multiple Spatial-Spectral Feature Fusion

3D Convolutional Siamese Network for Few-Shot Hyperspectral Classification

Hyperspectral Image Classification Using Deep Pixel-Pair Features

Group Convolutional Neural Networks For Hyperspectral Image Classification

Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification

Dual-Channel Convolution Network With Image-Based Global Learning Framework for Hyperspectral Image Classification

Hyperspectral Image Classification With Deep Learning Models

Hyperspectral Classification Based on Spectral-Spatial Convolutional Neural Networks

Joint spatial-spectral hyperspectral image classification based on convolutional neural network

Synergistic 2D/3D Convolutional Neural Network for Hyperspectral Image Classification

Convolutional Neural Network Based Classification for Hyperspectral Data

Spectral-Spatial Classification of Hyperspectral Imagery Based on Deep Convolutional Network

A Multi-branch Feature Fusion Model Based on Convolutional Neural Network for Hyperspectral Remote Sensing Image Classification