Abstract:Supervised approaches classify input data using a set of representative samples for each class, known as training samples. The collection of such samples is expensive and time demanding. Hence, unsupervised feature learning, which has a quick access to arbitrary amounts of unlabeled data, is conceptually of high interest. In this paper, we propose a novel network architecture, fully Conv-Deconv network, for unsupervised spectral-spatial feature learning of hyperspectral images, which is able to be trained in an end-to-end manner. Specifically, our network is based on the so-called encoder-decoder paradigm, i.e., the input 3-D hyperspectral patch is first transformed into a typically lower dimensional space via a convolutional subnetwork (encoder), and then expanded to reproduce the initial data by a deconvolutional subnetwork (decoder). However, during the experiment, we found that such a network is not easy to be optimized. To address this problem, we refine the proposed network architecture by incorporating: 1) residual learning and 2) a new unpooling operation that can use memorized max-pooling indexes. Moreover, to understand the “black box,” we make an in-depth study of the learned feature maps in the experimental analysis. A very interesting discovery is that some specific “neurons” in the first residual block of the proposed network own good description power for semantic visual patterns in the object level, which provide an opportunity to achieve “free” object detection. This paper, for the first time in the remote sensing community, proposes an end-to-end fully Conv-Deconv network for unsupervised spectral-spatial feature learning. Moreover, this paper also introduces an in-depth investigation of learned features. Experimental results on two widely used hyperspectral data, Indian Pines and Pavia University, demonstrate competitive performance obtained by the proposed methodology compared with other studied approaches.

Spectral perturbation method for deep learning-based classification of remote sensing hyperspectral images

Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification

A combination method of stacked autoencoder and 3D deep residual network for hyperspectral image classification

Efficient Deep Auto-Encoder Learning for the Classification of Hyperspectral Images

Hyperspectral Image Classification Based on Deep Auto-Encoder and Hidden Markov Random Field.

Hyperspectral Remote Sensing Image Classification Based on Auto-Encoder

Hyper-voxel Based Deep Learning for Hyperspectral Image Classification

Semisupervised Hyperspectral Imagery Classification Based on a Three-Dimensional Convolutional Adversarial Autoencoder Model with Low Sample Requirements

Image classification of hyperspectral remote sensing using semi-supervised learning algorithm

Active Deep Learning for Classification of Hyperspectral Images

Semisupervised Stacked Autoencoder with Cotraining for Hyperspectral Image Classification.

Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification

Wide and Deep Fourier Neural Network for Hyperspectral Remote Sensing Image Classification

Hyperspectral Data Classification Using Margin Infused Relaxed Algorithm

Stacked sparse autoencoder in hyperspectral data classification using spectral-spatial, higher order statistics and multifractal spectrum features

Deep Learning Hyperspectral Image Classification Using Multiple Class-based Denoising Autoencoders, Mixed Pixel Training Augmentation, and Morphological Operations

Self-Supervised Feature Learning Based on Spectral Masking for Hyperspectral Image Classification

Hyperspectral Image Classification Using Spectral–Spatial Double-Branch Attention Mechanism

A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

On combining multiscale deep learning features for the classification of hyperspectral remote sensing imagery

Deep Learning Classification by ResNet-18 Based on the Real Spectral Dataset from Multispectral Remote Sensing Images