Abstract:Supervised approaches classify input data using a set of representative samples for each class, known as training samples. The collection of such samples is expensive and time demanding. Hence, unsupervised feature learning, which has a quick access to arbitrary amounts of unlabeled data, is conceptually of high interest. In this paper, we propose a novel network architecture, fully Conv-Deconv network, for unsupervised spectral-spatial feature learning of hyperspectral images, which is able to be trained in an end-to-end manner. Specifically, our network is based on the so-called encoder-decoder paradigm, i.e., the input 3-D hyperspectral patch is first transformed into a typically lower dimensional space via a convolutional subnetwork (encoder), and then expanded to reproduce the initial data by a deconvolutional subnetwork (decoder). However, during the experiment, we found that such a network is not easy to be optimized. To address this problem, we refine the proposed network architecture by incorporating: 1) residual learning and 2) a new unpooling operation that can use memorized max-pooling indexes. Moreover, to understand the “black box,” we make an in-depth study of the learned feature maps in the experimental analysis. A very interesting discovery is that some specific “neurons” in the first residual block of the proposed network own good description power for semantic visual patterns in the object level, which provide an opportunity to achieve “free” object detection. This paper, for the first time in the remote sensing community, proposes an end-to-end fully Conv-Deconv network for unsupervised spectral-spatial feature learning. Moreover, this paper also introduces an in-depth investigation of learned features. Experimental results on two widely used hyperspectral data, Indian Pines and Pavia University, demonstrate competitive performance obtained by the proposed methodology compared with other studied approaches.

Spectral–spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks

A Deep Learning Framework for Hyperspectral Image Classification Using Spatial Pyramid Pooling

Deep Learning-Based Classification of Hyperspectral Data

Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural Network

Hyperspectral image classification using principle component analysis and deep convolutional neural network

Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

Classification Based On Deep Convolutional Neural Networks With Hyperspectral Image

Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach

Deep Convolutional Neural Networks for Hyperspectral Image Classification

S DCN: Spectral–Spatial Difference Convolution Network for Hyperspectral Image Classification

Convolutional Neural Network Based Classification for Hyperspectral Data

Hyperspectral Image Classification With Deep Learning Models

Spectral-spatial classification of hyperspectral imagery based on recurrent neural networks

Spatial-Spectral Network for Hyperspectral Image Classification: A 3-D CNN and Bi-LSTM Framework

Spectral-Spatial Classification of Hyperspectral Image Using Autoencoders

Integrating Convolutional Neural Network and Gated Recurrent Unit for Hyperspectral Image Spectral-Spatial Classification.

Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification

Hyperspectral Classification Based on Spectral-Spatial Convolutional Neural Networks

Deep Convolutional Networks with Superpixel Segmentation for Hyperspectral Image Classification

Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification

Active Deep Densely Connected Convolutional Network for Hyperspectral Image Classification