Abstract:Supervised approaches classify input data using a set of representative samples for each class, known as training samples. The collection of such samples is expensive and time demanding. Hence, unsupervised feature learning, which has a quick access to arbitrary amounts of unlabeled data, is conceptually of high interest. In this paper, we propose a novel network architecture, fully Conv-Deconv network, for unsupervised spectral-spatial feature learning of hyperspectral images, which is able to be trained in an end-to-end manner. Specifically, our network is based on the so-called encoder-decoder paradigm, i.e., the input 3-D hyperspectral patch is first transformed into a typically lower dimensional space via a convolutional subnetwork (encoder), and then expanded to reproduce the initial data by a deconvolutional subnetwork (decoder). However, during the experiment, we found that such a network is not easy to be optimized. To address this problem, we refine the proposed network architecture by incorporating: 1) residual learning and 2) a new unpooling operation that can use memorized max-pooling indexes. Moreover, to understand the “black box,” we make an in-depth study of the learned feature maps in the experimental analysis. A very interesting discovery is that some specific “neurons” in the first residual block of the proposed network own good description power for semantic visual patterns in the object level, which provide an opportunity to achieve “free” object detection. This paper, for the first time in the remote sensing community, proposes an end-to-end fully Conv-Deconv network for unsupervised spectral-spatial feature learning. Moreover, this paper also introduces an in-depth investigation of learned features. Experimental results on two widely used hyperspectral data, Indian Pines and Pavia University, demonstrate competitive performance obtained by the proposed methodology compared with other studied approaches.

Spatial Revising Variational Autoencoder-Based Feature Extraction Method for Hyperspectral Images

Learning sensor-specific features for hyperspectral images via 3-dimensional convolutional autoencoder

Unsupervised Spatial–Spectral Feature Learning by 3D Convolutional Autoencoder for Hyperspectral Classification

Learning a Deep Structural Subspace Across Hyperspectral Scenes with Cross-Domain VAE

Hyperspectral Anomaly Detection with Auto-Encoder and Independent Target

Dual Branch Autoencoder Network for Spectral-Spatial Hyperspectral Unmixing

Hyperspectral Anomaly Detection with CNN-Based VAE and RX Algorithm

Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network.

DSFC-AE: A New Hyperspectral Unmixing Method Based on Deep Shared Fully Connected Autoencoder

A Superpixel-Based Relational Auto-Encoder For Feature Extraction Of Hyperspectral Images

Spectral–Spatial Feature Extraction With Dual Graph Autoencoder for Hyperspectral Image Clustering

Hyperspectral Image Reconstruction Based on Improved Residual Dense Network

Improving Spectral-Based Endmember Finding by Exploring Spatial Context for Hyperspectral Unmixing

CVA2E: A Conditional Variational Autoencoder with an Adversarial Training Process for Hyperspectral Imagery Classification

Unsupervised Multi-Level Feature Extraction for Improvement of Hyperspectral Classification

Attention-Enhanced Generative Adversarial Network for Hyperspectral Imagery Spatial Super-Resolution

A Multi-Attention Autoencoder for Hyperspectral Unmixing Based on the Extended Linear Mixing Model

Unidirectional Local-Attention Autoencoder Network for Spectral Variability Unmixing

Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images

Spatial Feature Enhancement and Attention-Guided Bidirectional Sequential Spectral Feature Extraction for Hyperspectral Image Classification

Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification