Abstract:Supervised approaches classify input data using a set of representative samples for each class, known as training samples. The collection of such samples is expensive and time demanding. Hence, unsupervised feature learning, which has a quick access to arbitrary amounts of unlabeled data, is conceptually of high interest. In this paper, we propose a novel network architecture, fully Conv-Deconv network, for unsupervised spectral-spatial feature learning of hyperspectral images, which is able to be trained in an end-to-end manner. Specifically, our network is based on the so-called encoder-decoder paradigm, i.e., the input 3-D hyperspectral patch is first transformed into a typically lower dimensional space via a convolutional subnetwork (encoder), and then expanded to reproduce the initial data by a deconvolutional subnetwork (decoder). However, during the experiment, we found that such a network is not easy to be optimized. To address this problem, we refine the proposed network architecture by incorporating: 1) residual learning and 2) a new unpooling operation that can use memorized max-pooling indexes. Moreover, to understand the “black box,” we make an in-depth study of the learned feature maps in the experimental analysis. A very interesting discovery is that some specific “neurons” in the first residual block of the proposed network own good description power for semantic visual patterns in the object level, which provide an opportunity to achieve “free” object detection. This paper, for the first time in the remote sensing community, proposes an end-to-end fully Conv-Deconv network for unsupervised spectral-spatial feature learning. Moreover, this paper also introduces an in-depth investigation of learned features. Experimental results on two widely used hyperspectral data, Indian Pines and Pavia University, demonstrate competitive performance obtained by the proposed methodology compared with other studied approaches.

Hyperspectral Intrinsic Image Decomposition Based on Physical Prior-Driven Unsupervised Learning

An Unsupervised Dehazing Network With Hybrid Prior Constraints for Hyperspectral Image

Intrinsic Image Decomposition by Pursuing Reflectance Image.

Unsupervised Intrinsic Image Decomposition with LiDAR Intensity Enhanced Training

Deep Intrinsic Decomposition With Adversarial Learning for Hyperspectral Image Classification

Hyperspectral Reconstruction From RGB Images via Physically Guided Graph Deep Prior Learning

Intrinsic Image Decomposition via Ordinal Shading

Self-Supervised Learning Hyperspectral Image Denoiser with Separated Spectral-Spatial Feature Extraction.

A Deep Unfolding Network Based on Intrinsic Image Decomposition for Pansharpening

Intrinsic Decomposition from a Single Spectral Image.

Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification

Deep Intrinsic Image Decomposition Using Joint Parallel Learning.

Deep Unsupervised Blind Hyperspectral and Multispectral Data Fusion

Hyperspectral Denoising Using Unsupervised Disentangled Spatio-Spectral Deep Priors

Hyperspectral Denoising Using Unsupervised Disentangled Spatiospectral Deep Priors

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

Hyperspectral Compressive Image Reconstruction With Deep Tucker Decomposition and Spatial–Spectral Learning Network

Multispectral Image Intrinsic Decomposition via Subspace Constraint

HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging

A New Dataset and Deep Residual Spectral Spatial Network for Hyperspectral Image Classification