Abstract:Linear spectral unmixing is an essential technique in hyperspectral image (HSI) processing and interpretation. In recent years, deep learning-based approaches have shown great promise in hyperspectral unmixing (HU), in particular, unsupervised unmixing methods based on autoencoder (AE) networks are a recent trend. The AE model, which automatically learns low-dimensional representations (abundances) and reconstructs data with their corresponding bases (endmembers), has achieved superior performance in HU. In this article, we explore the effective utilization of spatial and spectral information in AE-based unmixing networks. Important findings on the use of spatial and spectral information in the AE framework are discussed. Inspired by these findings, we propose a spatial–spectral collaborative unmixing network, called SSCU-Net, which learns a spatial AE network and a spectral AE network in an end-to-end manner to more effectively improve the unmixing performance. SSCU-Net is a two-stream deep network and shares an alternating architecture, where the two AE networks are efficiently trained in a collaborative way for estimation of endmembers and abundances. Meanwhile, we propose a new spatial AE network by introducing a superpixel segmentation method based on abundance information, which greatly facilitates the employment of spatial information and improves the accuracy of unmixing network. Moreover, extensive ablation studies are carried out to investigate the performance gain of SSCU-Net. Experimental results on both synthetic and real hyperspectral datasets illustrate the effectiveness and competitiveness of the proposed SSCU-Net compared with several state-of-the-art HU methods.

Scattering Transform Framework For Unmixing Of Hyperspectral Data

Correntropy-Based Spatial-Spectral Robust Sparsity-Regularized Hyperspectral Unmixing

Spectral and Spatial Complexity-Based Hyperspectral Unmixing

Hyperspectral Unmixing Network Accounting for Spectral Variability Based on a Modified Scaled and a Perturbed Linear Mixing Model

Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing

Half-quadratic Based Robust Hyperspectral Unmixing Framework

Deep spectral convolution network for hyperspectral image unmixing with spectral library

Hyperspectral Unmixing Via Total Variation Regularized Nonnegative Tensor Factorization.

Nonlocal Low-Rank Nonnegative Tensor Factorization for Hyperspectral Unmixing

Hypergraph-Regularized Sparse NMF for Hyperspectral Unmixing.

Kernel Based Sparse NMF Algorithm for Hyperspectral Unmixing

Superpixel-Based Nonnegative Tensor Factorization for Hyperspectral Unmixing

Structured Sparse Method for Hyperspectral Unmixing

A Kernel Spatial Complexity-Based Nonlinear Unmixing Method of Hyperspectral Imagery.

Three-Dimensional Fourier Scattering Transform and Classification of Hyperspectral Images

A Variable-Iterative Fully Convolutional Neural Network for Sparse Unmixing

Spatial-spectral collaborative attention network for hyperspectral unmixing

Curvelet Transform Domain-Based Sparse Nonnegative Matrix Factorization for Hyperspectral Unmixing

UST-Net: A U-Shaped Transformer Network Using Shifted Windows for Hyperspectral Unmixing

Unleashing the full potential of hyperspectral imaging: Decoupled image and frequency-domain spatial–spectral framework

SSCU-Net: Spatial–Spectral Collaborative Unmixing Network for Hyperspectral Images