Abstract:Linear spectral unmixing is an important technique in the analysis of mixed pixels in hyperspectral images. In recent years, deep learning-based methods have been garnering increasing attention in hyperspectral unmixing; especially, unsupervised autoencoder (AE) networks that have achieved excellent unmixing performance are a recent trend. While most approaches use spatial information, it is well known that hyperspectral data are characterized by a large number of narrow spectral bands. In order to take full advantage of the hyperspectral bands in unmixing and the spatial information, in this article, we explore multiview spectral and spatial information in an AE-based unmixing framework. We introduce multiview spectral information through spectral partitioning and propose a multiview spatial–spectral two-stream network, called MSSS-Net, which simultaneously learns a spatial stream network and a multiview spectral stream network in an end-to-end fashion for more efficient unmixing. The MSSS-Net is a two-stream deep unmixing network sharing a decoder, where its two AE networks employ recurrent neural networks (RNNs) to collaboratively utilize multiview spectral and spatial information. The spatial stream network branch extracts the spatial features of pixels and its neighbors, while the multiview spectral stream network branch exploits the multiview spectral bands of a pixel. Meanwhile, we design a cascaded bidirectional and unidirectional RNNs’ encoder structure for multiview spatial–spectral information to learn more discriminative deep patch-pixel features. Extensive ablation studies and experiments on both synthetic and real datasets demonstrate the superiority of the MSSS-Net over state-of-the-art unmixing methods.

Multiview Siamese Collaborative Network for Hyperspectral Image Unmixing

Multiview Spatial–Spectral Two-Stream Network for Hyperspectral Image Unmixing

Region-Based Multiview Sparse Hyperspectral Unmixing Incorporating Spectral Library

Spectral–Spatial-Weighted Multiview Collaborative Sparse Unmixing for Hyperspectral Images

SSCU-Net: Spatial–Spectral Collaborative Unmixing Network for Hyperspectral Images

Multi-stream pyramid collaborative network for spectral unmixing

Hyperspectral Unmixing Network Accounting for Spectral Variability Based on a Modified Scaled and a Perturbed Linear Mixing Model

TCCU-Net: Transformer and CNN Collaborative Unmixing Network for Hyperspectral Image

Superpixel construction for hyperspectral unmixing.

Unsupervised Nonlinear Hyperspectral Unmixing Based on an Extended Multilinear Mixing Model-Inspired Dual-Stream Network

Dual Branch Autoencoder Network for Spectral-Spatial Hyperspectral Unmixing

Spectral Variability Augmented Two-Stream Network for Hyperspectral Sparse Unmixing

A Dual-Stream Convolutional Feature Fusion Network for Hyperspectral Unmixing

Unrolling Plug-and-Play Network for Hyperspectral Unmixing

Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing

Multiscale Convolutional Mask Network for Hyperspectral Unmixing

EMLM-Net: An Extended Multilinear Mixing Model-Inspired Dual-Stream Network for Unsupervised Nonlinear Hyperspectral Unmixing

Multi-stage convolutional autoencoder network for hyperspectral unmixing

Deep spectral convolution network for hyperspectral image unmixing with spectral library

Hyperspectral Unmixing Based on Spectral and Sparse Deep Convolutional Neural Networks

Spatial-spectral collaborative attention network for hyperspectral unmixing