Abstract:Linear spectral unmixing is an important technique in the analysis of mixed pixels in hyperspectral images. In recent years, deep learning-based methods have been garnering increasing attention in hyperspectral unmixing; especially, unsupervised autoencoder (AE) networks that have achieved excellent unmixing performance are a recent trend. While most approaches use spatial information, it is well known that hyperspectral data are characterized by a large number of narrow spectral bands. In order to take full advantage of the hyperspectral bands in unmixing and the spatial information, in this article, we explore multiview spectral and spatial information in an AE-based unmixing framework. We introduce multiview spectral information through spectral partitioning and propose a multiview spatial–spectral two-stream network, called MSSS-Net, which simultaneously learns a spatial stream network and a multiview spectral stream network in an end-to-end fashion for more efficient unmixing. The MSSS-Net is a two-stream deep unmixing network sharing a decoder, where its two AE networks employ recurrent neural networks (RNNs) to collaboratively utilize multiview spectral and spatial information. The spatial stream network branch extracts the spatial features of pixels and its neighbors, while the multiview spectral stream network branch exploits the multiview spectral bands of a pixel. Meanwhile, we design a cascaded bidirectional and unidirectional RNNs’ encoder structure for multiview spatial–spectral information to learn more discriminative deep patch-pixel features. Extensive ablation studies and experiments on both synthetic and real datasets demonstrate the superiority of the MSSS-Net over state-of-the-art unmixing methods.

Unsupervised Nonlinear Hyperspectral Unmixing Based on an Extended Multilinear Mixing Model-Inspired Dual-Stream Network

EMLM-Net: An Extended Multilinear Mixing Model-Inspired Dual-Stream Network for Unsupervised Nonlinear Hyperspectral Unmixing

Hopfield Neural Network Approach for Supervised Nonlinear Spectral Unmixing

Hyperspectral Unmixing Network Accounting for Spectral Variability Based on a Modified Scaled and a Perturbed Linear Mixing Model

A Coarse-to-Fine Scheme for Unsupervised Nonlinear Hyperspectral Unmixing Based on an Extended Multilinear Mixing Model.

Spectral–Spatial Reweighted Robust Nonlinear Unmixing for Hyperspectral Images Based on an Extended Multilinear Mixing Model

Nonlinear Hyperspectral Unmixing based on Multilinear Mixing Model using Convolutional Autoencoders

A Graph Regularized Multilinear Mixing Model for Nonlinear Hyperspectral Unmixing.

Multiview Spatial–Spectral Two-Stream Network for Hyperspectral Image Unmixing

Robust Nonlinear Unmixing for Hyperspectral Images Based on an Extended Multilinear Mixing Model

Hyperspectral Unmixing via Deep Autoencoder Networks for a Generalized Linear-Mixture/Nonlinear-Fluctuation Model

Unsupervised Nonlinear Hyperspectral Unmixing Based on the Generalized Bilinear Model

Deep Autoencoders With Multitask Learning for Bilinear Hyperspectral Unmixing

Unrolling Plug-and-Play Network for Hyperspectral Unmixing

Hyperspecral Unmixing Based on Multilinear Mixing Model Using Convolutional Autoencoders

ADMM-Based Hyperspectral Unmixing Networks for Abundance and Endmember Estimation

Joint Supervised-Unsupervised Nonlinear Unmixing of Hyperspectral Images Using Kernel Method

Dual Branch Autoencoder Network for Spectral-Spatial Hyperspectral Unmixing

Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing

Autoencoder Network for Hyperspectral Unmixing with Adaptive Abundance Smoothing

A Dual-Stream Convolutional Feature Fusion Network for Hyperspectral Unmixing