Abstract:Deep learning-based hyperspectral unmixing (HU) is getting increasing attention in the field of remote sensing, aiming at endmember extraction and abundance estimation at pixel scale. However, many existing deep learning-based unmixing methods base on linear mixing models, neglecting complex nonlinear light scattering interactions. Furthermore, these methods often treat all spectral bands indiscriminately, ignoring characteristic differences between endmembers, hampering endmember separation. To address these issues, we present BU-Net, a novel approach for HU based on the generalized bilinear mixing model (GBM), which is a two-stream stacked autoencoder architecture designed to enhance inter-class separability. In the encoder, we employ 3D convolutions with multiple receptive field to extract multiscale spatial and spectral features simultaneously. Additionally, we design a novel band selection based on inter-class separability (BSICS), which identifies bands with inter-class separability (BICS) and the obtained bands are taken as an additional stream for improving performance. In the decoder, BU-Net develops a two-stream structure encompassing linear and bilinear elements, aligning with the theoretical components and constraints of GBM. To further enhance separability between endmembers during training, we use the spectral angle distance between BICS and its reconstruction as a loss regularization term. Moreover, we utilize materials' representative pixels obtained in the process of BSICS to initialize endmembers, which offers effective guidance for modeling the spectral properties. Experimental results on synthetic and real hyperspectral datasets show that our method outperforms state-of-the-art methods. This novel approach addresses limitations of linear mixing models while leveraging deep learning to improve accuracy of HU.

Dual Branch Autoencoder Network for Spectral-Spatial Hyperspectral Unmixing

Autoencoder Network for Hyperspectral Unmixing with Adaptive Abundance Smoothing

Hyperspectral Unmixing Network Accounting for Spectral Variability Based on a Modified Scaled and a Perturbed Linear Mixing Model

Unidirectional Local-Attention Autoencoder Network for Spectral Variability Unmixing

A Global Spatial-Spectral Feature Fused Autoencoder for Nonlinear Hyperspectral Unmixing

SSCU-Net: Spatial–Spectral Collaborative Unmixing Network for Hyperspectral Images

DSFC-AE: A New Hyperspectral Unmixing Method Based on Deep Shared Fully Connected Autoencoder

A Multi-Attention Autoencoder for Hyperspectral Unmixing Based on the Extended Linear Mixing Model

Cascaded hybrid convolutional autoencoder network for spectral-spatial nonlinear hyperspectral unmixing

Correntropy-Based Spatial-Spectral Robust Sparsity-Regularized Hyperspectral Unmixing

Deep Autoencoders With Multitask Learning for Bilinear Hyperspectral Unmixing

An Improved Hyperspectral Unmixing Approach Based on a Spatial–Spectral Adaptive Nonlinear Unmixing Network

Unsupervised Nonlinear Hyperspectral Unmixing Based on an Extended Multilinear Mixing Model-Inspired Dual-Stream Network

DAEN: Deep Autoencoder Networks for Hyperspectral Unmixing

SSANet: An Adaptive Spectral–Spatial Attention Autoencoder Network for Hyperspectral Unmixing

Multi-stream pyramid collaborative network for spectral unmixing

A Two-Stream Stacked Autoencoder With Inter-Class Separability for Bilinear Hyperspectral Unmixing

SpACNN-LDVAE: Spatial Attention Convolutional Latent Dirichlet Variational Autoencoder for Hyperspectral Pixel Unmixing

NMF-SAE: an Interpretable Sparse Autoencoder for Hyperspectral Unmixing

Spectral–Spatial Feature Extraction With Dual Graph Autoencoder for Hyperspectral Image Clustering

Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing