Abstract:Hyperspectral unmixing is a vibrant research field that focuses on the task of decomposing mixed pixels into a collection of pure spectral signatures, known as endmembers, along with their corresponding fractional abundances. Conventional unmixing algorithms often need to combine two techniques, namely endmember extraction and abundance estimation, to accomplish the unmixing task. Recently, deep learning (DL) has succeeded in the field of hyperspectral unmixing due to its strong feature learning and data-fitting capabilities. By extracting the output and weight of a particular layer as abundance maps and endmember signatures, available DL methods can directly unmix hyperspectral images. However, to improve the performance of spectral unmixing, such available DL methods frequently employ the results of endmember extraction algorithms—in most cases, the well-known vertex component analysis (VCA)—as the initial weights, which leads to significant limitations in their performance: 1) the unmixing results are heavily dependent on the initialization given by VCA and 2) the randomness of VCA is passed to the unmixing network. In this article, we design a new method called abundance-guided spectral and spatial network (A2SN) that not only skips the weights to extract endmember features directly from the network, but also estimates the abundance maps and reconstructs images directly. In particular, the proposed A2SN employs different kernels to capture spectral and spatial information. We also propose an abundance-guided attention spectral and spatial attention network (A2SAN) for hyperspectral unmixing by integrating attention mechanisms into A2SN. As a result, A2SAN is a completely innovative unmixing method that employs attention and reconstruction directly for hyperspectral unmixing, rather than just as modules for information extraction. Most importantly, both A2SN and A2SAN use a weighted summation of the feature maps to reconstruct the image and increase the noise immunity of the network. Experimental results, conducted on both synthetic and real datasets, demonstrate the effectiveness and superiority of A2SN and A2SAN over state-of-the-art unmixing methods. Our full code is released at https://github.com/xuanwentao/A2SN-and-A2SAN for public evaluation.

Hyperspectral Unmixing Based on Spectral and Sparse Deep Convolutional Neural Networks

Hyperspectral Unmixing Network Accounting for Spectral Variability Based on a Modified Scaled and a Perturbed Linear Mixing Model

Realistic Mixing Miniature Scene Hyperspectral Unmixing: from Benchmark Datasets to Autonomous Unmixing

Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing

Deep spectral convolution network for hyperspectral image unmixing with spectral library

Correntropy-Based Spatial-Spectral Robust Sparsity-Regularized Hyperspectral Unmixing

Unsupervised Hyperspectral Unmixing Based on Constrained Nonnegative Matrix Factorization and Particle Swarm Optimization

A Variable-Iterative Fully Convolutional Neural Network for Sparse Unmixing

Nonlinear Hyperspectral Unmixing Based on Sparse Non-Negative Matrix Factorization

Hyperspectral Unmixing Using Sparsity-Constrained Deep Nonnegative Matrix Factorization With Total Variation

Hypergraph-Regularized Sparse NMF for Hyperspectral Unmixing.

TCCU-Net: Transformer and CNN Collaborative Unmixing Network for Hyperspectral Image

SSCU-Net: Spatial–Spectral Collaborative Unmixing Network for Hyperspectral Images

Kernel Based Sparse NMF Algorithm for Hyperspectral Unmixing

ADMM-Based Hyperspectral Unmixing Networks for Abundance and Endmember Estimation

A Global Spatial-Spectral Feature Fused Autoencoder for Nonlinear Hyperspectral Unmixing

An Abundance-Guided Attention Network for Hyperspectral Unmixing

DSFC-AE: A New Hyperspectral Unmixing Method Based on Deep Shared Fully Connected Autoencoder

Superpixel-Based Reweighted Low-Rank and Total Variation Sparse Unmixing for Hyperspectral Remote Sensing Imagery

Nonlinear Hyperspectral Unmixing based on Multilinear Mixing Model using Convolutional Autoencoders