Abstract:We present a method for hyperspectral pixel unmixing. The proposed method assumes that 1) abundances can be encoded as Dirichlet distributions and 2) spectra of endmembers can be represented as multivariate normal distributions. The method solves the problem of abundance estimation and endmember extraction within a variational autoencoder setting where a Dirichlet bottleneck layer models the abundances, and the decoder performs endmember extraction. The proposed method can also leverage the transfer learning paradigm, where the model is only trained on synthetic data containing pixels that are linear combinations of one or more endmembers of interest. In this case, we retrieve endmembers (spectra) from the United States Geological Survey Spectral Library. The model thus trained can be subsequently used to perform pixel unmixing on "real data" that contains a subset of the endmembers used to generate the synthetic data. The model achieves state-of-the-art results on several benchmarks: Cuprite, Urban Hydice, and Samson. We also present a new synthetic dataset, OnTech-HSI-Syn-21, that can be used to study hyperspectral pixel unmixing methods. We showcase the transfer learning capabilities of the proposed model on Cuprite and OnTech-HSI-Syn-21 datasets. In summary, the proposed method can be applied for pixel unmixing in a variety of domains, including agriculture, forestry, mineralogy, analysis of materials, and healthcare. In addition, the proposed method eschews the need for labeled data for training by leveraging the transfer learning paradigm, where the model is trained on synthetic data generated using the endmembers present in the "real" data.

Hyperspectral Unmixing with Endmember Variability using Semi-supervised Partial Membership Latent Dirichlet Allocation

Nonnegative-Matrix-Factorization-Based Hyperspectral Unmixing with Partially Known Endmembers

Autonomous Endmember Detection Via an Abundance Anomaly Guided Saliency Prior for Hyperspectral Imagery

Blind Spectral Unmixing Based on Sparse Component Analysis for Hyperspectral Remote Sensing Imagery

Hyperspectral Unmixing with Scaled and Perturbed Linear Mixing Model to Address Spectral Variability

Hyperspectral Unmixing Network Accounting for Spectral Variability Based on a Modified Scaled and a Perturbed Linear Mixing Model

Nonlinear Spectral Mixture Analysis by Determining Per-Pixel Endmember Sets

Linear Mixture Analysis for Hyperspectral Imagery in the Presence of Less Prevalent Materials

Hyperspectral Unmixing Under Endmember Variability: A Variational Inference Framework

Band Selection Based Hyperspectral Unmixing

Correntropy-Based Spatial-Spectral Robust Sparsity-Regularized Hyperspectral Unmixing

Multi-endmember hierarchical mixture analysis algorithm for spectra

Spectral and Spatial Complexity-Based Hyperspectral Unmixing

Unsupervised Hyperspectral Unmixing Based on Constrained Nonnegative Matrix Factorization and Particle Swarm Optimization

A spatial-spectral clustering-based algorithm for endmember extraction and hyperspectral unmixing

Unsupervised Nonlinear Hyperspectral Unmixing Based on the Generalized Bilinear Model

Hyperspectral Unmixing via Latent Multiheterogeneous Subspace

Hierarchical alternating least squares algorithm with Sparsity Constraint for hyperspectral unmixing

An improved multi-endmember hyperspectral unmixing algorithm

Hyperspectral Pixel Unmixing With Latent Dirichlet Variational Autoencoder

Endmember Bundle Extraction Based On Pure Pixel Index And Superpixel Segmentation