Abstract:Hyperspectral unmixing extracts pure spectral constituents (endmembers) and their corresponding abundance fractions from remotely sensed scenes. Most traditional hyperspectral unmixing methods require the results of other endmember extraction algorithms to complete the abundance estimation step. Due to the impressive learning and data fitting capabilities of convolutional neural networks (CNNs), deep learning (DL)-based hyperspectral unmixing technologies have rapidly developed in the literature. According to the procedure used to combine different layers (i.e., fully connected layers, convolution layers, and activation layers), these techniques are mainly divided into three main categories, i.e., those based on autoencoder networks, convolutional neural networks, and convolutional autoencoder networks. They usually extract the weight and output of a specific activation layer as endmember signatures and abundance maps, respectively. Moreover, most existing DL-based unmixing approaches usually use 2-D CNNs to learn the features contained in hyperspectral images, and very few approaches employ 3-D CNNs to extract spectral and spatial information. However, 2-D CNN-based techniques cannot capture good discriminative feature maps from the spectral viewpoint, and 3-D CNN-based techniques usually have high computational overload. In this work, to further exploit the feature extraction capability of CNNs, we combine 3- and 2-D convolutions to propose a cross-convolution unmixing network (CrossCUN) for hyperspectral unmixing. Simultaneously, to better illustrate the improvements of our proposed CrossCUN, we also build the corresponding 2-D convolution unmixing network (2-DCUN) and 3-D convolution unmixing network (3-DCUN). We evaluate the performance of our newly developed networks on two types of synthetic datasets and three real hyperspectral images. Experimental results show that the proposed networks not only obtain better results than other DL-based unmixing methods but also do not require any prior knowledge (e.g., the results of other endmember extraction algorithms) to estimate the abundance maps.

Hyperspectral Unmixing for Additive Nonlinear Models With a 3-D-CNN Autoencoder Network

Hyperspectral Unmixing via Deep Autoencoder Networks for a Generalized Linear-Mixture/Nonlinear-Fluctuation Model

Nonlinear Unmixing of Hyperspectral Data via Deep Autoencoder Networks

Nonlinear Hyperspectral Unmixing based on Multilinear Mixing Model using Convolutional Autoencoders

Hyperspectral Unmixing Network Accounting for Spectral Variability Based on a Modified Scaled and a Perturbed Linear Mixing Model

LSTM-DNN Based Autoencoder Network for Nonlinear Hyperspectral Image Unmixing

A 3-D-CNN Framework for Hyperspectral Unmixing with Spectral Variability

Nonlinear Unmixing of Hyperspectral Data with Partially Linear Least-Squares Support Vector Regression

Hyperspectral Unmixing Based on Spectral and Sparse Deep Convolutional Neural Networks

Hopfield Neural Network Approach for Supervised Nonlinear Spectral Unmixing

Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing

Nonlinear Unmixing Of Hyperspectral Data Based On A Linear-Mixture/Nonlinear-Fluctuation Model

Unsupervised Nonlinear Hyperspectral Unmixing Based on an Extended Multilinear Mixing Model-Inspired Dual-Stream Network

Hyperspecral Unmixing Based on Multilinear Mixing Model Using Convolutional Autoencoders

A Global Spatial-Spectral Feature Fused Autoencoder for Nonlinear Hyperspectral Unmixing

A New Deep Convolutional Network for Effective Hyperspectral Unmixing.

Nonlinear Hyperspectral Unmixing Based on Sparse Non-Negative Matrix Factorization

Cascaded hybrid convolutional autoencoder network for spectral-spatial nonlinear hyperspectral unmixing

Nonlinear Hyperspectral Unmixing Based on Constrained Multiple Kernel NMF

NMF-SAE: an Interpretable Sparse Autoencoder for Hyperspectral Unmixing

Joint Supervised-Unsupervised Nonlinear Unmixing of Hyperspectral Images Using Kernel Method