Abstract:Hyperspectral unmixing extracts pure spectral constituents (endmembers) and their corresponding abundance fractions from remotely sensed scenes. Most traditional hyperspectral unmixing methods require the results of other endmember extraction algorithms to complete the abundance estimation step. Due to the impressive learning and data fitting capabilities of convolutional neural networks (CNNs), deep learning (DL)-based hyperspectral unmixing technologies have rapidly developed in the literature. According to the procedure used to combine different layers (i.e., fully connected layers, convolution layers, and activation layers), these techniques are mainly divided into three main categories, i.e., those based on autoencoder networks, convolutional neural networks, and convolutional autoencoder networks. They usually extract the weight and output of a specific activation layer as endmember signatures and abundance maps, respectively. Moreover, most existing DL-based unmixing approaches usually use 2-D CNNs to learn the features contained in hyperspectral images, and very few approaches employ 3-D CNNs to extract spectral and spatial information. However, 2-D CNN-based techniques cannot capture good discriminative feature maps from the spectral viewpoint, and 3-D CNN-based techniques usually have high computational overload. In this work, to further exploit the feature extraction capability of CNNs, we combine 3- and 2-D convolutions to propose a cross-convolution unmixing network (CrossCUN) for hyperspectral unmixing. Simultaneously, to better illustrate the improvements of our proposed CrossCUN, we also build the corresponding 2-D convolution unmixing network (2-DCUN) and 3-D convolution unmixing network (3-DCUN). We evaluate the performance of our newly developed networks on two types of synthetic datasets and three real hyperspectral images. Experimental results show that the proposed networks not only obtain better results than other DL-based unmixing methods but also do not require any prior knowledge (e.g., the results of other endmember extraction algorithms) to estimate the abundance maps.

TCCU-Net: Transformer and CNN Collaborative Unmixing Network for Hyperspectral Image

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

CTNet: an Efficient Coupled Transformer Network for Robust Hyperspectral Unmixing

Hyperspectral Unmixing Based on Spectral and Sparse Deep Convolutional Neural Networks

SSCU-Net: Spatial–Spectral Collaborative Unmixing Network for Hyperspectral Images

Spatial-spectral collaborative attention network for hyperspectral unmixing

A New Deep Convolutional Network for Effective Hyperspectral Unmixing.

Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution

Hyperspectral Unmixing Via Deep Convolutional Neural Networks

MSCC-ViT:A Multiscale Visual-Transformer Network Using Convolution Crossing Attention for Hyperspectral Unmixing

A Dual-Stream Convolutional Feature Fusion Network for Hyperspectral Unmixing

UST-Net: A U-Shaped Transformer Network Using Shifted Windows for Hyperspectral Unmixing

Multi-stream pyramid collaborative network for spectral unmixing

Multiview Siamese Collaborative Network for Hyperspectral Image Unmixing

Endmember-Guided Unmixing Network (EGU-Net): A General Deep Learning Framework for Self-Supervised Hyperspectral Unmixing

Transformer based Endmember Fusion with Spatial Context for Hyperspectral Unmixing

CMTNet: Convolutional Meets Transformer Network for Hyperspectral Images Classification

A Variable-Iterative Fully Convolutional Neural Network for Sparse Unmixing

Deep spectral convolution network for hyperspectral image unmixing with spectral library

Convolution Transformer Fusion Splicing Network for Hyperspectral Image Classification

An Effective Unmixing Network for Deep Spectral Information Extraction