Abstract:Recently, Hyperspectral Image (HSI) classification methods based on deep learning models have shown encouraging performance. However, the limited numbers of training samples, as well as the mixed pixels due to low spatial resolution, have become major obstacles for HSI classification. To tackle these problems, we propose a resource-efficient HSI classification framework which introduces adaptive spectral unmixing into a 3D/2D dense network with early-exiting strategy. More specifically, on one hand, our framework uses a cascade of intermediate classifiers throughout the 3D/2D dense network that is trained end-to-end. The proposed 3D/2D dense network that integrates 3D convolutions with 2D convolutions is more capable of handling spectral-spatial features, while containing fewer parameters compared with the conventional 3D convolutions, and further boosts the network performance with limited training samples. On another hand, considering the existence of mixed pixels in HSI data, the pixels in HSI classification are divided into hard samples and easy samples. With the early-exiting strategy in these intermediate classifiers, the average accuracy can be improved by reducing the amount of computation cost for easy samples, thus focusing on classifying hard samples. Furthermore, for hard samples, an adaptive spectral unmixing method is proposed as a complementary source of information for classification, which brings considerable benefits to the final performance. Experimental results on four HSI benchmark datasets demonstrate that the proposed method can achieve better performance than state-of-the-art deep learning-based methods and other traditional HSI classification methods.

Dual-Path Optimization Network Based on Spectral Unmixing for Hyperspectral and Multispectral Image Fusion

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

HYPERSPECTRAL AND MULTISPECTRAL IMAGE FUSION USING DUAL-SOURCE LOCALIZED DICTIONARY PAIR

A Dual-Stream Convolutional Feature Fusion Network for Hyperspectral Unmixing

Hyperspectral and Multispectral Image Fusion Via Nonlocal Low-Rank Tensor Decomposition and Spectral Unmixing

Hyperspectral and Multispectral Image Fusion with Dual-Source Spatial-Spectral Dictionary.

Multi-Spectral and Panchromatic Image Fusion Based on His-Wavelet Transform and Mopso Algorithm

Cycle-Consistent Sparse Unmixing Network Based on Deep Image Prior

Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing

A Dual-UNet With Multistage Details Injection for Hyperspectral Image Fusion

Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model

Dual-Stream Attention Network for Hyperspectral Image Unmixing

A Deep Unfolding Network for Multispectral and Hyperspectral Image Fusion

Multispectral and Hyperspectral Image Fusion by MS/HS Fusion Net.

Combining Spectral Unmixing and 3D/2D Dense Networks with Early-Exiting Strategy for Hyperspectral Image Classification.

Dual-Channel Enhanced Decoder Network for Blind Hyperspectral Unmixing

UMAG-Net: A New Unsupervised Multiattention-Guided Network for Hyperspectral and Multispectral Image Fusion

Hyperspectral Image Resolution Enhancement Using High-Resolution Multispectral Image Based on Spectral Unmixing

Coupled Matrix Factorization Constrained Deep Hyperspectral and Multispectral Image Fusion

Hyperspectral and Multispectral Image Fusion - From Model-Driven to Data-Driven.