Abstract:In the compressive spectral imaging (CSI) framework, different architectures have been proposed to recover high-resolution spectral images from compressive measurements. Since CSI architectures compactly capture the relevant information of the spectral image, various methods that extract classification features from compressive samples have been recently proposed. However, these techniques require a feature extraction procedure that reorders measurements using the information embedded in the coded aperture patterns. In this paper, a method that fuses features directly from dual-resolution compressive measurements is proposed for spectral image classification. More precisely, the fusion method is formulated as an inverse problem that estimates high-spatial-resolution and low-dimensional feature bands from compressive measurements. To this end, the decimation matrices that describe the compressive measurements as degraded versions of the fused features are mathematically modeled using the information embedded in the coded aperture patterns. Furthermore, we include both a sparsity-promoting and a total-variation (TV) regularization terms to the fusion problem in order to consider the correlations between neighbor pixels, and therefore, improve the accuracy of pixel-based classifiers. To solve the fusion problem, we describe an algorithm based on the accelerated variant of the alternating direction method of multipliers (accelerated-ADMM). Additionally, a classification approach that includes the developed fusion method and a multilayer neural network is introduced. Finally, the proposed approach is evaluated on three remote sensing spectral images and a set of compressive measurements captured in the laboratory. Extensive simulations show that the proposed classification approach outperforms other approaches under various performance metrics.

Image fusion in compressed sensing

IEF-CSNET: Information Enhancement and Fusion Network for Compressed Sensing Reconstruction

Compressed Sensing Fourier Single Pixel Imaging Algorithm Based on Joint Discrete Gradient and Non-Local Self-Similarity Priors

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Compressive Single-Pixel Spectral Imaging with Spatial-Spectral Modulation Optimization Via Coherence Minimization

Gradient-based Compressive Image Fusion

Image Reconstruction Via Small Block-Based Compressed Sensing and Discrete Legendre Polynomials

PCNN-Based Image Fusion in Compressed Domain

Image Reconstruction Based on Sub-Gaussian Random Projection

Classification-based image-fusion framework for compressive imaging

Image Compressed Sensing Reconstruction with 3D Transform Domain Collaborative Filtering

Novel data fusion strategy based on Bayesian compressive sensing in cognitive WSN

Compressive sensing image fusion in heterogeneous sensor networks based on shearlet and wavelet transform

Feature Fusion via Dual-resolution Compressive Measurement Matrix Analysis For Spectral Image Classification

An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain

A multi-source image fusion algorithm based on gradient regularized convolution sparse representation

Compressed Multi-view Imaging with Joint Reconstruction

Compressed Sensing Image Reconstruction with Fast Convolution Filtering

Image compressive sensing via hybrid regularization combining centralized group sparse representation and deep denoiser prior

FusionOpt-Net: A Transformer-Based Compressive Sensing Reconstruction Algorithm

Region-Based Image-Fusion Framework for Compressive Imaging