Abstract:Sparse representation (SR)-based hyperspectral image (HSI) denoising methods normally average the local denoising results of multiple overlapped cubes to recover the whole HSI. Though interpretable, they rely on cumbersome hyperparameter settings and ignore the relationship between overlapped cubes, leading to poor denoising performance. This article combines SR and convolutional neural networks and introduces a deep parameterized sparse neural network (DPNet-S) to address the above issues. DPNet-S parameterizes the SR-based HSI denoising model with two modules: 1) sparse optimizer to extract sparse feature maps from noisy HSIs via recurrent usage of convolution, deconvolution, and soft shrinkage operations; and 2) image reconstructor to recover the denoised HSI from its sparse feature maps via deconvolution operations. We further replace the soft shrinkage operator with U-Net architecture to account for general HSI priors and more effectively capture the complex structures of HSIs, resulting in DPNet-U. Both networks directly learn the parameters from data and perform denoising on the whole HSI, which overcomes the limitations of SR-based methods. Moreover, our networks are generated from the denoising model and optimization procedures, thus leveraging the knowledge embedded and relying less on the number of training samples. Extensive experiments on both synthetic and real-world HSIs show that our DPNet-S and DPNet-U achieve remarkable results when compared with state-of-the-art methods. The codes will be publicly available at https://github.com/bearshng/dpnets for reproducible research.

Deep demosaicking for multispectral filter arrays

Deep convolutional demosaicking network for multispectral polarization filter array

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network

Deep joint demosaicking and denoising

Deep Demosaicing for Polarimetric Filter Array Cameras

Adaptive Multispectral Demosaicking Based on Frequency-Domain Analysis of Spectral Correlation

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

Toward Moiré-Free and Detail-Preserving Demosaicking

Joint optimization of multispectral filter arrays and demosaicking for pathological images

Optimized High-Frequency Based Interpolation for Multispectral Demosaicking

NTSDCN: New Three-Stage Deep Convolutional Image Demosaicking Network.

Multitask Sparse Representation Model-Inspired Network for Hyperspectral Image Denoising

Deep Parameterized Neural Networks for Hyperspectral Image Denoising

Efficient Training Procedures for Multi-Spectra Demosaicing

Efficient and Accurate Hyperspectral Image Demosaicing with Neural Network Architectures

Joint learning of RGBW color filter arrays and demosaicking

Multispectral Demosaicing Based on Iterative-Linear-Regression Model for Estimating Pseudo-Panchromatic Image

Universal Demosaicking of Color Filter Arrays

Color demosaicking via fully directional estimation