Abstract:Sparse representation (SR)-based hyperspectral image (HSI) denoising methods normally average the local denoising results of multiple overlapped cubes to recover the whole HSI. Though interpretable, they rely on cumbersome hyperparameter settings and ignore the relationship between overlapped cubes, leading to poor denoising performance. This article combines SR and convolutional neural networks and introduces a deep parameterized sparse neural network (DPNet-S) to address the above issues. DPNet-S parameterizes the SR-based HSI denoising model with two modules: 1) sparse optimizer to extract sparse feature maps from noisy HSIs via recurrent usage of convolution, deconvolution, and soft shrinkage operations; and 2) image reconstructor to recover the denoised HSI from its sparse feature maps via deconvolution operations. We further replace the soft shrinkage operator with U-Net architecture to account for general HSI priors and more effectively capture the complex structures of HSIs, resulting in DPNet-U. Both networks directly learn the parameters from data and perform denoising on the whole HSI, which overcomes the limitations of SR-based methods. Moreover, our networks are generated from the denoising model and optimization procedures, thus leveraging the knowledge embedded and relying less on the number of training samples. Extensive experiments on both synthetic and real-world HSIs show that our DPNet-S and DPNet-U achieve remarkable results when compared with state-of-the-art methods. The codes will be publicly available at https://github.com/bearshng/dpnets for reproducible research.

Index Networks.

Index Network

Indices Matter: Learning to Index for Deep Image Matting

EiCSNet: Efficient Iterative Neural Network for Compressed Sensing Reconstruction

NoUCSR: Efficient Super-Resolution Network Without Upsampling Convolution.

Deep Parameterized Neural Networks for Hyperspectral Image Denoising

UniNet: Unified Architecture Search with Convolution, Transformer, and MLP

Deep Sampling Networks

Optimization-inspired Cumulative Transmission Network for image compressive sensing

Scale-Iterative Upscaling Network for Image Deblurring

PU-Net: Point Cloud Upsampling Network

Deepindex For Accurate And Efficient Image Retrieval

Invertible Residual Neural Networks with Conditional Injector and Interpolator for Point Cloud Upsampling

OneNet: A Channel-Wise 1D Convolutional U-Net

Learning Spatio-Temporal Downsampling for Effective Video Upscaling

I³Net: Inter-Intra-Slice Interpolation Network for Medical Slice Synthesis

InverseNet: Solving Inverse Problems of Multimedia Data with Splitting Networks.

Spectrally Consistent UNet for High Fidelity Image Transformations

CUF: Continuous Upsampling Filters

PUI-Net: A Point Cloud Upsampling and Inpainting Network

Learning Affinity-Aware Upsampling for Deep Image Matting