Abstract:Despite the tremendous advances in denoising techniques, it's still challenging to restore a clean image with salient structures based on one noisy observation, especially at high noise levels. In this work, we propose a frequency-domain guided denoising algorithm to conduct denoising with the help of a well-aligned guidance image. Thanks to their structural correlations, the frequency characteristics of the guidance image can indicate whether the frequency coefficients of the noisy target image are contributed by noise or textures. Therefore, the explicit frequency decomposition enables our denoising model to avoid over-smoothing detailed contents. However, as two input images are usually captured in different fields, their structures are not always consistent. Therefore, we model guided denoising with an optimization problem which considers both the representation model of the guidance image and the fidelity to the noisy target. Further, we design a convolutional neural network, called as FGDNet, to explore the optimal solution. Due to the visual masking phenomenon, human eyes are sensitive to noise in the flat areas, but may not perceive noise around edges or textures. Therefore, we expect to remove as much noise as possible to guarantee the spatial smoothness of flat contents, while also preserving high-frequency structures. Through frequency decomposition, our model can process the low-frequency and high-frequency contents separately. We also adopt a frequency-relevant loss function to train the network. Experimental results show that, compared with state-of-the-art guided and non-guided denoisers, our FGDNet achieves higher denoising accuracy and better visual quality in both flat and texture-rich regions.

Depth Image Denoising via Collaborative Graph Fourier Transform.

Depth Map Denoising Using Graph-Based Transform and Group Sparsity

Depth Map Inpainting Using a Fully Convolutional Network

Frequency-Domain Deep Guided Image Denoising

A Comparative Study on Guided Depth Enhancement

Guided depth enhancement via a fast marching method

Depth Image Denoising Using Nuclear Norm and Learning Graph Model.

Fast Color-guided Depth Denoising for RGB-D Images by Graph Filtering

Denoising Deep Monte Carlo Renderings

Color-Guided Depth Image Recovery with Adaptive Data Fidelity and Transferred Graph Laplacian Regularization

Depth map enhancement based on color and depth consistency

Ddrnet: Depth Map Denoising And Refinement For Consumer Depth Cameras Using Cascaded Cnns

Single Depth Image Super-Resolution and Denoising Based on Sparse Graphs Via Structure Tensor

Recurrent Cross-Modality Fusion for Time-of-Flight Depth Denoising

High Quality Depth Map Estimation Method Based on Graph Cut

A weighted least squares algorithm for time-of-flight depth image denoising

Details Preserving Deep Collaborative Filtering-Based Method for Image Denoising

Multi-Patch Collaborative Point Cloud Denoising via Low-Rank Recovery with Graph Constraint

Image Guided Depth Enhancement Via Deep Fusion And Local Linear Regularization

Self-Supervised Deep Depth Denoising

Fast and accurate image denoising via a deep convolutional-pairs network