Abstract:Under low-light environment, handheld photography suffers from severe camera shake under long exposure settings. Although existing deblurring algorithms have shown promising performance on well-exposed blurry images, they still cannot cope with low-light snapshots. Sophisticated noise and saturation regions are two dominating challenges in practical low-light deblurring: the former violates the Gaussian or Poisson assumption widely used in most existing algorithms and thus degrades their performance badly, while the latter introduces non-linearity to the classical convolution-based blurring model and makes the deblurring task even challenging. In this work, we propose a novel non-blind deblurring method dubbed image and feature space Wiener deconvolution network (INFWIDE) to tackle these problems systematically. In terms of algorithm design, INFWIDE proposes a two-branch architecture, which explicitly removes noise and hallucinates saturated regions in the image space and suppresses ringing artifacts in the feature space, and integrates the two complementary outputs with a subtle multi-scale fusion network for high quality night photograph deblurring. For effective network training, we design a set of loss functions integrating a forward imaging model and backward reconstruction to form a close-loop regularization to secure good convergence of the deep neural network. Further, to optimize INFWIDE's applicability in real low-light conditions, a physical-process-based low-light noise model is employed to synthesize realistic noisy night photographs for model training. Taking advantage of the traditional Wiener deconvolution algorithm's physically driven characteristics and deep neural network's representation ability, INFWIDE can recover fine details while suppressing the unpleasant artifacts during deblurring. Extensive experiments on synthetic data and real data demonstrate the superior performance of the proposed approach.

End-to-end Learned Single Lens Design Using Improved Wiener Deconvolution

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

End-to-end learned single lens design using fast differentiable ray tracing

Blind Deconvolution Using an Improved L0 Sparse Representation

Image Restoration Via Improved Wiener Filter Applied to Optical Sparse Aperture Systems

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network

DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurring

Super-Resolution Image Reconstruction of Wavefront Coding Imaging System Based on Deep Learning Network

Deep Denoiser Prior Based Deep Analytic Network for Lensless Image Restoration.

Embedded Processing for Extended Depth of Field Imaging Systems: From Infinite Impulse Response Wiener Filter to Learned Deconvolution

INFWIDE: Image and Feature Space Wiener Deconvolution Network for Non-Blind Image Deblurring in Low-Light Conditions

Learning to Deblur using Light Field Generated and Real Defocus Images

Lensless cameras using a mask based on almost perfect sequence through deep learning

An End-to-End Real-World Camera Imaging Pipeline

Unsupervised Learning of High-resolution Light Field Imaging via Beam Splitter-based Hybrid Lenses

Learning to autofocus in whole slide imaging via physics-guided deep cascade networks

Deep Learning Based Image Restoration Method of Optical Synthetic Aperture Imaging System

A CNN-Based Blind Denoising Method for Endoscopic Images

A Physics-informed Low-rank Deep Neural Network for Blind and Universal Lens Aberration Correction