Abstract:In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an ill-posed inverse problem and its solution is difficult to approximate when noise affects the data. Really, one limitation of neural networks for deblurring is their sensitivity to noise and other perturbations, which can lead to instability and produce poor reconstructions. In addition, networks do not necessarily take into account the numerical formulation of the underlying imaging problem, when trained end-to-end. In this paper, we propose some strategies to improve stability without losing to much accuracy to deblur images with deep-learning based methods. First, we suggest a very small neural architecture, which reduces the execution time for training, satisfying a green AI need, and does not extremely amplify noise in the computed image. Second, we introduce a unified framework where a pre-processing step balances the lack of stability of the following, neural network-based, step. Two different pre-processors are presented: the former implements a strong parameter-free denoiser, and the latter is a variational model-based regularized formulation of the latent imaging problem. This framework is also formally characterized by mathematical analysis. Numerical experiments are performed to verify the accuracy and stability of the proposed approaches for image deblurring when unknown or not-quantified noise is present; the results confirm that they improve the network stability with respect to noise. In particular, the model-based framework represents the most reliable trade-off between visual precision and robustness.

Matrix Forms of Iterative Algorithms to Solve Large-Scale Discrete Ill-Posed Problems with an Application to Image Restoration.

Matrix Forms of Gradient Descent Algorithms Applied to Restoration of Blurred Images

Non-Local Image Inpainting Using Low-Rank Matrix Completion: Non-Local Image Inpainting Using Low-Rank Matrix Completion

Improved Restoration Algorithm for Weakly Blurred and Strongly Noisy Image

A Graph-based Iterative Algorithm for Inverse Problems with Local and Non-local Regularizations

Generalized Structure Preserving Preconditioners for Frame-Based Image Deblurring

Regularization Preconditioners for Frame-Based Image Deblurring with Reduced Boundary Artifacts

Two global iterative methods for ill-posed problems from image restoration

Image Restoration: Structured Low Rank Matrix Framework for Piecewise Smooth Functions and Beyond

Two Soft-Thresholding Based Iterative Algorithms for Image Deblurring

Truncated Spectral Decomposition Preconditioner for Image Restoration

Ambiguity in solving imaging inverse problems with deep learning based operators

IML FISTA: A Multilevel Framework for Inexact and Inertial Forward-Backward. Application to Image Restoration

Image restoration using sparse approximations of spatially varying blur operators in the wavelet domain

A fast iterative regularization method for ill-posed problems

Efficient Decomposition-Based Algorithms for $\ell_1$-Regularized Inverse Problems with Column-Orthogonal and Kronecker Product Matrices

Tikhonov regularization with conjugate gradient least squares method for large-scale discrete ill-posed problem in image restoration

Non-blind constraint image deblurring problem with mean curvature functional

An Additive Convolution Model for Fast Restoration of Nonuniform Blurred Images

Refined Exponential Filter with Applications to Image Restoration and Interpolation

Two New Efficient Iterative Regularization Methods for Image Restoration Problems