Abstract:In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an ill-posed inverse problem and its solution is difficult to approximate when noise affects the data. Really, one limitation of neural networks for deblurring is their sensitivity to noise and other perturbations, which can lead to instability and produce poor reconstructions. In addition, networks do not necessarily take into account the numerical formulation of the underlying imaging problem, when trained end-to-end. In this paper, we propose some strategies to improve stability without losing to much accuracy to deblur images with deep-learning based methods. First, we suggest a very small neural architecture, which reduces the execution time for training, satisfying a green AI need, and does not extremely amplify noise in the computed image. Second, we introduce a unified framework where a pre-processing step balances the lack of stability of the following, neural network-based, step. Two different pre-processors are presented: the former implements a strong parameter-free denoiser, and the latter is a variational model-based regularized formulation of the latent imaging problem. This framework is also formally characterized by mathematical analysis. Numerical experiments are performed to verify the accuracy and stability of the proposed approaches for image deblurring when unknown or not-quantified noise is present; the results confirm that they improve the network stability with respect to noise. In particular, the model-based framework represents the most reliable trade-off between visual precision and robustness.

Neural Differential Equations for Single Image Super-resolution

Epistemic-Uncertainty-Based Divide-and-Conquer Network for Single-Image Super-Resolution

Image Super-resolution Based on Tiny Recurrent Convolutional Neural Network

Neural Delay Differential Equations: System Reconstruction and Image Classification

Progressive Image Super-Resolution via Neural Differential Equation

Image Restoration with Mean-Reverting Stochastic Differential Equations

Image Super-Resolution Via Deterministic-Stochastic Synthesis and Local Statistical Rectification

Single Image Super Resolution - when Model Adaptation Matters

The dual approach to non-negative super-resolution: impact on primal reconstruction accuracy

Deep Networks for Image and Video Super-Resolution

Multi-Scale Deep Neural Networks for Real Image Super-Resolution

The Neural Network Approach to Inverse Problems in Differential Equations

Single-image Super-Resolution Via Joint Statistic Models-Guided Deep Auto-Encoder Network

An Iterative Robust Kernel-Based Regression Method for Simultaneous Single Image Super-Resolution and Denoising

Accuracy and Architecture Studies of Residual Neural Network solving Ordinary Differential Equations

Single Image Super-Resolution via a Dual Interactive Implicit Neural Network

The Problem Of Image Super-Resolution, Denoising And Some Image Restoration Methods In Deep Learning Models

Single-Image Super-Resolution Reconstruction based on the Differences of Neighboring Pixels

Unified Dynamic Convolutional Network for Super-Resolution with Variational Degradations

The dual approach to non-negative super-resolution: perturbation analysis

Ambiguity in solving imaging inverse problems with deep learning based operators