Abstract:The restoration of images affected by blur and noise has been widely studied and has broad potential for applications including in medical imaging modalities like computed tomography (CT). Although the blur and noise in CT images can be attributed to a variety of system factors, these image properties can often be modeled and predicted accurately and used in classical restoration approaches for deconvolution and denoising. In classical approaches, simultaneous deconvolution and denoising can be challenging and often represent competing goals. Recently, deep learning approaches have demonstrated the potential to enhance image quality beyond classic limits; however, most deep learning models attempt a blind restoration problem and base their restoration on image inputs alone without direct knowledge of the image noise and blur properties. In this work, we present a method that leverages both degraded image inputs and a characterization of the system blur and noise to combine modeling and deep learning approaches. Different methods to integrate these auxiliary inputs are presented. Namely, an input-variant and a weight-variant approach wherein the auxiliary inputs are incorporated as a parameter vector before and after the convolutional block, respectively, allowing easy integration into any CNN architecture. The proposed model shows superior performance compared to baseline models lacking auxiliary inputs. Evaluations are based on the average Peak Signal-to-Noise Ratio (PSNR), selected examples of good and poor performance for varying approaches, and an input space analysis to assess the effect of different noise and blur on performance. Results demonstrate the efficacy of providing a deep learning model with auxiliary inputs, representing system blur and noise characteristics, to enhance the performance of the model in image restoration tasks.

Noise2Noise: Learning Image Restoration without Clean Data

Noise2Stack: Improving Image Restoration by Learning from Volumetric Data

Noisy-as-Clean: Learning Self-Supervised Denoising From Corrupted Image

Unsupervised Image Restoration Using Partially Linear Denoisers

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation

Learning to See by Looking at Noise

Feature-Preserving Noise Removal

Noise2Inverse: Self-supervised deep convolutional denoising for tomography

The role of noise in denoising models for anomaly detection in medical images

A recommender system to restore images with impulse noise

Generalized Recorrupted-to-Recorrupted: Self-Supervised Learning Beyond Gaussian Noise

Enhancing and Learning Denoiser Without Clean Reference

Recorrupted-to-Recorrupted: Unsupervised Deep Learning for Image Denoising

Deep Learning CT Image Restoration using System Blur and Noise Models

Exaggerated Learning for Clean-And-Sharp Image Restoration

Self-supervised Noise2noise Method Utilizing Corrupted Images with a Modular Network for LDCT Denoising

Learned denoising with simulated and experimental low-dose CT data

Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration

Using learned optimizers to make models robust to input noise

Enhancing Image Quality: A Comparative Study of Spatial, Frequency Domain, and Deep Learning Methods

ReNoise: Real Image Inversion Through Iterative Noising