Abstract:The restoration of images affected by blur and noise has been widely studied and has broad potential for applications including in medical imaging modalities like computed tomography (CT). Although the blur and noise in CT images can be attributed to a variety of system factors, these image properties can often be modeled and predicted accurately and used in classical restoration approaches for deconvolution and denoising. In classical approaches, simultaneous deconvolution and denoising can be challenging and often represent competing goals. Recently, deep learning approaches have demonstrated the potential to enhance image quality beyond classic limits; however, most deep learning models attempt a blind restoration problem and base their restoration on image inputs alone without direct knowledge of the image noise and blur properties. In this work, we present a method that leverages both degraded image inputs and a characterization of the system blur and noise to combine modeling and deep learning approaches. Different methods to integrate these auxiliary inputs are presented. Namely, an input-variant and a weight-variant approach wherein the auxiliary inputs are incorporated as a parameter vector before and after the convolutional block, respectively, allowing easy integration into any CNN architecture. The proposed model shows superior performance compared to baseline models lacking auxiliary inputs. Evaluations are based on the average Peak Signal-to-Noise Ratio (PSNR), selected examples of good and poor performance for varying approaches, and an input space analysis to assess the effect of different noise and blur on performance. Results demonstrate the efficacy of providing a deep learning model with auxiliary inputs, representing system blur and noise characteristics, to enhance the performance of the model in image restoration tasks.

What problem does this paper attempt to address?

The paper aims to address the issue of blurriness and noise affecting computed tomography (CT) images in the field of medical imaging. Specifically, the research aims to propose a deep learning method that combines system blur and noise models to restore image quality. ### Research Background and Objectives In the field of medical imaging, especially CT imaging, images are often affected by blurriness and noise, which can reduce image quality and subsequently affect diagnostic accuracy. Traditional image restoration techniques such as deconvolution and denoising can improve image quality, but they often face challenges when dealing with blurriness and noise, as these are often competing objectives. In recent years, deep learning methods have shown great potential in enhancing image quality, but most existing deep learning models are based on the "blind restoration" problem, relying solely on the input image itself without directly utilizing information about image noise and blur characteristics. ### Solution To address the above issues, the paper proposes a method that not only considers the degraded image itself but also integrates descriptions of system blur and noise characteristics, combining classical methods with deep learning. Specifically, the researchers developed several different methods to integrate these auxiliary inputs into the neural network architecture, including: - **Input Variant Method**: In this method, auxiliary vectors (representing blur and noise characteristics) are added before the input to the convolutional blocks, allowing the model to directly utilize this additional information. - **Weight Variant Method**: In this method, auxiliary vectors are used as weights to adjust the importance of different features after the convolution operation. - **Hybrid Model**: This model combines the advantages of both the input variant and weight variant methods, utilizing auxiliary information to make adjustments both before and after the convolution process. In this way, the proposed model can improve performance in image restoration tasks, especially when performing both deblurring and denoising simultaneously. ### Main Contributions - The paper demonstrates that providing blur and noise characteristics to deep learning models can significantly improve performance in image restoration tasks. - Several effective methods are proposed to integrate these auxiliary inputs and their effects are evaluated. - Experimental results show that the proposed model outperforms baseline models in various scenarios, particularly in cases involving complex blur and noise. In summary, this paper addresses the common issues of blurriness and noise in CT image restoration by proposing a novel solution that effectively utilizes knowledge about system blur and noise through deep learning methods, thereby improving the quality of image restoration.

Deep Learning CT Image Restoration using System Blur and Noise Models

Deep Learning CT Image Restoration using System Blur Models

End-to-end Deep Learning Restoration of GLCM Features from blurred and noisy images

A survey of deep learning approaches to image restoration

RestoreNet: a deep learning framework for image restoration in optical synthetic aperture imaging system

Statistical Image Restoration for Low-Dose CT using Convolutional Neural Networks

Nonblind Image Deblurring Via Deep Learning in Complex Field

Adaptive Optimized Discriminative Learning based Image Deblurring using Deep CNN

Image Restoration Based on Deep Convolutional Network in Wavefront Coding Imaging System.

Convolutional Neural Networks For Image Denoising And Restoration

Low-dose CT Restoration Via Stacked Sparse Denoising Autoencoders

Deep Learning Based Image Restoration Method of Optical Synthetic Aperture Imaging System

Restoration of Turbulence-degraded Images Based on Deep Convolutional Network

A Comprehensive Review of Deep Learning-Based Real-World Image Restoration

CT Image Denoising and Deblurring with Deep Learning: Current Status and Perspectives

CT Reconstruction using Nonlinear Diffusion Posterior Sampling with Detector Blur Modeling

Self-Supervised Image Restoration with Blurry and Noisy Pairs

Deep self-supervised spatial-variant image deblurring

Training Very Deep CNNs for General Non-Blind Deconvolution.

Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network

CT Image Denoising with Perceptive Deep Neural Networks