Survey of Image Deblurring
Hu Zhangying,Zhou Quan,Chen Mingju,Cui Jingcheng,Wu Xiaofu,Zheng Baoyu
DOI: https://doi.org/10.11834/jig.230555
2024-01-01
Abstract:Image blurring refers to the loss of clarity and detail in an image during its capture or transmission due to factors such as motion of the lens or camera,lighting conditions,and other environmental variables.This loss of quality and usability can significantly influence the overall visual impact of the image.The technique of image deblurring has been developed to mitigate such effects.Its purpose is to predict the clear version of an image automatically by constructing com-puter mathematical models that measure the blurriness of the image.The research and development of image deblurring algorithms have not only provided convenience for other tasks in the field of computer vision,such as object detection,but have also offered assurance in various aspects of life,including security monitoring.Depending on its cause,blurring can mainly be divided into motion blur,out-of-focus blur,and Gaussian blur.Out-of-focus and Gaussian blurs are less preva-lent and relatively easier to handle,whereas motion blur is more likely to occur in situations such as road traffic cameras,pedestrian movement,and fast-moving vehicles,making it a more critical issue to be addressed.After an image is deblurred,evaluating the quality of the results becomes essential,which is carried out using methods for image quality assessment(IQA),categorized as either subjective or objective.Objective evaluation methods can be divided into three types:full-reference,reduced reference,and no reference.Owing to constraints in resources,objective evaluation meth-ods make up the majority of IQA approaches.The process of image blurring can be represented as the convolution of a clear image with a blur kernel,accompanied with greater or lesser degrees of noise.Therefore,image deblurring comprises two types:non-blind image deblurring(NBID)and blind image deblurring(BID).Non-blind deblurring involves the restora-tion of an image with a known blur kernel,requiring prior knowledge of the blur kernel's parameters.On the contrary,blind deblurring aims to restore images with unknown blur kernels or unknown clear images,posing a more challenging problem to solve because of the increased number of unknown factors.In light of these considerations,we systematically and critically review the recent advancements in image deblurring.A comprehensive and systematic introduction of image deblurring is presented from the following two aspects:1)the evolution of traditional image deblurring and 2)the develop-ment of deep learning-based image deblurring.From the perspective of traditional image deblurring,the existing image deblurring methods can be divided into two categories:non-blind deblurring and blind deblurring.Specifically,traditional NBID algorithms rely on prior knowledge of the blur kernel for the restoration process.Common methods include denoising-and iteration-based methods.Traditional BID methods primarily involve estimating the blur kernel first and transforming it into an NBID problem afterward.The kernel and clear image are often estimated iteratively until satisfactory results are obtained.The emerging deep learning methods extract blur image features through training a neural network and employing logistic regression to update models.Unlike traditional methods that require prior knowledge of the degree of image blur,deep learning-based methods are capable of directly processing blurry images without the need for prior estimation of the blur degree.From the perspective of network architecture,deep learning-based image deblurring algorithms can be classi-fied into convolutional neural network(CNN)-based,recurrent neural network(RNN)-based,generative adversarial net-work(GAN)-based,and Transformer-based networks.CNN-based methods can learn the mapping between blurry and clear images by training on a large number of image pairs,which enables them to perform blind deblurring.These algo-rithms take advantage of parameter sharing and local receptive fields,reducing the number of model parameters and improv-ing the accuracy of image feature extraction.Image deblurring based on RNN is a type of neural network model that can handle sequential data through learning the relationship between sequential data.GAN-based deblurring approaches define image deblurring problems as an adversarial game between generators and discriminators.Transformer-based methods employ a self-attention mechanism to encode global dependencies between different spatial positions,thereby capturing the global information of an entire image.Our critical review focuses on the main concepts and discussions of the characteris-tics of each method for image deblurring from the perspective of network architecture.Particularly,we summarize the limi-tations of different deblurring algorithms.We also briefly introduce popular public datasets.Then,we review some image deblurring literature from two aspects:traditional methods and deep learning-based methods.The capability of representa-tive algorithms is analyzed using peak signal-to-noise ratio and structural similarity evaluation indexes in terms of GoPro Labs,human-aware motion deblurring,and other datasets.Furthermore,this review critically analyzes the conclusion,highlighting the challenges in image deblurring.