Abstract:Image deblurring continues to achieve impressive performance with the development of generative models. Nonetheless, there still remains a displeasing problem if one wants to improve perceptual quality and quantitative scores of recovered image at the same time. In this study, drawing inspiration from the research of transformer properties, we introduce the pretrained transformers to address this problem. In particular, we leverage deep features extracted from a pretrained vision transformer (ViT) to encourage recovered images to be sharp without sacrificing the performance measured by the quantitative metrics. The pretrained transformer can capture the global topological relations (i.e., self-similarity) of image, and we observe that the captured topological relationships about the sharp image will change when blur occurs. By comparing the transformer features between recovered image and target one, the pretrained transformer provides high-resolution blur-sensitive semantic information, which is critical in measuring the sharpness of the deblurred image. On the basis of the advantages, we present two types of novel perceptual losses to guide image deblurring. One regards the features as vectors and computes the discrepancy between representations extracted from recovered image and target one in Euclidean space. The other type considers the features extracted from an image as a distribution and compares the distribution discrepancy between recovered image and target one. We demonstrate the effectiveness of transformer properties in improving the perceptual quality while not sacrificing the quantitative scores peak signal-to-noise ratio (PSNR) over the most competitive models, such as Uformer, Restormer, and NAFNet, on defocus deblurring and motion deblurring tasks. The code is available at https://github. com/erfect2020/TransformerPerceptualLoss.

HistDeblur: A Pyramid Trustworthy Framework for Blurry Histologic Artifacts Quality Control

Vision Transformers for Single Image Dehazing

High Quality Image-Pair-based Deblurring Method Using Edge Mask and Improved Residual Deconvolution

A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learning

Deep Blur Multi-Model (DeepBlurMM) -- a strategy to mitigate the impact of image blur on deep learning model performance in histopathology image analysis

Digital Pathology Image Deblurring Via Local Focus Quality Assessment

Blind deblurring for microscopic pathology images using deep learning networks

Leveraging Central-Surrounding Receptive Fields for Single Image Dehazing

Decoupling Image Deblurring Into Twofold: A Hierarchical Model for Defocus Deblurring

Image Deblurring by Exploring In-Depth Properties of Transformer

Artifact Restoration in Histology Images with Diffusion Probabilistic Models

Rethinking Image Deblurring Via CNN-Transformer Multiscale Hybrid Architecture

Reduced-reference image deblurring quality assessment based on multi-scale feature enhancement and aggregation

Artifact Detection and Restoration in Histology Images with Stain-Style and Structural Preservation

Debluring Low-Resolution Images

Pyramid Architecture Search for Real-Time Image Deblurring

HCTIRdeblur: A Hybrid Convolution-Transformer Network for Single Infrared Image Deblurring

DehazeDCT: Towards Effective Non-Homogeneous Dehazing via Deformable Convolutional Transformer

Deblurring masked image modeling for ultrasound image analysis

Accelerating Cardiac MRI Via Deblurring Without Sensitivity Estimation.

Double Pyramid Field-aware Blind Deconvolution Framework