Abstract:Although the current deep learning-based old photos restoration work can repair scratches and structural defects, the results often have the problems of incomplete scratch detection and poor repair quality. In order to solve these problems synthetically, in this paper, we use the way of modeling the degradation information of the scratched areas and generate contents to fill them. We proposed a framework to restore old scratched photos, in which we fully exploit and preserve the available information from the deteriorated photos, enabling us to accomplish image quality restoration and colorization with utmost finesse based on this invaluable data. Our proposed framework consists of two modules: a scratch removal module for old photos based on a Fine-tune and Guided the diffusion model, an Image enhancement and colorization module. To make full use of scratches feature information, we introduce a scratch distribution extraction (ScDE) module to learn the scratch model as Gaussian noise distributions. Through the fine-tuning the path of reverse denoising, it will eventually move towards the data distribution without scratches. Therefore, our proposed method can efficiently remove scratches from degraded old photos while maintaining the original styles of scratch-free regions. At the same time, most old photos after scanning have the problem of low resolution and blurriness, the efficacy of our image quality enhancement and Colorization strategy in resolving this issue is commendable. The comprehensive experimental results show that our image enhancement and colorization module can render the structural features of the image clearer and more realistic. Furthermore, we construct a large-scale old-photo-scratch-dataset (ScraOld) involved various scene classes with 703 pairs of scratched photos and their ground-truth. Experimental results demonstrate that our proposed method achieve the state-of-the-art (SOTA) performance in terms of PSNR, SSIM, LPIPS, FID metrics. The subjective quality is significantly higher than all comparison methods.

Synthesis Algorithm Based on Overcomplete Wavelet Expansion for Line Scratch Restoration in Old Films

An Owe-Based Algorithm for Line Scratches Restoration in Old Movies

Research of Image Restoration Algorithms

Removal of Vertical Scratches in Old Movie Film by Using Wavelet Decomposition

Scratch Detection Technology for Product Surface Based on Improved Contourlet Transform

Precisely connected and calculated algorithm of punctate scratches in the super-smooth surface defects evaluation system

Dark-field detection method of shallow scratches on the super-smooth optical surface based on the technology of adaptive smoothing and morphological differencing

Analysis of the selection of overlapping region of sectioned restoration for images with space-variant point spread function

Improved Restoration Algorithm for Weakly Blurred and Strongly Noisy Image

Scratch Detection Algorithm for Old Movies Based on Spatial Model and Morphological Feature

Automatic Movie Restoration Based on Wave Atom Transform and Nonparametric Model

An improved image restoration approach using adaptive local constraint

Old scratched photos restoration with enhancement and colorization

Improved Sparse Representation Algorithm for Optical Coherence Tomography Images

Image Restoration Via Improved Wiener Filter Applied to Optical Sparse Aperture Systems

Detection of Blotch and Scratch in Video Based on Video Decomposition

Restoration Algorithm of Damaged Mark Image Based on Texture Synthesis

RESEARCH ON FAST AND ROBUST SUB-PIXEL DETECTION METHOD FOR SCRATCHES ON OPTICAL COMPONENTS

An Improved SROD Blotch Detection Method in Old Film

Contextual-Assisted Scratched Photo Restoration

A fast, robust and precise method for measuring scratches on optical surfaces