Abstract:Although the current deep learning-based old photos restoration work can repair scratches and structural defects, the results often have the problems of incomplete scratch detection and poor repair quality. In order to solve these problems synthetically, in this paper, we use the way of modeling the degradation information of the scratched areas and generate contents to fill them. We proposed a framework to restore old scratched photos, in which we fully exploit and preserve the available information from the deteriorated photos, enabling us to accomplish image quality restoration and colorization with utmost finesse based on this invaluable data. Our proposed framework consists of two modules: a scratch removal module for old photos based on a Fine-tune and Guided the diffusion model, an Image enhancement and colorization module. To make full use of scratches feature information, we introduce a scratch distribution extraction (ScDE) module to learn the scratch model as Gaussian noise distributions. Through the fine-tuning the path of reverse denoising, it will eventually move towards the data distribution without scratches. Therefore, our proposed method can efficiently remove scratches from degraded old photos while maintaining the original styles of scratch-free regions. At the same time, most old photos after scanning have the problem of low resolution and blurriness, the efficacy of our image quality enhancement and Colorization strategy in resolving this issue is commendable. The comprehensive experimental results show that our image enhancement and colorization module can render the structural features of the image clearer and more realistic. Furthermore, we construct a large-scale old-photo-scratch-dataset (ScraOld) involved various scene classes with 703 pairs of scratched photos and their ground-truth. Experimental results demonstrate that our proposed method achieve the state-of-the-art (SOTA) performance in terms of PSNR, SSIM, LPIPS, FID metrics. The subjective quality is significantly higher than all comparison methods.

SSHRF-GAN: Spatial-Spectral Joint High Receptive Field GAN for Old Photo Restoration.

Old Photo Restoration via Deep Latent Space Translation

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network.

Application Research on Image Recovery Technology Based on GAN

Remote Sensing Image Jitter Restoration Based on Deep Generative Adversarial Network

Bringing Old Photos Back to Life

Dehaze-AGGAN: Unpaired Remote Sensing Image Dehazing Using Enhanced Attention-Guide Generative Adversarial Networks.

Hierarchical Damage Correlations for Old Photo Restoration

Old scratched photos restoration with enhancement and colorization

High-dimensional Assisted Generative Model for Color Image Restoration

Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration

HPG-GAN: High-Quality Prior-Guided Blind Face Restoration Generative Adversarial Network

Learning Compact Hyperbolic Representations of Latent Space for Old Photo Restoration

Remote sensing image dehazing using generative adversarial network with texture and color space enhancement

ROMNet: Renovate the Old Memories

Effective Image Restoration for Semantic Segmentation.

Forest Single-Frame Remote Sensing Image Super-Resolution Using GANs

Optical Remote Sensing Image Denoising and Super-Resolution Reconstructing Using Optimized Generative Network in Wavelet Transform Domain

Sgrgan: sketch-guided restoration for traditional Chinese landscape paintings

An Ancient Chinese Painting Restoration Method Based on Improved Generative Adversarial Network