Abstract:Unsupervised restoration approaches based on generative adversarial networks (GANs) offer a promising solution without requiring paired datasets. Yet, these GAN-based approaches struggle to surpass the performance of conventional unsupervised GAN-based frameworks without significantly modifying model structures or increasing the computational complexity. To address these issues, we propose a self-collaboration (SC) strategy for existing restoration models. This strategy utilizes information from the previous stage as feedback to guide subsequent stages, achieving significant performance improvement without increasing the framework's inference complexity. The SC strategy comprises a prompt learning (PL) module and a restorer ($Res$). It iteratively replaces the previous less powerful fixed restorer $\overline{Res}$ in the PL module with a more powerful $Res$. The enhanced PL module generates better pseudo-degraded/clean image pairs, leading to a more powerful $Res$ for the next iteration. Our SC can significantly improve the $Res$'s performance by over 1.5 dB without adding extra parameters or computational complexity during inference. Meanwhile, existing self-ensemble (SE) and our SC strategies enhance the performance of pre-trained restorers from different perspectives. As SE increases computational complexity during inference, we propose a re-boosting module to the SC (Reb-SC) to improve the SC strategy further by incorporating SE into SC without increasing inference time. This approach further enhances the restorer's performance by approximately 0.3 dB. Extensive experimental results on restoration tasks demonstrate that the proposed model performs favorably against existing state-of-the-art unsupervised restoration methods. Source code and trained models are publicly available at: \url{<a class="link-external link-https" href="https://github.com/linxin0/RSCP2GAN" rel="external noopener nofollow">this https URL</a>}.

Self-Supervised Face Image Restoration with a One-Shot Reference

A Dive into SAM Prior in Image Restoration

Semantic-Aware Detail Enhancement for Blind Face Restoration

Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior

Towards Unsupervised Blind Face Restoration using Diffusion Prior

Overcoming False Illusions in Real-World Face Restoration with Multi-Modal Guided Diffusion Model

Enhanced Blind Face Restoration with Multi-Exemplar Images and Adaptive Spatial Feature Fusion

A Survey of Deep Face Restoration: Denoise, Super-Resolution, Deblur, Artifact Removal

Image Restoration Via Simultaneous Nonlocal Self-Similarity Priors.

DARGS: Image Inpainting Algorithm via Deep Attention Residuals Group and Semantics

Learning the Hybrid Nonlocal Self-Similarity Prior for Image Restoration

Supervise-Assisted Self-Supervised Deep-Learning Method for Hyperspectral Image Restoration

Distilling Semantic Priors from SAM to Efficient Image Restoration Models

Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration

Self-Supervised Image Restoration with Blurry and Noisy Pairs

Survey on Deep Face Restoration: From Non-blind to Blind and Beyond

Unpaired Face Restoration Via Learnable Cross-Quality Shift

Efficient Image Restoration through Low-Rank Adaptation and Stable Diffusion XL

Implicit Subspace Prior Learning for Dual-Blind Face Restoration

AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior

RestorerID: Towards Tuning-Free Face Restoration with ID Preservation