Abstract:Unsupervised restoration approaches based on generative adversarial networks (GANs) offer a promising solution without requiring paired datasets. Yet, these GAN-based approaches struggle to surpass the performance of conventional unsupervised GAN-based frameworks without significantly modifying model structures or increasing the computational complexity. To address these issues, we propose a self-collaboration (SC) strategy for existing restoration models. This strategy utilizes information from the previous stage as feedback to guide subsequent stages, achieving significant performance improvement without increasing the framework's inference complexity. The SC strategy comprises a prompt learning (PL) module and a restorer ($Res$). It iteratively replaces the previous less powerful fixed restorer $\overline{Res}$ in the PL module with a more powerful $Res$. The enhanced PL module generates better pseudo-degraded/clean image pairs, leading to a more powerful $Res$ for the next iteration. Our SC can significantly improve the $Res$'s performance by over 1.5 dB without adding extra parameters or computational complexity during inference. Meanwhile, existing self-ensemble (SE) and our SC strategies enhance the performance of pre-trained restorers from different perspectives. As SE increases computational complexity during inference, we propose a re-boosting module to the SC (Reb-SC) to improve the SC strategy further by incorporating SE into SC without increasing inference time. This approach further enhances the restorer's performance by approximately 0.3 dB. Extensive experimental results on restoration tasks demonstrate that the proposed model performs favorably against existing state-of-the-art unsupervised restoration methods. Source code and trained models are publicly available at: \url{<a class="link-external link-https" href="https://github.com/linxin0/RSCP2GAN" rel="external noopener nofollow">this https URL</a>}.

RIS-GAN: Self-Supervised GANs via Recovering Initial State of Subimages

Assessing a Single Image in Reference-Guided Image Synthesis

Remote Sensing Image Super-Resolution via Saliency-Guided Feedback GANs

RIRGAN: an End-to-end Lightweight Multi-Task Learning Method for Brain MRI Super-Resolution and Denoising

SD-GAN: Saliency-Discriminated GAN for Remote Sensing Image Superresolution

Incremental Focal Loss GANs.

RIS-GAN: Explore Residual and Illumination with Generative Adversarial Networks for Shadow Removal

RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detection

Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration

CM-MaskSD: Cross-Modality Masked Self-Distillation for Referring Image Segmentation

Enhanced self-supervised GANs with blend ratio classification

Self-supervised single-view 3D point cloud reconstruction through GAN inversion

Robust Semi-Supervised Classification using GANs with Self-Organizing Maps

Pseudo-RIS: Distinctive Pseudo-supervision Generation for Referring Image Segmentation

Mask Grounding for Referring Image Segmentation

Self-Supervised Divide-and-Conquer Generative Adversarial Network for Classification of Hyperspectral Images

VSG-GAN: A high-fidelity image synthesis method with semantic manipulation in retinal fundus image

Self-Ensembling GAN for Cross-Domain Semantic Segmentation

X-GANs: Image Reconstruction Made Easy for Extreme Cases

Towards Generalizable Referring Image Segmentation via Target Prompt and Visual Coherence

DSRGAN: Detail Prior-Assisted Perceptual Single Image Super-Resolution via Generative Adversarial Networks