Abstract:In this paper, we address the unified image restoration challenge by reframing it as a contrastive learning-based classification problem. Despite the significant strides made by deep learning methods in enhancing image restoration quality, their limited capacity to generalize across diverse degradation types and intensities necessitates the training of separate models for each specific degradation scenario. We proposes an all-encompassing approach that can restore images from various unknown corruption types and levels. We devise a method that learns representations of the latent sharp image’s degradation and accompanying textual features (such as dataset categories and image content descriptions), converting these into prompts which are then embedded within a reconstruction network model to enhance cross-database restoration performance. This culminates in a unified image reconstruction framework. The study involves two stages: In the first stage, we design a MultiContentNet that learns multi-modal features (MMFs) of the latent sharp image. This network encodes the visual degradation expressions and contextual text features into latent variables, thereby exerting a guided classification effect. Specifically, MultiContentNet is trained as an auxiliary controller capable of taking the degraded input image and, through contrastive learning, extracts MMFs of the latent target image. This effectively generates natural classifiers tailored for different degradation types. The second phase integrates the learned MMFs into an image restoration network via cross-attention mechanisms. This guides the restoration model to learn high-fidelity image recovery. Experiments conducted on six blind image restoration tasks demonstrate that the proposed method achieves state-of-the-art performance, highlighting the potential significance of large-scale pretrained vision-language models’ MMFs in advancing high-quality unified image reconstruction.

Deep multi-scale gabor wavelet network for image restoration

Image Denoising Via Multi-Scale Gated Fusion Network

Multi-scale residual network-based image restoration

Multi-Scale Representation Learning for Image Restoration with State-Space Model

Variational Image Restoration Network

Variational Image Restoration Network.

Multi-level Wavelet-CNN for Image Restoration

Wide & deep learning for spatial & intensity adaptive image restoration

Multi-modal Degradation Feature Learning for Unified Image Restoration Based on Contrastive Learning

Efficient Multi-scale Network with Learnable Discrete Wavelet Transform for Blind Motion Deblurring

A Method for Remote Sensing Image Restoration Based on the System Degradation Model

Multiscale Synergism Ensemble Progressive and Contrastive Investigation for Image Restoration

Research on a multi‐scale degradation fusion network in all‐in‐one image restoration

Multi-level Wavelet Convolutional Neural Networks

WGLFNets: Wavelet-based global-local filtering networks for image denoising with structure preservation

Deep Likelihood Network for Image Restoration with Multiple Degradation Levels

WaveDM: Wavelet-Based Diffusion Models for Image Restoration

Deep Generalized Unfolding Networks for Image Restoration

Global-Local Stepwise Generative Network for Ultra High-Resolution Image Restoration

Frequency domain task-adaptive network for restoring images with combined degradations

Unified-Width Adaptive Dynamic Network for All-In-One Image Restoration