Abstract:In this paper, we address the unified image restoration challenge by reframing it as a contrastive learning-based classification problem. Despite the significant strides made by deep learning methods in enhancing image restoration quality, their limited capacity to generalize across diverse degradation types and intensities necessitates the training of separate models for each specific degradation scenario. We proposes an all-encompassing approach that can restore images from various unknown corruption types and levels. We devise a method that learns representations of the latent sharp image’s degradation and accompanying textual features (such as dataset categories and image content descriptions), converting these into prompts which are then embedded within a reconstruction network model to enhance cross-database restoration performance. This culminates in a unified image reconstruction framework. The study involves two stages: In the first stage, we design a MultiContentNet that learns multi-modal features (MMFs) of the latent sharp image. This network encodes the visual degradation expressions and contextual text features into latent variables, thereby exerting a guided classification effect. Specifically, MultiContentNet is trained as an auxiliary controller capable of taking the degraded input image and, through contrastive learning, extracts MMFs of the latent target image. This effectively generates natural classifiers tailored for different degradation types. The second phase integrates the learned MMFs into an image restoration network via cross-attention mechanisms. This guides the restoration model to learn high-fidelity image recovery. Experiments conducted on six blind image restoration tasks demonstrate that the proposed method achieves state-of-the-art performance, highlighting the potential significance of large-scale pretrained vision-language models’ MMFs in advancing high-quality unified image reconstruction.

Learning Dual Transformation Networks For Image Contrast Enhancement

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Single Image Enhancement Using Dual Boundaries

Dual-band low-light image enhancement

Multi-modal Degradation Feature Learning for Unified Image Restoration Based on Contrastive Learning

Low-Light Image Enhancement by Learning Contrastive Representations in Spatial and Frequency Domains

Low-Light Image Enhancement via Dual Information-Based Networks

Contrast Enhancement Via Dual Graph Total Variation-Based Image Decomposition.

Low-Light Image Enhancement via Stage-Transformer-Guided Network

Division gets better: Learning brightness-aware and detail-sensitive representations for low-light image enhancement

Multistage supervised contrastive learning for hybrid-degraded image restoration

Low-light Image Enhancement Network Based on Multi-Stream Information Supplement

Flow Learning Based Dual Networks for Low-Light Image Enhancement

Low-Light Image Enhancement by Combining Transformer and Convolutional Neural Network

Low‐light image enhancement via lightweight custom non‐linear transform network

Manifestation of Image Contrast in Deep Networks

Dual Attention Unit-Based Generative Adversarial Networks for Low-Light Image Enhancement

What to Learn: Features, Image Transformations, or Both?

Dual-Domain Fusion Convolutional Neural Network for Contrast Enhancement Forensics

Single low-light image brightening using learning-based intensity mapping

A Transformer-Based Network for Low-Light Image Enhancement