Abstract:Autonomous vehicles and robots often struggle with reliable visual perception at night due to the low illumination and motion blur caused by the long exposure time of RGB cameras. Existing methods address this challenge by sequentially connecting the off-the-shelf pretrained low-light enhancement and deblurring models. Unfortunately, these methods often lead to noticeable artifacts (\eg, color distortions) in the over-exposed regions or make it hardly possible to learn the motion cues of the dark regions. In this paper, we interestingly find vision-language models, \eg, Contrastive Language-Image Pretraining (CLIP), can comprehensively perceive diverse degradation levels at night. In light of this, we propose a novel transformer-based joint learning framework, named DAP-LED, which can jointly achieve low-light enhancement and deblurring, benefiting downstream tasks, such as depth estimation, segmentation, and detection in the dark. The key insight is to leverage CLIP to adaptively learn the degradation levels from images at night. This subtly enables learning rich semantic information and visual representation for optimization of the joint tasks. To achieve this, we first introduce a CLIP-guided cross-fusion module to obtain multi-scale patch-wise degradation heatmaps from the image embeddings. Then, the heatmaps are fused via the designed CLIP-enhanced transformer blocks to retain useful degradation information for effective model optimization. Experimental results show that, compared to existing methods, our DAP-LED achieves state-of-the-art performance in the dark. Meanwhile, the enhanced results are demonstrated to be effective for three downstream tasks. For demo and more results, please check the project page: \url{<a class="link-external link-https" href="https://vlislab22.github.io/dap-led/" rel="external noopener nofollow">this https URL</a>}.

CPA-Enhancer: Chain-of-Thought Prompted Adaptive Enhancer for Object Detection under Unknown Degradations

Modular Degradation Simulation and Restoration for Under-Display Camera

TIENet: task-oriented image enhancement network for degraded object detection

Boosting Visual Recognition in Real-world Degradations via Unsupervised Feature Enhancement Module with Deep Channel Prior

All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Model

Degradation Type-Aware Image Restoration for Effective Object Detection in Adverse Weather

DAP-LED: Learning Degradation-Aware Priors with CLIP for Joint Low-light Enhancement and Deblurring

RestoreDet: Degradation Equivariant Representation for Object Detection in Low Resolution Images

Exploring Test-Time Adaptation for Object Detection in Continually Changing Environments

Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers

Attention guided multi-level feature aggregation network for camouflaged object detection

FocusDiffuser: Perceiving Local Disparities for Camouflaged Object Detection

CoDA: Instructive Chain-of-Domain Adaptation with Severity-Aware Visual Prompt Tuning

MSCAF-Net: A General Framework for Camouflaged Object Detection via Learning Multi-Scale Context-Aware Features

COMPrompter: reconceptualized segment anything model with multiprompt network for camouflaged object detection

CamDiff: Camouflage Image Augmentation via Diffusion Model

Restorer: Removing Multi-Degradation with All-Axis Attention and Prompt Guidance

Active Visual Perception Enhancement Method Based on Deep Reinforcement Learning

Camouflaged Object Detection with Feature Decomposition and Edge Reconstruction

Image Enhancement via Associated Perturbation Removal and Texture Reconstruction Learning

DPEC: Dual-Path Error Compensation Method for Enhanced Low-Light Image Clarity