Abstract:Event cameras offer significant advantages for low-light video enhancement, primarily due to their high dynamic range. Current research, however, is severely limited by the absence of large-scale, real-world, and spatio-temporally aligned event-video datasets. To address this, we introduce a large-scale dataset with over 30,000 pairs of frames and events captured under varying illumination. This dataset was curated using a robotic arm that traces a consistent non-linear trajectory, achieving spatial alignment precision under 0.03mm and temporal alignment with errors under 0.01s for 90% of the dataset. Based on the dataset, we propose \textbf{EvLight++}, a novel event-guided low-light video enhancement approach designed for robust performance in real-world scenarios. Firstly, we design a multi-scale holistic fusion branch to integrate structural and textural information from both images and events. To counteract variations in regional illumination and noise, we introduce Signal-to-Noise Ratio (SNR)-guided regional feature selection, enhancing features from high SNR regions and augmenting those from low SNR regions by extracting structural information from events. To incorporate temporal information and ensure temporal coherence, we further introduce a recurrent module and temporal loss in the whole pipeline. Extensive experiments on our and the synthetic SDSD dataset demonstrate that EvLight++ significantly outperforms both single image- and video-based methods by 1.37 dB and 3.71 dB, respectively. To further explore its potential in downstream tasks like semantic segmentation and monocular depth estimation, we extend our datasets by adding pseudo segmentation and depth labels via meticulous annotation efforts with foundation models. Experiments under diverse low-light scenes show that the enhanced results achieve a 15.97% improvement in mIoU for semantic segmentation.

Event-Based Low-Illumination Image Enhancement

Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approach

Event-Based Fusion for Motion Deblurring with Cross-modal Attention

MEFNet: Multi-scale Event Fusion Network for Motion Deblurring

Coherent Event Guided Low-Light Video Enhancement

Research on Low-Light Image Enhancement Algorithm Based on Filtering and Data-Driven Composite

EvLight++: Low-Light Video Enhancement with an Event Camera: A Large-Scale Real-World Dataset, Novel Method, and More

Low-Light Video Enhancement with Synthetic Event Guidance

Event-assisted Low-Light Video Object Segmentation

A Review of Image Reconstruction Based on Event Cameras

Towards Real-world Event-guided Low-light Video Enhancement and Deblurring

Seeing Motion at Nighttime with an Event Camera

Event Enhanced High-Quality Image Recovery

Deblurring Low-Light Images with Events.

DeLiEve-Net: Deblurring Low-light Images with Light Streaks and Local Events

EEMEFN: Low-Light Image Enhancement Via Edge-Enhanced Multi-Exposure Fusion Network

Fast, Zero-Reference Low-Light Image Enhancement with Camera Response Model

From Sim-to-Real: Toward General Event-based Low-light Frame Interpolation with Per-scene Optimization

Image De-occlusion via Event-enhanced Multi-modal Fusion Hybrid Network

Enhancing Low-Light Images Using Infrared-Encoded Images

EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Dataset