Abstract:Imaging and perception in photon-limited scenarios is necessary for various applications, e.g., night surveillance or photography, high-speed photography, and autonomous driving. In these cases, cameras suffer from low signal-to-noise ratio, which degrades the image quality severely and poses challenges for downstream high-level vision tasks like object detection and recognition. Data-driven methods have achieved enormous success in both image restoration and high-level vision tasks. However, the lack of high-quality benchmark dataset with task-specific accurate annotations for photon-limited images/videos delays the research progress heavily. In this paper, we contribute the first multi-illuminance, multi-camera, and low-light dataset, named DarkVision, serving for both image enhancement and object detection. We provide bright and dark pairs with pixel-wise registration, in which the bright counterpart provides reliable reference for restoration and annotation. The dataset consists of bright-dark pairs of 900 static scenes with objects from 15 categories, and 32 dynamic scenes with 4-category objects. For each scene, images/videos were captured at 5 illuminance levels using three cameras of different grades, and average photons can be reliably estimated from the calibration data for quantitative studies. The static-scene images and dynamic videos respectively contain around 7,344 and 320,667 instances in total. With DarkVision, we established baselines for image/video enhancement and object detection by representative algorithms. To demonstrate an exemplary application of DarkVision, we propose two simple yet effective approaches for improving performance in video enhancement and object detection respectively. We believe DarkVision would advance the state-of-the-arts in both imaging and related computer vision tasks in low-light environment.

A Mutually Boosting Dual Sensor Computational Camera for High Quality Dark Videography.

A Dual Sensor Computational Camera for High Quality Dark Videography

Low-Light Color Imaging via Dual Camera Acquisition.

DMDC: a cross-attention network for dynamic mask-based dual-camera snapshot hyperspectral Photography

DarkVision: A Benchmark for Low-light Image/Video Perception

Low-Light Color Imaging Via Cross-Camera Synthesis.

DarkVisionNet: Low-Light Imaging via RGB-NIR Fusion with Deep Inconsistency Prior

Diving into Darkness: A Dual-Modulated Framework for High-Fidelity Super-Resolution in Ultra-Dark Environments

Enhancing Low Light Videos by Exploring High Sensitivity Camera Noise.

Diving into Darkness: A Dual-Modulated Framework for High-Fidelity Super-Resolution in Ultra-Dark Environments.

DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging

Dual-Camera Joint Deblurring-Denoising

Physics-based Noise Modeling for Extreme Low-light Photography

End-to-End Computational Imaging Based on Multispectral Fusion

Abandoning the Bayer-Filter to See in the Dark

Collaborative brightening and amplification of low-light imagery via bi-level adversarial learning

DarkFeat: Noise-Robust Feature Detector and Descriptor for Extremely Low-Light RAW Images.

Light-Dark: A Novel Lightweight Self-supervised Monocular Depth Estimation in the Dark

Retrieving Object Motions from Coded Shutter Snapshot in Dark Environment.

Joint Self-Supervised Enhancement and Denoising of Low-Light Images

DNF: Decouple and Feedback Network for Seeing in the Dark