Abstract:Temporal inconsistency is the annoying artifact that has been commonly introduced in low-light video enhancement, but current methods tend to overlook the significance of utilizing both data-centric clues and model-centric design to tackle this problem. In this context, our work makes a comprehensive exploration from the following three aspects. First, to enrich the scene diversity and motion flexibility, we construct a synthetic diverse low/normal-light paired video dataset with a carefully designed low-light simulation strategy, which can effectively complement existing real captured datasets. Second, for better temporal dependency utilization, we develop a Temporally Consistent Enhancer Network (TCE-Net) that consists of stacked 3D convolutions and 2D convolutions to exploit spatial-temporal clues in videos. Last, the temporal dynamic feature dependencies are exploited to obtain consistency constraints for different frame indexes. All these efforts are powered by a Spatial-Temporal Compatible Learning (STCL) optimization technique, which dynamically constructs specific training loss functions adaptively on different datasets. As such, multiple-frame information can be effectively utilized and different levels of information from the network can be feasibly integrated, thus expanding the synergies on different kinds of data and offering visually better results in terms of illumination distribution, color consistency, texture details, and temporal coherence. Extensive experimental results on various real-world low-light video datasets clearly demonstrate the proposed method achieves superior performance to state-of-the-art methods. Our code and synthesized low-light video database will be publicly available at https://github.com/lingyzhu0101/low-light-video-enhancement.git.

Watching It in Dark: A Target-aware Representation Learning Framework for High-Level Vision Tasks in Low Illumination

Mutual Support and Promotion: Learning Structure Compensation and Context Completion for Low-Light Vision

Unsupervised Illumination Adaptation for Low-Light Vision

You Only Look Around: Learning Illumination Invariant Feature for Low-light Object Detection

Self-Aligned Concave Curve: Illumination Enhancement for Unsupervised Adaptation

Temporally Consistent Enhancement of Low-Light Videos via Spatial-Temporal Compatible Learning

Learning an Adaptive Model for Extreme Low-light Raw Image Processing

Low-Light Image Enhancement by Learning Contrastive Representations in Spatial and Frequency Domains

Research on Target Image Classification in Low-Light Night Vision

Learning With Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision

EFLNet: Enhancing Feature Learning for Infrared Small Target Detection

Ultra-High-Definition Low-Light Image Enhancement: A Benchmark and Transformer-Based Method

Learning an adaptive model for extreme low‐light raw image processing

End-to-End Retinex-Based Illumination Attention Low-Light Enhancement Network for Autonomous Driving at Night

Learning Adaptive Lighting via Channel-Aware Guidance

Dark2Light: multi-stage progressive learning model for low-light image enhancement

Low-Light Image and Video Enhancement Using Deep Learning: A Survey

DarkFeat: Noise-Robust Feature Detector and Descriptor for Extremely Low-Light RAW Images.

Fast and Accurate Detection of Dim and Small Targets for Smart Micro-Light Sight

Seeing Dark Videos Via Self-Learned Bottleneck Neural Representation

DTCM: Joint Optimization of Dark Enhancement and Action Recognition in Videos