Abstract:Obtaining pairs of low/normal-light videos, with motions, is more challenging than still images, which raises technical issues and poses the technical route of unpaired learning as a critical role. This paper makes endeavors in the direction of learning for low-light video enhancement without using paired ground truth. Compared to low-light image enhancement, enhancing low-light videos is more difficult due to the intertwined effects of noise, exposure, and contrast in the spatial domain, jointly with the need for temporal coherence. To address the above challenge, we propose the Unrolled Decomposed Unpaired Network (UDU-Net) for enhancing low-light videos by unrolling the optimization functions into a deep network to decompose the signal into spatial and temporal-related factors, which are updated iteratively. Firstly, we formulate low-light video enhancement as a Maximum A Posteriori estimation (MAP) problem with carefully designed spatial and temporal visual regularization. Then, via unrolling the problem, the optimization of the spatial and temporal constraints can be decomposed into different steps and updated in a stage-wise manner. From the spatial perspective, the designed Intra subnet leverages unpair prior information from expert photography retouched skills to adjust the statistical distribution. Additionally, we introduce a novel mechanism that integrates human perception feedback to guide network optimization, suppressing over/under-exposure conditions. Meanwhile, to address the issue from the temporal perspective, the designed Inter subnet fully exploits temporal cues in progressive optimization, which helps achieve improved temporal consistency in enhancement results. Consequently, the proposed method achieves superior performance to state-of-the-art methods in video illumination, noise suppression, and temporal consistency across outdoor and indoor scenes.

A Joint Model-Driven Unfolding Network for Degraded Low-Quality Color-Depth Images Enhancement

Dual Degradation-Inspired Deep Unfolding Network for Low-Light Image Enhancement

Joint Discontinuity-Aware Depth Map Super-Resolution Via Dual-Tasks Driven Unfolding Network

Brighten-and-Colorize: A Decoupled Network for Customized Low-Light Image Enhancement

Unrolled Decomposed Unpaired Learning for Controllable Low-Light Video Enhancement

Joint Correcting and Refinement for Balanced Low-Light Image Enhancement

Deep Arbitrary-Scale Unfolding Network for Color-Guided Depth Map Super-Resolution.

Joint low-light enhancement and deblurring with structural priors guidance

Learning an Enhancement Convolutional Neural Network for Multi-degraded Images

Photo-realistic Image Bit-Depth Enhancement Via Residual Transposed Convolutional Neural Network

Low-light Image Enhancement Network Based on Multi-Stream Information Supplement

Learning deep texture-structure decomposition for low-light image restoration and enhancement

Division gets better: Learning brightness-aware and detail-sensitive representations for low-light image enhancement

Unsupervised Low-Light Image Enhancement by Extracting Structural Similarity and Color Consistency

Mixed distortion image enhancement method based on joint of deep residuals learning and reinforcement learning

Low-Light Image Enhancement Using Hybrid Deep-Learning and Mixed-Norm Loss Functions

Low-light Image Enhancement Via Deep Retinex Decomposition and Bilateral Learning

Degradation-Guided Multi-Modal Fusion Network for Depth Map Super-Resolution

Explainable Unfolding Network for Joint Edge-Preserving Depth Map Super-Resolution.

Joint Iterative Color Correction and Dehazing for Underwater Image Enhancement

Deep Multi-path Low-light Image Enhancement