Abstract:Real-world low-light images captured by imaging devices suffer from poor visibility and require a domain-specific enhancement to produce artifact-free outputs that reveal details. However, it is usually challenging to create large-scale paired real-world low-light image datasets for training enhancement approaches. When trained with limited data, most supervised approaches do not perform well in generalizing to a wide variety of real-world images. In this article, we propose an unpaired low-light image enhancement network leveraging novel controlled transformation-based self-supervision and unpaired self-conditioning strategies. The model determines the required degrees of enhancement at the input image pixels, which are learned from the unpaired low-lit and well-lit images without any direct supervision. The self-supervision is based on a controlled transformation of the input image and subsequent maintenance of its enhancement in spite of the transformation. The self-conditioning performs training of the model on unpaired images such that it does not enhance an already-enhanced image or a well-lit input image. The inherent noise in the input low-light images is handled by employing low gradient magnitude suppression in a detail-preserving manner. In addition, our noise handling is self-conditioned by preventing the denoising of noise-free well-lit images. The training based on low-light image enhancement-specific attributes allows our model to avoid paired supervision without compromising significantly in performance. While our proposed self-supervision aids consistent enhancement, our novel self-conditioning facilitates adequate enhancement. Extensive experiments on multiple standard datasets demonstrate that our model, in general, outperforms the state-of-the-art both quantitatively and subjectively. Ablation studies show the effectiveness of our self-supervision and self-conditioning strategies, and the related loss functions.

Unsupervised low-light image enhancement by data augmentation and contrastive learning

Boosting Unsupervised Contrastive Learning Using Diffusion-Based Data Augmentation from Scratch

Low Light Enhancement by Unsupervised Network.

A Two-Stage Unsupervised Approach for Low Light Image Enhancement

Learning to See in Extremely Low-Light Environments with Small Data

Unsupervised Low-Light Image Enhancement Via Luminance Mask and Luminance-Independent Representation Decoupling

Self-Supervision via Controlled Transformation and Unpaired Self-Conditioning for Low-Light Image Enhancement

Unsupervised Illumination Adaptation for Low-Light Vision

Low-Light Image Enhancement Based on Deep Convolutional Neural Network

Leveraging Content and Context Cues for Low-Light Image Enhancement

Fusion-Based Low-Light Image Enhancement

Luminance Domain-Guided Low-Light Image Enhancement

Unsupervised Low-Light Image Enhancement via Virtual Diffraction Information in Frequency Domain

Low-light image enhancement based on deep learning: a survey

Semi-supervised Zero-Shot Learning in Retinex Decomposition-Based Low-Light Image Enhancement.

Unsupervised network for low-light enhancement

Division gets better: Learning brightness-aware and detail-sensitive representations for low-light image enhancement

Learning To Restore Low-Light Images Via Decomposition-And-Enhancement

More Than Lightening: A Self-Supervised Low-Light Image Enhancement Method Capable for Multiple Degradations

A Survey of Deep Learning-Based Low-Light Image Enhancement

Retinex Model with Learned Prior for Partly-Paired Low-Light Image Enhancement