Self-Supervision via Controlled Transformation and Unpaired Self-Conditioning for Low-Light Image Enhancement

Aupendu Kar,Sobhan Kanti Dhara,Debashis Sen,Prabir Kumar Biswas

DOI: https://doi.org/10.1109/tim.2024.3370779

IF: 5.6

2024-03-19

IEEE Transactions on Instrumentation and Measurement

Abstract:Real-world low-light images captured by imaging devices suffer from poor visibility and require a domain-specific enhancement to produce artifact-free outputs that reveal details. However, it is usually challenging to create large-scale paired real-world low-light image datasets for training enhancement approaches. When trained with limited data, most supervised approaches do not perform well in generalizing to a wide variety of real-world images. In this article, we propose an unpaired low-light image enhancement network leveraging novel controlled transformation-based self-supervision and unpaired self-conditioning strategies. The model determines the required degrees of enhancement at the input image pixels, which are learned from the unpaired low-lit and well-lit images without any direct supervision. The self-supervision is based on a controlled transformation of the input image and subsequent maintenance of its enhancement in spite of the transformation. The self-conditioning performs training of the model on unpaired images such that it does not enhance an already-enhanced image or a well-lit input image. The inherent noise in the input low-light images is handled by employing low gradient magnitude suppression in a detail-preserving manner. In addition, our noise handling is self-conditioned by preventing the denoising of noise-free well-lit images. The training based on low-light image enhancement-specific attributes allows our model to avoid paired supervision without compromising significantly in performance. While our proposed self-supervision aids consistent enhancement, our novel self-conditioning facilitates adequate enhancement. Extensive experiments on multiple standard datasets demonstrate that our model, in general, outperforms the state-of-the-art both quantitatively and subjectively. Ablation studies show the effectiveness of our self-supervision and self-conditioning strategies, and the related loss functions.

engineering, electrical & electronic,instruments & instrumentation