Low-Light Image Enhancement by Learning Contrastive Representations in Spatial and Frequency Domains

Yi Huang,Xiaoguang Tu,Gui Fu,Tingting Liu,Bokai Liu,Ming Yang,Ziliang Feng

2023-03-24

Abstract:Images taken under low-light conditions tend to suffer from poor visibility, which can decrease image quality and even reduce the performance of the downstream tasks. It is hard for a CNN-based method to learn generalized features that can recover normal images from the ones under various unknow low-light conditions. In this paper, we propose to incorporate the contrastive learning into an illumination correction network to learn abstract representations to distinguish various low-light conditions in the representation space, with the purpose of enhancing the generalizability of the network. Considering that light conditions can change the frequency components of the images, the representations are learned and compared in both spatial and frequency domains to make full advantage of the contrastive learning. The proposed method is evaluated on LOL and LOL-V2 datasets, the results show that the proposed method achieves better qualitative and quantitative results compared with other state-of-the-arts.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

This paper attempts to address the problem of image enhancement under low-light conditions. Specifically, images captured under low-light conditions often suffer from low brightness, unsaturated colors, and loss of details. These issues not only degrade image quality but also limit the performance of downstream tasks. Existing CNN-based methods struggle to restore normal images from various unknown low-light conditions because publicly available datasets are incomplete, leading to insufficient generalization capabilities of these methods.

To solve this problem, the authors propose a contrastive learning-based illumination correction framework. This framework improves the network's generalization ability by learning the feature differences under different low-light conditions in the representation space, rather than directly relying on labeled training data for supervised learning. Additionally, the authors introduce an adaptive weighted frequency loss function to increase the network's attention to high-frequency signals, thereby alleviating the spectral bias problem present in convolutional neural networks during image reconstruction. Experimental results show that this method outperforms other existing methods on multiple datasets.