PIE: Physics-inspired Low-light Enhancement

Dong Liang,Zhengyan Xu,Ling Li,Mingqiang Wei,Songcan Chen

2024-04-06

Abstract:In this paper, we propose a physics-inspired contrastive learning paradigm for low-light enhancement, called PIE. PIE primarily addresses three issues: (i) To resolve the problem of existing learning-based methods often training a LLE model with strict pixel-correspondence image pairs, we eliminate the need for pixel-correspondence paired training data and instead train with unpaired images. (ii) To address the disregard for negative samples and the inadequacy of their generation in existing methods, we incorporate physics-inspired contrastive learning for LLE and design the Bag of Curves (BoC) method to generate more reasonable negative samples that closely adhere to the underlying physical imaging principle. (iii) To overcome the reliance on semantic ground truths in existing methods, we propose an unsupervised regional segmentation module, ensuring regional brightness consistency while eliminating the dependency on semantic ground truths. Overall, the proposed PIE can effectively learn from unpaired positive/negative samples and smoothly realize non-semantic regional enhancement, which is clearly different from existing LLE efforts. Besides the novel architecture of PIE, we explore the gain of PIE on downstream tasks such as semantic segmentation and face detection. Training on readily available open data and extensive experiments demonstrate that our method surpasses the state-of-the-art LLE models over six independent cross-scenes datasets. PIE runs fast with reasonable GFLOPs in test time, making it easy to use on mobile devices.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper attempts to address three key challenges in the field of Low-light Enhancement (LLE):

1. **Addressing the need for strictly pixel-corresponding image pairs**:
- Existing learning-based methods typically require strictly pixel-corresponding image pairs for training, which is very difficult to obtain in practical applications. The paper proposes a training method that does not require pixel-corresponding paired data but instead uses unpaired images for training.

2. **Addressing the insufficiency of negative sample generation**:
- Existing methods overlook the importance of negative samples and their generation methods in contrastive learning. The paper introduces a physics-inspired contrastive learning approach and designs a method called "Bag of Curves" (BoC) to generate more reasonable negative samples that better align with the underlying physical imaging principles.

3. **Addressing the dependency on semantic annotations**:
- Existing methods typically rely on semantic annotations to maintain regional brightness consistency. The paper proposes an unsupervised region segmentation module that ensures regional brightness consistency while eliminating the dependency on semantic annotations.

By addressing the above issues, the paper proposes a new Physics-inspired Low-light Enhancement (PIE) framework that can effectively learn from unpaired positive and negative samples and achieve smooth enhancement of non-semantic regions. Additionally, the paper explores the performance improvement of PIE in downstream tasks such as semantic segmentation and face detection. Experimental results show that PIE outperforms existing state-of-the-art LLE models on six independent cross-scene datasets and runs fast on mobile devices with reasonable GFLOPs.