Abstract:Low-light image enhancement (LLIE) investigates how to improve the brightness of an image captured in illumination-insufficient environments. The majority of existing methods enhance low-light images in a global and uniform manner, without taking into account the semantic information of different regions. Consequently, a network may easily deviate from the original color of local regions. To address this issue, we propose a semantic-aware knowledge-guided framework (SKF) that can assist a low-light enhancement model in learning rich and diverse priors encapsulated in a semantic segmentation model. We concentrate on incorporating semantic knowledge from three key aspects: a semantic-aware embedding module that adaptively integrates semantic priors in feature representation space, a semantic-guided color histogram loss that preserves color consistency of various instances, and a semantic-guided adversarial loss that produces more natural textures by semantic priors. Our SKF is appealing in acting as a general framework in the LLIE task. We further present a refined framework SKF++ with two new techniques: (a) Extra convolutional branch for intra-class illumination and color recovery through extracting local information and (b) Equalization-based histogram transformation for contrast enhancement and high dynamic range adjustment. Extensive experiments on various benchmarks of LLIE task and other image processing tasks show that models equipped with the SKF/SKF++ significantly outperform the baselines and our SKF/SKF++ generalizes to different models and scenes well. Besides, the potential benefits of our method in face detection and semantic segmentation in low-light conditions are discussed. The code and pre-trained models have been publicly available at https://github.com/langmanbusi/Semantic-Aware-Low-Light-Image-Enhancement.

The Symmetric Generalized LIP Model and Its Application in Dynamic Range Enhancement

Toward a General Model for Reflection Recovery and Single Image Enhancement.

L0 image smoothing via iterating truncated L1 gradient regularization

Improved Restoration Algorithm for Weakly Blurred and Strongly Noisy Image

Single Parameter Logarithmic Image Processing For Edge Detection

Image Enhancement Thanks to Negative Grey Levels in the Logarithmic Image Processing Framework

Potential Equivalence of Sinogram and Image-Domain Penalized Likelihood Methods

DI-Retinex: Digital-Imaging Retinex Theory for Low-Light Image Enhancement

Low-Light Image Enhancement via the Absorption Light Scattering Model

Generalized Equalization Model for Image Enhancement

Logarithmic mathematical morphology: a new framework adaptive to illumination changes

Exploring Illumination Removal of Face Image Via Logarithmic Gradient Penalty for Accurate Facial Expression Recognition

Remote Sensing Image Enhancement Based on the Combination of Adaptive Nonlinear Gain and the PLIP Model in the NSST Domain

Image Enhancement Using Modified Histogram and Log-Exp Transformation

A Variational Model for Nonuniform Low-Light Image Enhancement

Fast Augmented Lagrangian Method for Image Smoothing with Hyper-Laplacian Gradient Prior.

Towards a Flexible Semantic Guided Model for Single Image Enhancement and Restoration

L-DiffER: Single Image Reflection Removal with Language-based Diffusion Model

Enhancing the Visual Effectiveness of Overexposed and Underexposed Images in Power Marketing Field Operations Using Gray Scale Logarithmic Transformation and Histogram Equalization

Enhancing low-light images using Sakaguchi type function and Gegenbauer polynomial

Denoising Diffusion Post-Processing for Low-Light Image Enhancement