Improving the perception of low-light enhanced images

Javier Vazquez-Corral,Graham D. Finlayson,Luis Herranz

DOI: https://doi.org/10.1364/oe.509713

IF: 3.8

2024-01-31

Optics Express

Abstract:Javier Vazquez-Corral, Graham D. Finlayson, Luis Herranz Improving images captured under low-light conditions has become an important topic in computational color imaging, as it has a wide range ... [Opt. Express 32, 5174-5190 (2024)]

optics

What problem does this paper attempt to address?

Research on Low-Light Image Enhancement Algorithm Based on Filtering and Data-Driven Composite

Jiang Wu,Zhengdong Cheng,Yi Chen,Bin Xie

DOI: https://doi.org/10.1117/12.3016282

2024-01-01

Abstract:Low-light images have low visibility, poor contrast, and weakened details, which pose significant obstacles for subsequent computer vision tasks. When enhancing low-light images, multiple factors such as brightness, contrast, artifacts, and noise need to be considered, making this problem challenging. Low-light enhancement algorithms based on the Retinex theory are important methods in the field of image enhancement, with a wide range of applications and practicality. In this paper, starting from the low-light image imaging model, we address the issues of color distortion and limited brightness improvement exhibited by traditional Retinex-based algorithms and deep learning algorithms in actual low-light scenarios. We propose a filtering and data-driven composite enhancement algorithm (FADDC) that performs weighted fusion on output and intermediate quantities before outputting them. Experimental results combining SCI-Net with traditional algorithms SSR and MSR demonstrate that this fusion method can effectively enhance image brightness without color distortion, achieving better enhancement results.
Low-light Image Enhancement with Strong Light Weakening and Bright Halo Suppressing.

Chaoying Tang,Yeru Wang,Huajun Feng,Zhihai Xu,Qi Li,Yueting Chen

DOI: https://doi.org/10.1049/iet-ipr.2018.5505

IF: 2.3

2018-01-01

IET Image Processing

Abstract:Low-light enhancement methods suffer from the over-enhancement problem which could induce the loss of the important texture and make images look unnatural. Moreover, some low-light images contain strong light areas that must be weakened to improve the visual effect. In this study, an enhancement method with strong light weakening and bright halo suppressing is presented. Firstly, the bright channel prior is applied to the inverted image to weaken the strong light both in and around the strong light areas. Then, a dehazing-type of algorithm with the dark channel prior is employed via superpixel segmentation to enhance the low-light image. Finally, a revised non-local denoising method is proposed to further refine the enhanced image. Experimental results showed that the proposed method achieved better visual effects compared with other state-of-the-art methods. Besides, the quantitative evaluation showed that the authors' method outperforms the other methods both in the aspect of enhancement and denoising.
Low Light Enhancement by Unsupervised Network.

Yangyang Qu,Yongsheng Ou,Rong Xiong

DOI: https://doi.org/10.1109/rcar49640.2020.9303267

2020-01-01

Abstract:This paper focuses on unsupervised low-light enhancement methods for practical applications such as automated driving, surveillance cameras, and so on. This paper proposes an unsupervised method that is independent of paired samples and works well to solve the image darkness problem. Furthermore, to increase the brightness of the image and restore the information hidden in the dark, an auxiliary attention module is incorporated into our model. This proposed module can help generate images with good edges and make the image colors and details richer. The experimental results show that the proposed method works well for both image enhancement and noise control.
Visual Perception Model for Rapid and Adaptive Low-light Image Enhancement

Xiaoxiao Li,Xiaopeng Guo,Liye Mei,Mingyu Shang,Jie Gao,Maojing Shu,Xiang Wang

DOI: https://doi.org/10.48550/arXiv.2005.07343

2020-05-15

Image and Video Processing

Abstract:Low-light image enhancement is a promising solution to tackle the problem of insufficient sensitivity of human vision system (HVS) to perceive information in low light environments. Previous Retinex-based works always accomplish enhancement task by estimating light intensity. Unfortunately, single light intensity modelling is hard to accurately simulate visual perception information, leading to the problems of imbalanced visual photosensitivity and weak adaptivity. To solve these problems, we explore the precise relationship between light source and visual perception and then propose the visual perception (VP) model to acquire a precise mathematical description of visual perception. The core of VP model is to decompose the light source into light intensity and light spatial distribution to describe the perception process of HVS, offering refinement estimation of illumination and reflectance. To reduce complexity of the estimation process, we introduce the rapid and adaptive $\mathbf{\beta}$ and $\mathbf{\gamma}$ functions to build an illumination and reflectance estimation scheme. Finally, we present a optimal determination strategy, consisting of a \emph{cycle operation} and a \emph{comparator}. Specifically, the \emph{comparator} is responsible for determining the optimal enhancement results from multiple enhanced results through implementing the \emph{cycle operation}. By coordinating the proposed VP model, illumination and reflectance estimation scheme, and the optimal determination strategy, we propose a rapid and adaptive framework for low-light image enhancement. Extensive experiment results demenstrate that the proposed method achieves better performance in terms of visual comparison, quantitative assessment, and computational efficiency, compared with the currently state-of-the-arts.
Effective method for low-light image enhancement based on the JND and OCTM models

Yi-Zheng Lang,Yi-Lun Wang,Yun-Sheng Qian,Xiang-Yu Kong,Yang Cao

DOI: https://doi.org/10.1364/OE.485672

IF: 3.8

2023-01-01

Optics Express

Abstract:Low-light images always suffer from dim overall brightness, low contrast, and low dynamic ranges, thus result in image degradation. In this paper, we propose an effective method for low-light image enhancement based on the just-noticeable-difference (JND) and the optimal contrast-tone mapping (OCTM) models. First, the guided filter decomposes the original images into base and detail images. After this filtering, detail images are processed based on the visual masking model to enhance details effectively. At the same time, the brightness of base images is adjusted based on the JND and OCTM models. Finally, we propose a new method to generate a sequence of artificial images to adjust the brightness of the output, which has a better performance in image detail preservation compared with other single-input algorithms. Experiments have demonstrated that the proposed method not only achieves low-light image enhancement, but also outperforms state-of-the-art methods qualitatively and quantitatively.(c) 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
Low-light Image Enhancement via Breaking Down the Darkness

Qiming Hu,Xiaojie Guo

DOI: https://doi.org/10.48550/arXiv.2111.15557

2021-12-01

Abstract:Images captured in low-light environment often suffer from complex degradation. Simply adjusting light would inevitably result in burst of hidden noise and color distortion. To seek results with satisfied lighting, cleanliness, and realism from degraded inputs, this paper presents a novel framework inspired by the divide-and-rule principle, greatly alleviating the degradation entanglement. Assuming that an image can be decomposed into texture (with possible noise) and color components, one can specifically execute noise removal and color correction along with light adjustment. Towards this purpose, we propose to convert an image from the RGB space into a luminance-chrominance one. An adjustable noise suppression network is designed to eliminate noise in the brightened luminance, having the illumination map estimated to indicate noise boosting levels. The enhanced luminance further serves as guidance for the chrominance mapper to generate realistic colors. Extensive experiments are conducted to reveal the effectiveness of our design, and demonstrate its superiority over state-of-the-art alternatives both quantitatively and qualitatively on several benchmark datasets. Our code is publicly available at <a class="link-external link-https" href="https://github.com/mingcv/Bread" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Experimental Analysis of Low-Light Image Enhancement Techniques: A Review

Naazaan Shaheen,Yogendra Singh

DOI: https://doi.org/10.46610/joadd.2022.v07i03.001

2022-09-01

Journal of Analog and Digital Devices

Abstract:Images acquired in low-light situations generally suffer from subjective visual effects on human eyes and the performance of different machine vision systems due to low brightness, low contrast, a limited gray range, color distortion, and high noise. Enhancing photographs taken in low light is done so that they may be used in other applications more effectively. In this study, we look back at some of the most important methods for improving images in dim light. We categorize these techniques into seven distinct groups: gray transformation, histogram equalization, Retinex, frequency-domain, picture fusion, defogging model, and machine learning. Methods are presented across the board, from the broadest to the most specific categories, emphasizing the underlying concepts and distinguishing features. Different improved picture quality assessment techniques are also described, as are comparisons of the various algorithms used. Finally, a state-of-the-art summary and recommendations for where the field should go are presented.
An Experiment-Based Review of Low-Light Image Enhancement Methods

Wencheng Wang,Xiaojin Wu,Xiaohui Yuan,Zairui Gao

DOI: https://doi.org/10.1109/access.2020.2992749

IF: 3.9

2020-01-01

IEEE Access

Abstract:Images captured under poor illumination conditions often exhibit characteristics such as low brightness, low contrast, a narrow gray range, and color distortion, as well as considerable noise, which seriously affect the subjective visual effect on human eyes and greatly limit the performance of various machine vision systems. The role of low-light image enhancement is to improve the visual effect of such images for the benefit of subsequent processing. This paper reviews the main techniques of low-light image enhancement developed over the past decades. First, we present a new classification of these algorithms, dividing them into seven categories: gray transformation methods, histogram equalization methods, Retinex methods, frequency-domain methods, image fusion methods, defogging model methods and machine learning methods. Then, all the categories of methods, including subcategories, are introduced in accordance with their principles and characteristics. In addition, various quality evaluation methods for enhanced images are detailed, and comparisons of different algorithms are discussed. Finally, the current research progress is summarized, and future research directions are suggested.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Novel Framework For Enhancement Of The Low Lighting Video

Jianhua Pang,Sheng Zhang,Wencang Bai

DOI: https://doi.org/10.1109/ISCC.2017.8024714

2017-01-01

Abstract:A novel and effective framework for the enhancement of low lighting images is proposed in this paper. The novel framework presents an optimized de-haze algorithm on inverted images to enhance the low-dynamic-range images which optimizes the complicated process of computing the parameters A and t(x). The improved gamma correction is used to enhance the image contrast for providing better visual performance. For the noise signal is magnified simultaneously, the guided filter has been adapted for the noise reduction with the green channel as the guided image. The framework can real-time work with its low computational complexity. The luminance enhancement part reveals the relationship between the Retinex and the de-haze algorithm.
Enhancing Low-Light Images Using Infrared-Encoded Images

Shulin Tian,Yufei Wang,Renjie Wan,Wenhan Yang,Alex C. Kot,Bihan Wen

2023-07-09

Abstract:Low-light image enhancement task is essential yet challenging as it is ill-posed intrinsically. Previous arts mainly focus on the low-light images captured in the visible spectrum using pixel-wise loss, which limits the capacity of recovering the brightness, contrast, and texture details due to the small number of income photons. In this work, we propose a novel approach to increase the visibility of images captured under low-light environments by removing the in-camera infrared (IR) cut-off filter, which allows for the capture of more photons and results in improved signal-to-noise ratio due to the inclusion of information from the IR spectrum. To verify the proposed strategy, we collect a paired dataset of low-light images captured without the IR cut-off filter, with corresponding long-exposure reference images with an external filter. The experimental results on the proposed dataset demonstrate the effectiveness of the proposed method, showing better performance quantitatively and qualitatively. The dataset and code are publicly available at <a class="link-external link-https" href="https://wyf0912.github.io/ELIEI/" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Image and Video Processing
Non-Uniform Illumination and Low Light Image Enhancement Techniques: An Exhaustive Study

Aashi Singh Bhadouria

DOI: https://doi.org/10.22214/ijraset.2022.40385

2022-02-28

International Journal for Research in Applied Science and Engineering Technology

Abstract:Abstract: Different kinds of Images captured are an important medium to represent meaningful information. It can be problematic for artificial intelligence, computer vision techniques and detection algorithms to extract valuable information from those images with poor lighting. In this paper, a study of low illumination-based low-light night image enhancement techniques are presented which work on reflectance, degradation, unsatisfactory lightings, noise, limited range visibility, low contrast, color variations, illumination, color distortion, and quality is reduced. Improving the images in low light conditions is a prerequisite in many fields, such as surveillance systems, road safety and inland waterway transport, object tracking, scientific research, the detection system, the counting system and the navigation system. Low-illumination or night image enhancement algorithms can advance the visual quality of low-light images and these images can be used in many practical application’s artificial intelligence and computer vision techniques. The methods used for enhancement of low illumination must perform, preserving details, contrast improvement, color correction, noise reduction, image enhancement, restoration, etc. Keywords: Image Enhancement, Low Illumination, Reflectance, Low Contrast, Low Light Images, Night Time Images, Low Visibility Images.
Low-light and hazy image enhancement using retinex theory and wavelet transform fusion

Tyagi, Praveen Kumar

DOI: https://doi.org/10.1007/s11042-024-18459-7

IF: 2.577

2024-02-11

Multimedia Tools and Applications

Abstract:In contemporary times, image enhancement is playing an increasingly important role in image analysis and synthesis. This article introduces an algorithm that aims to enhance the visual information of low-light or hazy images while also improving quantitative metrics such as peak signal to noise ratio, discrete entropy, feature similarity, and structural index. The methodology leverages a multi-pronged approach involving illumination estimation, an enhanced coefficient for a filter to remove haze, along with the fusion of Discrete Wavelet Transform (DWT) tailored to fortify insufficiently illuminated images. In the initial phase, a computation of modified illumination is executed to rectify underexposed regions, thereby enhancing overall viewing quality. Following this, an inversion operation is applied to the image, setting the stage for an optimized de-hazing process aimed at eliminating haze artifacts. The subsequent integration of a DWT-based fusion strategy serves to distil salient features from both images, amalgamating them into a cohesive, enhanced output. Simulation results demonstrate a significant improvement over previously proposed algorithms in terms of visibility and quantitative performance.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Color Constancy-Based Visibility Enhancement in Low-Light Conditions

YU Jing,LI Da-Peng,LIAO Qing-Min

DOI: https://doi.org/10.1109/dicta.2010.81

2011-01-01

ACTA AUTOMATICA SINICA

Abstract:Imaging in low-light conditions is often significantly degraded by insufficient lighting and color cast. Poor visibility becomes a major problem for many applications of computer vision. In this paper, we propose a novel color constancy-based method to enhance the visibility of low-light images. The proposed method applies an appropriate color constancy algorithm to the active set of pixels across the image. The post-processing step is also added to enhance the global contrast and lightness. Results on a wide variety of images demonstrate that the proposed method can achieve good rendition for lightness, contrast and color fidelity without graying-out artifacts or halo artifacts intrinsically present in Retinex approaches.
Color and Luminance Separated Enhancement for Low-Light Images with Brightness Guidance

Feng Zhang,Xinran Liu,Changxin Gao,Nong Sang

DOI: https://doi.org/10.3390/s24092711

IF: 3.9

2024-04-25

Sensors

Abstract:Existing retinex-based low-light image enhancement strategies focus heavily on crafting complex networks for Retinex decomposition but often result in imprecise estimations. To overcome the limitations of previous methods, we introduce a straightforward yet effective strategy for Retinex decomposition, dividing images into colormaps and graymaps as new estimations for reflectance and illumination maps. The enhancement of these maps is separately conducted using a diffusion model for improved restoration. Furthermore, we address the dual challenge of perturbation removal and brightness adjustment in illumination maps by incorporating brightness guidance. This guidance aids in precisely adjusting the brightness while eliminating disturbances, ensuring a more effective enhancement process. Extensive quantitative and qualitative experimental analyses demonstrate that our proposed method improves the performance by approximately 4.4% on the LOL dataset compared to other state-of-the-art diffusion-based methods, while also validating the model's generalizability across multiple real-world datasets.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Revealing Shadows: Low-Light Image Enhancement Using Self-Calibrated Illumination

Farzaneh Koohestani,Nader Karimi,Shadrokh Samavi

2023-12-23

Abstract:In digital imaging, enhancing visual content in poorly lit environments is a significant challenge, as images often suffer from inadequate brightness, hidden details, and an overall reduction in quality. This issue is especially critical in applications like nighttime surveillance, astrophotography, and low-light videography, where clear and detailed visual information is crucial. Our research addresses this problem by enhancing the illumination aspect of dark images. We have advanced past techniques by using varied color spaces to extract the illumination component, enhance it, and then recombine it with the other components of the image. By employing the Self-Calibrated Illumination (SCI) method, a strategy initially developed for RGB images, we effectively intensify and clarify details that are typically lost in low-light conditions. This method of selective illumination enhancement leaves the color information intact, thus preserving the color integrity of the image. Crucially, our method eliminates the need for paired images, making it suitable for situations where they are unavailable. Implementing the modified SCI technique represents a substantial shift from traditional methods, providing a refined and potent solution for low-light image enhancement. Our approach sets the stage for more complex image processing techniques and extends the range of possible real-world applications where accurate color representation and improved visibility are essential.

Computer Vision and Pattern Recognition,Image and Video Processing
Gap-closing Matters: Perceptual Quality Evaluation and Optimization of Low-Light Image Enhancement

Baoliang Chen,Lingyu Zhu,Hanwei Zhu,Wenhan Yang,Linqi Song,Shiqi Wang

DOI: https://doi.org/10.1109/TMM.2023.3312851

2024-06-21

Abstract:There is a growing consensus in the research community that the optimization of low-light image enhancement approaches should be guided by the visual quality perceived by end users. Despite the substantial efforts invested in the design of low-light enhancement algorithms, there has been comparatively limited focus on assessing subjective and objective quality systematically. To mitigate this gap and provide a clear path towards optimizing low-light image enhancement for better visual quality, we propose a gap-closing framework. In particular, our gap-closing framework starts with the creation of a large-scale dataset for Subjective QUality Assessment of REconstructed LOw-Light Images (SQUARE-LOL). This database serves as the foundation for studying the quality of enhanced images and conducting a comprehensive subjective user study. Subsequently, we propose an objective quality assessment measure that plays a critical role in bridging the gap between visual quality and enhancement. Finally, we demonstrate that our proposed objective quality measure can be incorporated into the process of optimizing the learning of the enhancement model toward perceptual optimality. We validate the effectiveness of our proposed framework through both the accuracy of quality prediction and the perceptual quality of image enhancement. Our database and codes are publicly available at <a class="link-external link-https" href="https://github.com/Baoliang93/IACA_For_Lowlight_IQA" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Image and Video Processing
A Variational Framework for Single Low Light Image Enhancement Using Bright Channel Prior

Xueyang Fu,Delu Zeng,Yue Huang,Xinghao Ding,Xiao-Ping Zhang

DOI: https://doi.org/10.1109/globalsip.2013.6737082

2013-01-01

Abstract:Low light image enhancement is prerequisite in many fields, such as surveillance systems, road safety and waterway transport. In this paper, a new variational framework using bright channel prior is proposed to address the low light image enhancement problem within a single image. An alternating direction optimization method is employed to solve the variational problem. Experiment results show that the new method can better eliminate the black halo and suppressing the issues of over-enhancement and color distortion when compared with other existing methods.
Low-Illumination Image Enhancement Based on Deep Learning Techniques: A Brief Review

Hao Tang,Hongyu Zhu,Linfeng Fei,Tingwei Wang,Yichao Cao,Chao Xie

DOI: https://doi.org/10.3390/photonics10020198

IF: 2.536

2023-02-13

Photonics

Abstract:As a critical preprocessing technique, low-illumination image enhancement has a wide range of practical applications. It aims to improve the visual perception of a given image captured without sufficient illumination. Conventional low-illumination image enhancement methods are typically implemented by improving image brightness, enhancing image contrast, and suppressing image noise simultaneously. Nevertheless, recent advances in this area are dominated by deep-learning-based solutions, and consequently, various deep neural networks have been proposed and applied to this field. Therefore, this paper briefly reviews the latest low-illumination image enhancement, ranging from its related algorithms to its unsolved open issues. Specifically, current low-illumination image enhancement methods based on deep learning are first sorted out and divided into four categories: supervised learning methods, unsupervised learning methods, semi-supervised learning methods, and zero-shot learning methods. Then, existing low-light image datasets are summarized and analyzed. In addition, various quality assessment indices for low-light image enhancement are introduced in detail. We also compare 14 representative algorithms in terms of both objective evaluation and subjective evaluation. Finally, the future development trend of low-illumination image enhancement and its open issues are summarized and prospected.

optics
Low-Light Image Enhancement with Multi-Scale Attention and Frequency-Domain Optimization

Zhiquan He,Wu Ran,Shulin Liu,Kehua Li,Jiawen Lu,Changyong Xie,Yong Liu,Hong Lu

DOI: https://doi.org/10.1109/tcsvt.2023.3313348

IF: 5.859

2023-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Low-light image enhancement aims to improve the perceptual quality of images captured in conditions of insufficient illumination. However, such images are often characterized by low visibility and noise, making the task challenging. Recently, significant progress has been made using deep learning-based approaches. Nonetheless, existing methods encounter difficulties in balancing global and local illumination enhancement and may fail to suppress noise in complex lighting conditions. To address these issues, we first propose a multi-scale illumination adjustment network to balance both global illumination and local contrast. Furthermore, to effectively suppress noise potentially amplified by the illumination adjustment, we introduce a wavelet-based attention network that efficiently perceives and removes noise in the frequency domain. We additionally incorporate a discrete wavelet transform loss to supervise the training process. Particularly, the proposed wavelet-based attention network has been shown to enhance the performance of existing low-light image enhancement methods. This observation indicates that the proposed wavelet-based attention network can be flexibly adapted to current approaches to yield superior enhancement results. Furthermore, extensive experiments conducted on benchmark datasets and downstream object detection task demonstrate that our proposed method achieves state-of-the-art performance and generalization ability.
A comprehensive experiment-based review of low-light image enhancement methods and benchmarking low-light image quality assessment

Muhammad Tahir Rasheed,Daming Shi,Hufsa Khan

DOI: https://doi.org/10.1016/j.sigpro.2022.108821

IF: 4.729

2023-03-01

Signal Processing

Abstract:Low-light image enhancement is a notoriously challenging problem. Enhancement of low-light images is intended to increase contrast, adjust the tone, suppress noise, and produce better aesthetic quality images. Over the years, a large number of state-of-the-art classical and deep learning-based methods have been designed. The purpose of this experimental review is to examine the generalization ability of these methods. In order to examine the generalization ability of these methods (classical and deep learning-based) empirical analysis and relevant comparisons are performed on a wide range of commonly used test datasets using a variety of evaluation techniques. In addition, we have studied the inconsistency of low-light evaluation methods and highlighted their drawbacks. This inconsistency raises the question of whether the existing methods are able to fairly evaluate enhancement methods. In order to address this question, we propose a large no-reference perceptual image quality assessment (PIQA) dataset. Additionally, different deep learning-based methods have been trained on this PIQA dataset in order to provide benchmarking for developing learning-based low-light assessment methods. Finally, this review paper is concluded with current challenges and suggestions for future work.

engineering, electrical & electronic

Improving the perception of low-light enhanced images

Research on Low-Light Image Enhancement Algorithm Based on Filtering and Data-Driven Composite

Low-light Image Enhancement with Strong Light Weakening and Bright Halo Suppressing.

Low Light Enhancement by Unsupervised Network.

Visual Perception Model for Rapid and Adaptive Low-light Image Enhancement

Effective method for low-light image enhancement based on the JND and OCTM models

Low-light Image Enhancement via Breaking Down the Darkness

Experimental Analysis of Low-Light Image Enhancement Techniques: A Review

An Experiment-Based Review of Low-Light Image Enhancement Methods

A Novel Framework For Enhancement Of The Low Lighting Video

Enhancing Low-Light Images Using Infrared-Encoded Images

Non-Uniform Illumination and Low Light Image Enhancement Techniques: An Exhaustive Study

Low-light and hazy image enhancement using retinex theory and wavelet transform fusion

Color Constancy-Based Visibility Enhancement in Low-Light Conditions

Color and Luminance Separated Enhancement for Low-Light Images with Brightness Guidance

Revealing Shadows: Low-Light Image Enhancement Using Self-Calibrated Illumination

Gap-closing Matters: Perceptual Quality Evaluation and Optimization of Low-Light Image Enhancement

A Variational Framework for Single Low Light Image Enhancement Using Bright Channel Prior

Low-Illumination Image Enhancement Based on Deep Learning Techniques: A Brief Review

Low-Light Image Enhancement with Multi-Scale Attention and Frequency-Domain Optimization

A comprehensive experiment-based review of low-light image enhancement methods and benchmarking low-light image quality assessment