LLISP: Low-Light Image Signal Processing Net via Two-Stage Network

Hongjin Zhu,Yang Zhao,Rongjie Wang,Ronggang Wang,Weiqiang Chen,Xuesong Gao
DOI: https://doi.org/10.1109/access.2021.3053607
IF: 3.9
2021-01-01
IEEE Access
Abstract:Images taken in extremely low light suffer from various problems such as heavy noise, blur, and color distortion. Assuming the low-light images contain a good representation of the scene content, current enhancement methods focus on finding a suitable illumination adjustment but often fail to deal with heavy noise and color distortion. Recently, some works try to suppress noise and reconstruct low-light images from raw data. But these works apply a network instead of an image signal processing pipeline (ISP) to map the raw data to enhanced results which leads to heavy learning burden for the network and get unsatisfactory results. In order to remove heavy noise, correct color bias and enhance details more effectively, we propose a two-stage Low Light Image Signal Processing Network named LLISP. The design of our network is inspired by the traditional ISP: processing the images in multiple stages according to the attributes of different tasks. In the first stage, a simple denoising module is introduced to reduce heavy noise. In the second stage, we propose a two-branch network to reconstruct the low-light images and enhance texture details. One branch aims at correcting color distortion and restoring image content, while another branch focuses on recovering realistic texture. Experimental results demonstrate that the proposed method can reconstruct high-quality images from low-light raw data and replace the traditional ISP.
computer science, information systems,telecommunications,engineering, electrical & electronic
What problem does this paper attempt to address?
This paper attempts to address various issues present in images captured under extremely low light conditions, such as severe noise, blurriness, and color distortion. Existing enhancement methods usually focus on finding suitable lighting adjustments but often fail to effectively handle heavy noise and color distortion. Some recent works try to suppress noise and reconstruct low-light images from raw data, but these methods directly use networks to replace traditional image signal processing pipelines (ISP), leading to an excessive learning burden on the network and unsatisfactory results. To solve these problems, the authors propose a two-stage low-light image signal processing network (LLISP). The design of this network is inspired by traditional ISPs, processing images in multiple stages to adapt to the attributes of different tasks. Specifically: 1. **First Stage**: Introduce a simple denoising module to reduce severe noise. 2. **Second Stage**: Propose a dual-branch network to reconstruct low-light images and enhance texture details. One branch aims to correct color distortion and restore image content, while the other branch focuses on recovering realistic textures. Experimental results show that the proposed method can reconstruct high-quality images from low-light raw data and replace traditional ISPs.