Real-time Attentive Dilated U-Net for Extremely Dark Image Enhancement

Junjian Huang,Hao Ren,Shulin Liu,Yong Liu,Chuanlu Lv,Jiawen Lu,Changyong Xie,Hong Lu

DOI: https://doi.org/10.1145/3654668

2024-03-27

Abstract:Images taken under low-light conditions suffer from poor visibility, color distortion and graininess, all of which degrade the image quality and hamper the performance of downstream vision tasks, such as object detection and instance segmentation in the field of autonomous driving, making low-light enhancement an indispensable basic component of high-level visual tasks. Low-light enhancement aims to mitigate these issues, and has garnered extensive attention and research over several decades. The primary challenge in low-light image enhancement arises from the low signal-to-noise ratio (SNR) caused by insufficient lighting. This challenge becomes even more pronounced in near-zero lux conditions, where noise overwhelms the available image information. Both traditional image signal processing (ISP) pipeline and conventional low-light image enhancement methods struggle in such scenarios. Recently, deep neural networks have been used to address this challenge. These networks take unmodified RAW images as input and produce the enhanced sRGB images, forming a deep learning-based ISP pipeline. However, most of these networks are computationally expensive and thus far from practical use. In this paper, we propose a lightweight model called attentive dilated U-Net (ADU-Net) to tackle this issue. Our model incorporates several innovative designs, including an asymmetric U-shape architecture, dilated residual modules (DRMs) for feature extraction, and attentive fusion modules (AFMs) for feature fusion. The DRMs provide strong representative capability while the AFMs effectively leverage low-level texture information and high-level semantic information within the network. Both modules employ a lightweight design but offer significant performance gains. Extensive experiments demonstrate our method is highly-effective, achieving an excellent balance between image quality and computational complexity, i . e ., taking less than 4ms for a high-definition 4K image on a single GTX 1080Ti GPU and yet maintaining competitive visual quality. Furthermore, our method exhibits pleasing scalability and generalizability, highlighting its potential for widespread applicability.

computer science, information systems, theory & methods, software engineering

What problem does this paper attempt to address?

The paper aims to address the problem of image enhancement under low-light conditions. Specifically, images under low-light conditions suffer from low brightness, color distortion, and high graininess. These issues not only reduce the aesthetic quality of the images but also affect the performance of downstream tasks such as object detection and instance segmentation. Traditional image signal processing (ISP) pipelines and conventional low-light enhancement methods perform poorly under extremely dark conditions due to the very low signal-to-noise ratio in these scenarios. To tackle this challenge, the paper proposes a lightweight network model called the Attentive Dilated U-Net (ADU-Net), which can achieve high-quality image enhancement while ensuring real-time processing speed.

The main contributions of the paper include:
1. Proposing a lightweight network ADU-Net that achieves a good balance between visual quality and computational efficiency in extreme low-light image enhancement.
2. Introducing two structural modules tailored for the extreme low-light image enhancement task: the Dilated Residual Module (DRM) and the Attentive Fusion Module (AFM). These modules are both lightweight and effective, enhancing the model's performance.
3. Experimental results show that the proposed ADU-Net has superior or competitive performance compared to existing methods, with lower computational costs.