Low-Light Image and Video Enhancement: A Comprehensive Survey and Beyond

Shen Zheng,Yiling Ma,Jinqian Pan,Changjie Lu,Gaurav Gupta
2024-01-01
Abstract:This paper presents a comprehensive survey of low-light image and video enhancement, addressing two primary challenges in the field. The first challenge is the prevalence of mixed over-/under-exposed images, which are not adequately addressed by existing methods. In response, this work introduces two enhanced variants of the SICE dataset: SICE_Grad and SICE_Mix, designed to better represent these complexities. The second challenge is the scarcity of suitable low-light video datasets for training and testing. To address this, the paper introduces the Night Wenzhou dataset, a large-scale, high-resolution video collection that features challenging fast-moving aerial scenes and streetscapes with varied illuminations and degradation. This study also conducts an extensive analysis of key techniques and performs comparative experiments using the proposed and current benchmark datasets. The survey concludes by highlighting emerging applications, discussing unresolved challenges, and suggesting future research directions within the LLIE community. The datasets are available at <a class="link-external link-https" href="https://github.com/ShenZheng2000/LLIE_Survey" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
This paper attempts to address two major challenges in the field of low - light image and video enhancement: 1. **The problem of mixed over - exposed and under - exposed images**: Existing methods do not adequately process images that contain both over - exposed and under - exposed areas simultaneously. To meet this challenge, the paper introduces two enhanced versions of the SICE dataset: SICE Grad and SICE Mix, aiming to better represent these complex situations. 2. **Scarcity of training and test datasets suitable for low - light videos**: In response to this challenge, the paper presents the Night Wenzhou dataset, which is a large - scale, high - resolution video collection that includes fast - moving aerial and street - view scenes, with diverse lighting conditions and degradation phenomena. In addition, the paper also conducts an extensive analysis of key technologies and comparative experiments using the proposed and current benchmark datasets. Finally, the paper highlights emerging applications, discusses unresolved challenges, and proposes future research directions.