A novel low light object detection method based on the YOLOv5 fusion feature enhancement

Daxin Peng,Wei Ding,Tong Zhen

DOI: https://doi.org/10.1038/s41598-024-54428-8

IF: 4.6

2024-02-24

Scientific Reports

Abstract:Low-light object detection is an important research area in computer vision, but it is also a difficult issue. This research offers a low-light target detection network, NLE-YOLO, based on YOLOV5, to address the issues of insufficient illumination and noise interference experienced by target detection tasks in low-light environments. The network initially preprocesses the input image with an improvement technique before suppressing high-frequency noise and enhancing essential information with C2fLEFEM, a unique feature extraction module. We also created a multi-scale feature extraction module, AMC2fLEFEM, and an attention mechanism receptive field module, AMRFB, which are utilized to extract features of multiple scales and enhance the receptive field. The C2fLEFEM module, in particular, merges the LEF and FEM modules on top of the C2f module. The LEF module employs a low-frequency filter to remove high-frequency noise; the FEM module employs dual inputs to fuse low-frequency enhanced and original features; and the C2f module employs a gradient retention method to minimize information loss. The AMC2fLEFEM module combines the SimAM attention mechanism and uses the pixel relationship to obtain features of different receptive fields, adapt to brightness changes, capture the difference between the target and the background, improve the network's feature extraction capability, and effectively reduce the impact of noise. The AMRFB module employs atrous convolution to enlarge the receptive field, maintain global information, and adjust to targets of various scales. Finally, for low-light settings, we replaced the original YOLOv5 detection head with a decoupled head. The Exdark dataset experiments show that our method outperforms previous methods in terms of detection accuracy and performance.

multidisciplinary sciences

What problem does this paper attempt to address?

The paper aims to address the problem of object detection in low-light environments. Specifically, it proposes an object detection network based on YOLOv5, named NLE-YOLO, to tackle challenges such as insufficient image brightness, low contrast, and noise interference under low-light conditions. These issues severely affect the accuracy of object detection, especially in extremely low-light situations where it is difficult to distinguish between the foreground and background, leading to poor detection results.

To improve these issues, the authors designed a series of innovative modules and techniques, including:

1. **C2fLEFEM Module**: This module combines the Low-Frequency Filtering Enhancement Module (LEF) and the Feature Enhancement Module (FEM), which can enhance key information while removing high-frequency noise, thereby improving the network's feature extraction capability.
2. **AMC2fLEFEM Module**: This module introduces the SimAM attention mechanism based on C2fLEFEM, further enhancing the multi-scale feature extraction capability and the ability to adapt to different brightness changes.
3. **AMRFB Module**: This module expands the receptive field through dilated convolution and combines the SimAM attention mechanism, enabling the network to better focus on key target areas while maintaining global information.
4. **Decoupled Head**: The original YOLOv5 detection head is replaced with a decoupled head, improving the network's detection performance on the ExDark dataset.

With these improvements, NLE-YOLO performs excellently in object detection tasks under low-light environments, offering higher detection accuracy and performance compared to other existing methods.