FriendNet: Detection-Friendly Dehazing Network

Yihua Fan,Yongzhen Wang,Mingqiang Wei,Fu Lee Wang,Haoran Xie

2024-03-07

Abstract:Adverse weather conditions often impair the quality of captured images, inevitably inducing cutting-edge object detection models for advanced driver assistance systems (ADAS) and autonomous driving. In this paper, we raise an intriguing question: can the combination of image restoration and object detection enhance detection performance in adverse weather conditions? To answer it, we propose an effective architecture that bridges image dehazing and object detection together via guidance information and task-driven learning to achieve detection-friendly dehazing, termed FriendNet. FriendNet aims to deliver both high-quality perception and high detection capacity. Different from existing efforts that intuitively treat image dehazing as pre-processing, FriendNet establishes a positive correlation between these two tasks. Clean features generated by the dehazing network potentially contribute to improvements in object detection performance. Conversely, object detection crucially guides the learning process of the image dehazing network under the task-driven learning scheme. We shed light on how downstream tasks can guide upstream dehazing processes, considering both network architecture and learning objectives. We design Guidance Fusion Block (GFB) and Guidance Attention Block (GAB) to facilitate the integration of detection information into the network. Furthermore, the incorporation of the detection task loss aids in refining the optimization process. Additionally, we introduce a new Physics-aware Feature Enhancement Block (PFEB), which integrates physics-based priors to enhance the feature extraction and representation capabilities. Extensive experiments on synthetic and real-world datasets demonstrate the superiority of our method over state-of-the-art methods on both image quality and detection precision. Our source code is available at

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

This paper aims to address the issue of co-optimization between image dehazing and object detection under adverse weather conditions. Specifically:

1. **Problem Background**:
- Adverse weather conditions (such as haze) can severely degrade the quality of captured images, thereby affecting the performance of advanced driver assistance systems (ADAS) and object detection in autonomous driving.
- Existing methods typically treat image dehazing as a preprocessing step, but this does not significantly enhance subsequent object detection performance.

2. **Research Questions**:
- Propose an interesting question: Can the combination of image restoration and object detection enhance detection performance under adverse weather conditions?
- How to design a method that can improve both image quality and object detection accuracy?

3. **Solution**:
- Propose an architecture named "FriendNet," which combines image dehazing and object detection through guided information and task-driven learning to achieve "detection-friendly" dehazing.
- FriendNet not only improves the visual quality of images but also enhances object detection capabilities, establishing a positive correlation between the two tasks.

4. **Main Contributions**:
- Designed "Guided Fusion Block" (GFB) and "Guided Attention Block" (GAB) to facilitate the integration of detection information within the network.
- Introduced "Physics-based Feature Enhancement Block" (PFEB), which integrates prior knowledge of the atmospheric scattering model to enhance feature extraction and representation capabilities.
- Experimental results show that FriendNet outperforms existing methods on both synthetic and real-world datasets, demonstrating excellent performance in terms of image quality and detection accuracy.

Through these designs, the paper addresses the limitations caused by single optimization objectives and proposes a unified optimization paradigm that enhances both image dehazing and object detection performance simultaneously.