Unveiling the Hidden: A Comprehensive Evaluation of Underwater Image Enhancement and Its Impact on Object Detection

Ali Awad,Ashraf Saleem,Sidike Paheding,Evan Lucas,Serein Al-Ratrout,Timothy C. Havens
2024-11-22
Abstract:Underwater imagery often suffers from severe degradation that results in low visual quality and object detection performance. This work aims to evaluate state-of-the-art image enhancement models, investigate their impact on underwater object detection, and explore their potential to improve detection performance. To this end, we selected representative underwater image enhancement models covering major enhancement categories and applied them separately to two recent datasets: 1) the Real-World Underwater Object Detection Dataset (RUOD), and 2) the Challenging Underwater Plant Detection Dataset (CUPDD). Following this, we conducted qualitative and quantitative analyses on the enhanced images and developed a quality index (Q-index) to compare the quality distribution of the original and enhanced images. Subsequently, we compared the performance of several YOLO-NAS detection models that are separately trained and tested on the original and enhanced image sets. Then, we performed a correlation study to examine the relationship between enhancement metrics and detection performance. We also analyzed the inference results from the trained detectors presenting cases where enhancement increased the detection performance as well as cases where enhancement revealed missed objects by human annotators. This study suggests that although enhancement generally deteriorates the detection performance, it can still be harnessed in some cases for increased detection performance and more accurate human annotation.
Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate the impact of underwater image enhancement techniques on target detection performance. Specifically, the authors aim to: 1. **Evaluate the latest image enhancement models**: Select representative underwater image enhancement models, covering the main enhancement categories, and apply them to two recent datasets: Real - World Underwater Object Detection Dataset (RUOD) and Challenging Underwater Plant Detection Dataset (CUPDD). 2. **Explore the impact of enhancement techniques on underwater target detection**: Analyze the enhanced image quality qualitatively and quantitatively, and develop a quality index (Q - index) to compare the quality distributions of the original and enhanced images. 3. **Compare the performance of different detection models**: Train and test several YOLO - NAS detection models on the original and enhanced images respectively, and compare their detection performance. 4. **Analyze the relationship between enhancement indicators and detection performance**: Conduct a correlation study to examine the relationship between enhancement indicators and detection performance. 5. **Demonstrate the potential advantages of enhancement techniques**: Analyze cases where the enhanced images improve detection performance in certain situations, as well as cases where the enhancement techniques reveal targets that may have been missed by human annotators. Through these steps, the authors hope to explore the potential applications of image enhancement techniques in underwater target detection. Although in general the enhancement techniques may reduce the detection performance, they can still improve the detection effect and the accuracy of annotation in some specific situations.