Real-Time Multi-Scene Visibility Enhancement for Promoting Navigational Safety of Vessels Under Complex Weather Conditions

Ryan Wen Liu,Yuxu Lu,Yuan Gao,Yu Guo,Wenqi Ren,Fenghua Zhu,Fei-Yue Wang

2024-09-03

Abstract:The visible-light camera, which is capable of environment perception and navigation assistance, has emerged as an essential imaging sensor for marine surface vessels in intelligent waterborne transportation systems (IWTS). However, the visual imaging quality inevitably suffers from several kinds of degradations (e.g., limited visibility, low contrast, color distortion, etc.) under complex weather conditions (e.g., haze, rain, and low-lightness). The degraded visual information will accordingly result in inaccurate environment perception and delayed operations for navigational risk. To promote the navigational safety of vessels, many computational methods have been presented to perform visual quality enhancement under poor weather conditions. However, most of these methods are essentially specific-purpose implementation strategies, only available for one specific weather type. To overcome this limitation, we propose to develop a general-purpose multi-scene visibility enhancement method, i.e., edge reparameterization- and attention-guided neural network (ERANet), to adaptively restore the degraded images captured under different weather conditions. In particular, our ERANet simultaneously exploits the channel attention, spatial attention, and reparameterization technology to enhance the visual quality while maintaining low computational cost. Extensive experiments conducted on standard and IWTS-related datasets have demonstrated that our ERANet could outperform several representative visibility enhancement methods in terms of both imaging quality and computational efficiency. The superior performance of IWTS-related object detection and scene segmentation could also be steadily obtained after ERANet-based visibility enhancement under complex weather conditions.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper primarily aims to address the issue of navigation safety for ships in Intelligent Water Transport Systems (IWTS) under complex weather conditions such as fog, rain, and low light. Specifically, the research aims to develop a general multi-scene visibility enhancement method to adapt to image quality restoration under different weather conditions. Most current methods are only targeted at specific types of weather conditions, with limited flexibility and applicability. Therefore, the paper proposes an Edge Re-parameterization and Attention-guided Neural Network (ERANet) that can adaptively restore the quality of degraded images under various adverse weather conditions.

The main contributions of ERANet include:
1. Proposing a new Edge Re-parameterization and Attention-guided Neural Network (ERANet) as a general multi-scene visibility enhancement method.
2. Developing a re-parameterization module that uses a custom Kirsch gradient operator to extract meaningful edge features from low-visibility images.
3. Demonstrating through experiments that ERANet significantly improves visual image quality under different weather conditions and has lower computational costs compared to existing methods, which is of great value in the practical application of intelligent water transport systems.