Abstract:• We develop a novel encoder-decoder architecture with an attention-based skip fusion integrated into autonomous underwater robot for underwater image enhancement. • We propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. • We adopt a parallel attention block for spatial and channel dimensions to focus on the interest regions of the input feature map. • Our MsDCANet achieves state-of-the-art performance on the recent benchmark in terms of visual effects and object metrics, which is conducive to integrating underwater robots and applications in aquaculture. Underwater images suffer from poor visibility quality, which results from selective attenuation and scattering. These interdependence phenomena together cause image degradation, failing autonomous underwater robots to recognize image contents. To address those problems, we propose a multi-scale deformable convolution network with an attention mechanism (MsDCANet) to enhance the quality of underwater images. The proposed model is generally implemented by an encoder-decoder architecture. Concretely, we first propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. Coupled with spatial and channel attention mechanisms, the task-oriented high-level representations acquired from input feature maps, and the most significant features are highlighted. Considering the contributions of the encoder and decoder functions on the final enhancement task, an attention-based skip fusion scheme is designed to improve the original skip connection, which aims to reconstruct higher quality underwater images. Finally, the proposed model is optimized by a multi-task loss function, including pixel loss and perceptual loss. Experiments on underwater images captured under diverse scenes demonstrate that the proposed model produces visually pleasing results and has strong generalization ability, even significantly outperforming several state-of-the-art methods. Besides, our approach can also improve the performance of vision tasks and be applied to aquaculture development.

MSFC: Multi-scale Significant Feature Correction Method for Distorted Underwater Target Recognition

Dynamic Multiscale Feature Fusion Method for Underwater Target Recognition

A Multi‐scale Feature Representation and Interaction Network for Underwater Object Detection

A Multi-Scale Feature Extraction Network for Marine Underwater Image Enhancement

Underwater image restoration with multi-scale shallow feature extraction and detail enhancement network

Multi-scale aware turbulence network for underwater object recognition

Multi-scale convolution underwater image restoration network

IFE-net: improved feature enhancement network for weak feature target recognition in autonomous underwater vehicles

Multiscale Underwater Image Enhancement in RGB and HSV Color Spaces

Underwater Target Detection Lightweight Algorithm Based on Multi-Scale Feature Fusion

Color correction and restoration based on multi-scale recursive network for underwater optical image

Deep Color-Corrected Multiscale Retinex Network for Underwater Image Enhancement

Underwater image enhancement using multi-task fusion

Multi-Scale Frequency-Adaptive-Network-Based Underwater Target Recognition

Underwater Multi-Frame Target Images Mosaic Method Based on Adaptive Image Enhancement

A Multi-scale Feature Modulation Network for Efficient Underwater Image Enhancement

MDSCN: multiscale depthwise separable convolutional network for underwater graphics restoration

Multi-scale Enhancement Fusion for Underwater Sea Cucumber Images Based on Human Visual System Modelling

Integrate MSRCR and Mask R-CNN to Recognize Underwater Creatures on Small Sample Datasets

Autonomous Underwater Robot for Underwater Image Enhancement Via Multi-Scale Deformable Convolution Network with Attention Mechanism

Underwater image enhancement based on adaptive color correction and multi-scale fusion