Abstract:• We develop a novel encoder-decoder architecture with an attention-based skip fusion integrated into autonomous underwater robot for underwater image enhancement. • We propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. • We adopt a parallel attention block for spatial and channel dimensions to focus on the interest regions of the input feature map. • Our MsDCANet achieves state-of-the-art performance on the recent benchmark in terms of visual effects and object metrics, which is conducive to integrating underwater robots and applications in aquaculture. Underwater images suffer from poor visibility quality, which results from selective attenuation and scattering. These interdependence phenomena together cause image degradation, failing autonomous underwater robots to recognize image contents. To address those problems, we propose a multi-scale deformable convolution network with an attention mechanism (MsDCANet) to enhance the quality of underwater images. The proposed model is generally implemented by an encoder-decoder architecture. Concretely, we first propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. Coupled with spatial and channel attention mechanisms, the task-oriented high-level representations acquired from input feature maps, and the most significant features are highlighted. Considering the contributions of the encoder and decoder functions on the final enhancement task, an attention-based skip fusion scheme is designed to improve the original skip connection, which aims to reconstruct higher quality underwater images. Finally, the proposed model is optimized by a multi-task loss function, including pixel loss and perceptual loss. Experiments on underwater images captured under diverse scenes demonstrate that the proposed model produces visually pleasing results and has strong generalization ability, even significantly outperforming several state-of-the-art methods. Besides, our approach can also improve the performance of vision tasks and be applied to aquaculture development.

A Multi-scale Convolutional Hybrid Attention Residual Network for Enhancing Underwater Image and Identifying Underwater Multi-scene Sea Cucumber

An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN)

Accurate Fish Detection under Marine Background Noise Based on the Retinex Enhancement Algorithm and CNN

Underwater Image Enhancement Based on AttR2U-Net and Multi-Residual Networks

Underwater image enhancement by combining multi-attention with recurrent residual convolutional U-Net

MCCA-Net: Multi-color Convolution and Attention Stacked Network for Underwater Image Classification

Robust underwater image enhancement with cascaded multi-level sub-networks and triple attention mechanism

Autonomous Underwater Robot for Underwater Image Enhancement Via Multi-Scale Deformable Convolution Network with Attention Mechanism

Deep Color-Corrected Multiscale Retinex Network for Underwater Image Enhancement

Multi-scale Network with Attention Mechanism for Underwater Image Enhancement

Application of Improved MobileNet-SSD on Underwater Sea Cucumber Detection Robot

Research on Underwater Target Recognition Technology Based on Neural Network

Attention-guided Dynamic Multi-Branch Neural Network for Underwater Image Enhancement

An Efficient Convolutional Network for Underwater Object Detection

Multi-scale Enhancement Fusion for Underwater Sea Cucumber Images Based on Human Visual System Modelling

S-FPN: A shortcut feature pyramid network for sea cucumber detection in underwater images

CMRD-Net: an Improved Method for Underwater Image Enhancement

A Multi‐scale Feature Representation and Interaction Network for Underwater Object Detection

Multi-Domain Rapid Enhancement Networks for Underwater Images

A Novel Underwater Image Enhancement and Improved Underwater Biological Detection Pipeline

Multi-Scale and Multi-Path Networks for Simultaneous Enhancement and Super-Resolution of Underwater Images