Abstract:• We develop a novel encoder-decoder architecture with an attention-based skip fusion integrated into autonomous underwater robot for underwater image enhancement. • We propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. • We adopt a parallel attention block for spatial and channel dimensions to focus on the interest regions of the input feature map. • Our MsDCANet achieves state-of-the-art performance on the recent benchmark in terms of visual effects and object metrics, which is conducive to integrating underwater robots and applications in aquaculture. Underwater images suffer from poor visibility quality, which results from selective attenuation and scattering. These interdependence phenomena together cause image degradation, failing autonomous underwater robots to recognize image contents. To address those problems, we propose a multi-scale deformable convolution network with an attention mechanism (MsDCANet) to enhance the quality of underwater images. The proposed model is generally implemented by an encoder-decoder architecture. Concretely, we first propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. Coupled with spatial and channel attention mechanisms, the task-oriented high-level representations acquired from input feature maps, and the most significant features are highlighted. Considering the contributions of the encoder and decoder functions on the final enhancement task, an attention-based skip fusion scheme is designed to improve the original skip connection, which aims to reconstruct higher quality underwater images. Finally, the proposed model is optimized by a multi-task loss function, including pixel loss and perceptual loss. Experiments on underwater images captured under diverse scenes demonstrate that the proposed model produces visually pleasing results and has strong generalization ability, even significantly outperforming several state-of-the-art methods. Besides, our approach can also improve the performance of vision tasks and be applied to aquaculture development.

Shuffled Grouping Cross-Channel Attention-based Bilateral-Filter-Interpolation Deformable ConvNet with Applications to Benthonic Organism Detection

Accurate Fish Detection under Marine Background Noise Based on the Retinex Enhancement Algorithm and CNN

Exploring Underwater Target Detection Algorithm Based on Improved SSD

Underwater Object Detection Network with Dilated Deformable Convolutions and Dual-Branch Occlusion Attention Mechanism

One-stage CNN Detector-Based Benthonic Organisms Detection with Limited Training Dataset.

BCNet: Bidirectional Collaboration Network for Edge-Guided Salient Object Detection

A Novel Underwater Image Enhancement and Improved Underwater Biological Detection Pipeline

Underwater Species Detection using Channel Sharpening Attention

Concatenate and Shuffle Network: A Real-Time Underwater Object Detector for Small and Dense Objects

Feature-adaptive FPN with multiscale context integration for underwater object detection

Underwater Object Detection Based on Improved SSD with Convolutional Block Attention

Self-attention and long-range relationship capture network for underwater object detection

Autonomous Underwater Robot for Underwater Image Enhancement Via Multi-Scale Deformable Convolution Network with Attention Mechanism

Underwater Target Detection Algorithm Based on Feature Fusion Enhancement

Multi-Branch Dilation Convolution CenterNet for Object Detection of Underwater Vehicles

Augmented weighted bidirectional feature pyramid network for marine object detection

Refined marine object detector with attention-based spatial pyramid pooling networks and bidirectional feature fusion strategy

Lightweight Underwater Object Detection Algorithm for Embedded Deployment Using Higher-Order Information and Image Enhancement

Underwater Object Detection with Mixed Attention Mechanism and Multi-Enhancement Strategy

YOLO‐UOD: An underwater small object detector via improved efficient layer aggregation network

DeepSeaNet: Improving Underwater Object Detection using EfficientDet