Abstract:• We develop a novel encoder-decoder architecture with an attention-based skip fusion integrated into autonomous underwater robot for underwater image enhancement. • We propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. • We adopt a parallel attention block for spatial and channel dimensions to focus on the interest regions of the input feature map. • Our MsDCANet achieves state-of-the-art performance on the recent benchmark in terms of visual effects and object metrics, which is conducive to integrating underwater robots and applications in aquaculture. Underwater images suffer from poor visibility quality, which results from selective attenuation and scattering. These interdependence phenomena together cause image degradation, failing autonomous underwater robots to recognize image contents. To address those problems, we propose a multi-scale deformable convolution network with an attention mechanism (MsDCANet) to enhance the quality of underwater images. The proposed model is generally implemented by an encoder-decoder architecture. Concretely, we first propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. Coupled with spatial and channel attention mechanisms, the task-oriented high-level representations acquired from input feature maps, and the most significant features are highlighted. Considering the contributions of the encoder and decoder functions on the final enhancement task, an attention-based skip fusion scheme is designed to improve the original skip connection, which aims to reconstruct higher quality underwater images. Finally, the proposed model is optimized by a multi-task loss function, including pixel loss and perceptual loss. Experiments on underwater images captured under diverse scenes demonstrate that the proposed model produces visually pleasing results and has strong generalization ability, even significantly outperforming several state-of-the-art methods. Besides, our approach can also improve the performance of vision tasks and be applied to aquaculture development.

Multiple attentional path aggregation network for marine object detection

MDM-YOLO: Research on Object Detection Algorithm Based on Improved YOLOv4 for Marine Organisms.

Refined marine object detector with attention-based spatial pyramid pooling networks and bidirectional feature fusion strategy

Augmented weighted bidirectional feature pyramid network for marine object detection

Multi-scale aggregation feature pyramid with cornerness for underwater object detection

Joint image enhancement learning for marine object detection in natural scene

Self-attention and long-range relationship capture network for underwater object detection

Multiple information perception-based attention in YOLO for underwater object detection

Underwater Object Detection with Mixed Attention Mechanism and Multi-Enhancement Strategy

A Novel Underwater Image Enhancement and Improved Underwater Biological Detection Pipeline

Lightweight underwater object detection based on image enhancement and multi-attention

YOLO‐UOD: An underwater small object detector via improved efficient layer aggregation network

Underwater Target Detection Based on Parallel High-Resolution Networks

Lightweight Underwater Object Detection Algorithm for Embedded Deployment Using Higher-Order Information and Image Enhancement

Dual Spatial Attention Network for Underwater Object Detection With Sonar Imagery

Autonomous Underwater Robot for Underwater Image Enhancement Via Multi-Scale Deformable Convolution Network with Attention Mechanism

Single-Stage Underwater Target Detection Based on Feature Anchor Frame Double Optimization Network

Underwater Species Detection using Channel Sharpening Attention

Underwater object detection algorithm based on attention mechanism and cross-stage partial fast spatial pyramidal pooling

Underwater Target Detection Algorithm Based on Feature Fusion Enhancement

YWnet: A convolutional block attention-based fusion deep learning method for complex underwater small target detection