Abstract:• We develop a novel encoder-decoder architecture with an attention-based skip fusion integrated into autonomous underwater robot for underwater image enhancement. • We propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. • We adopt a parallel attention block for spatial and channel dimensions to focus on the interest regions of the input feature map. • Our MsDCANet achieves state-of-the-art performance on the recent benchmark in terms of visual effects and object metrics, which is conducive to integrating underwater robots and applications in aquaculture. Underwater images suffer from poor visibility quality, which results from selective attenuation and scattering. These interdependence phenomena together cause image degradation, failing autonomous underwater robots to recognize image contents. To address those problems, we propose a multi-scale deformable convolution network with an attention mechanism (MsDCANet) to enhance the quality of underwater images. The proposed model is generally implemented by an encoder-decoder architecture. Concretely, we first propose a multi-scale deformable convolutional network, which acquires deformable local receptive fields at different scales and enriches the diversity of feature representation. Coupled with spatial and channel attention mechanisms, the task-oriented high-level representations acquired from input feature maps, and the most significant features are highlighted. Considering the contributions of the encoder and decoder functions on the final enhancement task, an attention-based skip fusion scheme is designed to improve the original skip connection, which aims to reconstruct higher quality underwater images. Finally, the proposed model is optimized by a multi-task loss function, including pixel loss and perceptual loss. Experiments on underwater images captured under diverse scenes demonstrate that the proposed model produces visually pleasing results and has strong generalization ability, even significantly outperforming several state-of-the-art methods. Besides, our approach can also improve the performance of vision tasks and be applied to aquaculture development.

Enhancing Learning Classifier Systems Through Convolutional Autoencoder to Classify Underwater Images

Deep Learning-Based Recognition of Underwater Target

A Novel Lifelong Learning Model Based on Cross Domain Knowledge Extraction and Transfer to Classify Underwater Images.

Brain Inspired Lifelong Learning Model Based on Neural Based Learning Classifier System for Underwater Data Classification.

Underwater Target Classification at Greater Depths Using Deep Neural Network with Joint Multiple‐domain Feature

Fish species classification in unconstrained underwater environments based on deep learning

Underwater Image Enhancement with Cascaded Contrastive Learning

MCCA-Net: Multi-color Convolution and Attention Stacked Network for Underwater Image Classification

Attention-Based Mechanism and Adversarial Autoencoder for Underwater Image Enhancement

Autonomous Underwater Robot for Underwater Image Enhancement Via Multi-Scale Deformable Convolution Network with Attention Mechanism

Sparse Coral Classification Using Deep Convolutional Neural Networks

Underwater Image Classification Using Deep Convolutional Neural Networks and Data Augmentation

Underwater Target Classification Based on Feature Fusion and Gene Encoding of CNN-BIGRU-Attention

GCCF: A Lightweight and Scalable Network for Underwater Image Enhancement

Underwater Image Enhancement and Detection Based on Convolutional DCP and YOLOv5

Underwater scene prior inspired deep underwater image and video enhancement

A Deep Cnn Method For Underwater Image Enhancement

Deformable Convolutional Network Constrained by Contrastive Learning for Underwater Image Enhancement

Underwater Image Co-Enhancement with Correlation Feature Matching and Joint Learning

Multiscale Underwater Image Enhancement in RGB and HSV Color Spaces

Unified Multi-Color-model-learning-based Deep Support Vector Machine for Underwater Image Classification