Abstract:The automatic detection and identification of fish from underwater videos is of great significance for fishery resource assessment and ecological environment monitoring. However, due to the poor quality of underwater images and unconstrained fish movement, traditional hand-designed feature extraction methods or convolutional neural network (CNN)-based object detection algorithms cannot meet the detection requirements in real underwater scenes. Therefore, to realize fish recognition and localization in a complex underwater environment, this paper proposes a novel composite fish detection framework based on a composite backbone and an enhanced path aggregation network called Composited FishNet. By improving the residual network (ResNet), a new composite backbone network (CBresnet) is designed to learn the scene change information (source domain style), which is caused by the differences in the image brightness, fish orientation, seabed structure, aquatic plant movement, fish species shape and texture differences. Thus, the interference of underwater environmental information on the object characteristics is reduced, and the output of the main network to the object information is strengthened. In addition, to better integrate the high and low feature information output from CBresnet, the enhanced path aggregation network (EPANet) is also designed to solve the insufficient utilization of semantic information caused by linear upsampling. The experimental results show that the average precision (AP)0.5:0.95, AP50 and average recall (AR)max=10 of the proposed Composited FishNet are 75.2%, 92.8% and 81.1%, respectively. The composite backbone network enhances the characteristic information output of the detected object and improves the utilization of characteristic information. This method can be used for fish detection and identification in complex underwater envir-nments such as oceans and aquaculture.

Coordinate-Aware Mask R-CNN with Group Normalization: A underwater marine animal instance segmentation framework

Accurate Fish Detection under Marine Background Noise Based on the Retinex Enhancement Algorithm and CNN

Stereo Vison and Mask-RCNN Segmentation Based 3D Points Cloud Matching for Fish Dimension Measurement

An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN)

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Using Mask R-CNN for Underwater Fish Instance Segmentation as Novel Objects: A Proof of Concept

Fish Detection and Classification using Mask R-CNN

Integrate MSRCR and Mask R-CNN to Recognize Underwater Creatures on Small Sample Datasets

Detecting Fish Species Through Mask RCNN

Accelerating Fish Detection and Recognition by Sharing CNNs with Objectness Learning

Fish Trajectory Extraction Based on Object Detection

Segmentation and measurement scheme for fish morphological features based on Mask R-CNN

Fast Accurate Fish Detection and Recognition of Underwater Images with Fast R-CNN

Coastal Fisheries Resource Monitoring Through A Deep Learning-Based Underwater Video Analysis

A multitask model for realtime fish detection and segmentation based on YOLOv5

Composited FishNet: Fish Detection and Species Recognition From Low-Quality Underwater Videos

Finer Resolution Mapping Of Marine Aquaculture Areas Using Worldview-2 Imagery And A Hierarchical Cascade Convolutional Neural Network

Global Mask R-CNN for marine ship instance segmentation

Robust Tracking of Fish Schools Using CNN for Head Identification

A video object segmentation-based fish individual recognition method for underwater complex environments