Abstract:Object detection based on visual images provides significant technical support to realize autonomous environment perception of unmanned surface vehicles (USVs), yet difficulties exist for object detection on the sea surface, such as the constantly-changing weather conditions, considerable changes in the scale of objects, and severe object shaking. In this paper, an USV object detection algorithm is proposed based on an optimized feature fusion network. YOLOv4 was selected as the baseline, which is currently one of the object detection models with the best trade-offs between speed and accuracy. In the proposed weighted Cross Stage Partial Path Aggregation Network (wCSPPAN) structure, the concept of the Cross Stage Partial Network (CSPNet) was applied to the feature fusion network, so as to significantly reduce the amount of computation. In addition, weights that can be learned were introduced to learn input features of different resolutions in a more reasonable way. Finally, to obtain cross-space and cross-scale feature interactions, attempts were made to integrate the universal visual component of the Feature Pyramid Transformer (FPT) with the transformer mechanism in the YOLOv4 model. The FPT was used to transform the feature pyramid into another feature pyramid of the same size with richer contextual information for each level of feature map. We compare the performance with other advanced object detection algorithms. The experiments conducted on the dataset of sea surface buoys, which was collected and produced independently for the present study, and the open source Singapore Maritime Dataset verify that the proposed method achieved good results in the detection of sea objects of different scales under various weather conditions. In particular, the detection of long-distance small objects under foggy conditions with low visibility and extreme conditions was improved, and real-time sea surface object detection was achieved with an inference speed of up to 36FPS on a single RTX 2080Ti. Further, the detection results on the COCO dataset and KITTI dataset verify the excellent generalization ability of our proposed object detection model.

Research on Collaborative Object Detection and Recognition of Autonomous Underwater Vehicle Based on YOLO Algorithm

MDM-YOLO: Research on Object Detection Algorithm Based on Improved YOLOv4 for Marine Organisms.

YoloXT: A Object Detection Algorithm for Marine Benthos

Motion Behavior Recognition of Underwater Vehicle Based on YOLOv3

Research on Underwater Small Target Detection Algorithm Based on Improved YOLOv3

Embedded Online Fish Detection and Tracking System Via YOLOv3 and Parallel Correlation Filter

Underwater Object Detection Based on Enhanced YOLO

Research on underwater object recognition based on YOLOv3

UGC-YOLO: Underwater Environment Object Detection Based on YOLO with a Global Context Block

Research on Underwater Target Detection Method Based on Improved MSRCP and YOLOv3

Underwater Object Detection Using TC-YOLO with Attention Mechanisms

Sea Surface Object Detection Algorithm Based on YOLO V4 Fused with Reverse Depthwise Separable Convolution (RDSC) for USV

YOLO‐UOD: An underwater small object detector via improved efficient layer aggregation network

Underwater Biological Detection Based on YOLOv4 Combined with Channel Attention

Unmanned Surface Vessel Visual Object Detection under All-Weather Conditions with Optimized Feature Fusion Network in YOLOv4

Underwater Dense Targets Detection and Classification based on YOLOv3.

Underwater Target Detection Based on Improved Yolov5

Underwater Targets Detection and Classification in Complex Scenes Based on an Improved YOLOv3 Algorithm.

Research on multi-scale fusion image enhancement and improved YOLOv5s lightweight ROV underwater target detection method

Underwater Robot Target Detection Algorithm Based on YOLOv8

Enhanced YOLOv7 with three-dimensional attention and its application into underwater object detection