Abstract:Object detection based on visual images provides significant technical support to realize autonomous environment perception of unmanned surface vehicles (USVs), yet difficulties exist for object detection on the sea surface, such as the constantly-changing weather conditions, considerable changes in the scale of objects, and severe object shaking. In this paper, an USV object detection algorithm is proposed based on an optimized feature fusion network. YOLOv4 was selected as the baseline, which is currently one of the object detection models with the best trade-offs between speed and accuracy. In the proposed weighted Cross Stage Partial Path Aggregation Network (wCSPPAN) structure, the concept of the Cross Stage Partial Network (CSPNet) was applied to the feature fusion network, so as to significantly reduce the amount of computation. In addition, weights that can be learned were introduced to learn input features of different resolutions in a more reasonable way. Finally, to obtain cross-space and cross-scale feature interactions, attempts were made to integrate the universal visual component of the Feature Pyramid Transformer (FPT) with the transformer mechanism in the YOLOv4 model. The FPT was used to transform the feature pyramid into another feature pyramid of the same size with richer contextual information for each level of feature map. We compare the performance with other advanced object detection algorithms. The experiments conducted on the dataset of sea surface buoys, which was collected and produced independently for the present study, and the open source Singapore Maritime Dataset verify that the proposed method achieved good results in the detection of sea objects of different scales under various weather conditions. In particular, the detection of long-distance small objects under foggy conditions with low visibility and extreme conditions was improved, and real-time sea surface object detection was achieved with an inference speed of up to 36FPS on a single RTX 2080Ti. Further, the detection results on the COCO dataset and KITTI dataset verify the excellent generalization ability of our proposed object detection model.

Unmanned Surface Vessel Visual Object Detection under All-Weather Conditions with Optimized Feature Fusion Network in YOLOv4

MDM-YOLO: Research on Object Detection Algorithm Based on Improved YOLOv4 for Marine Organisms.

Sea Surface Object Detection Algorithm Based on YOLO V4 Fused with Reverse Depthwise Separable Convolution (RDSC) for USV

Visual Detection Algorithm for Enhanced Environmental Perception of Unmanned Surface Vehicles in Complex Marine Environments

Lightweight object detection algorithm based on YOLOv5 for unmanned surface vehicles

A Lightweight Sea Surface Object Detection Network for Unmanned Surface Vehicles

Accurate and real-time visual detection algorithm for environmental perception of USVS under all-weather conditions

A Novel Target Detection Method of the Unmanned Surface Vehicle under All-Weather Conditions with an Improved YOLOV3

Improved Object Detection Method for Unmanned Surface Vehicle Using Real-Time Neural Networks

Water Target Recognition Method and Application for Unmanned Surface Vessels

A Lightweight Detection Algorithm for Unmanned Surface Vehicles Based on Multi-Scale Feature Fusion

Underwater Target Detection Algorithm Based on Feature Fusion Enhancement

Attention-Based Lightweight YOLOv8 Underwater Target Recognition Algorithm

Underwater object detection algorithm based on attention mechanism and cross-stage partial fast spatial pyramidal pooling

Underwater small and occlusion object detection with feature fusion and global context decoupling head-based YOLO

Soft-NMS-Enabled YOLOv5 with SIOU for Small Water Surface Floater Detection in UAV-Captured Images

YOLOv5-UOD: Underwater Object Detection Method Based on Improved YOLOv5

Underwater Biological Detection Based on YOLOv4 Combined with Channel Attention

Underwater Object Detection Using TC-YOLO with Attention Mechanisms

B-YOLOX-S: A Lightweight Method for Underwater Object Detection Based on Data Augmentation and Multiscale Feature Fusion

Improved YOLOv8 Algorithm for Water Surface Object Detection