Abstract:Object detection based on visual images provides significant technical support to realize autonomous environment perception of unmanned surface vehicles (USVs), yet difficulties exist for object detection on the sea surface, such as the constantly-changing weather conditions, considerable changes in the scale of objects, and severe object shaking. In this paper, an USV object detection algorithm is proposed based on an optimized feature fusion network. YOLOv4 was selected as the baseline, which is currently one of the object detection models with the best trade-offs between speed and accuracy. In the proposed weighted Cross Stage Partial Path Aggregation Network (wCSPPAN) structure, the concept of the Cross Stage Partial Network (CSPNet) was applied to the feature fusion network, so as to significantly reduce the amount of computation. In addition, weights that can be learned were introduced to learn input features of different resolutions in a more reasonable way. Finally, to obtain cross-space and cross-scale feature interactions, attempts were made to integrate the universal visual component of the Feature Pyramid Transformer (FPT) with the transformer mechanism in the YOLOv4 model. The FPT was used to transform the feature pyramid into another feature pyramid of the same size with richer contextual information for each level of feature map. We compare the performance with other advanced object detection algorithms. The experiments conducted on the dataset of sea surface buoys, which was collected and produced independently for the present study, and the open source Singapore Maritime Dataset verify that the proposed method achieved good results in the detection of sea objects of different scales under various weather conditions. In particular, the detection of long-distance small objects under foggy conditions with low visibility and extreme conditions was improved, and real-time sea surface object detection was achieved with an inference speed of up to 36FPS on a single RTX 2080Ti. Further, the detection results on the COCO dataset and KITTI dataset verify the excellent generalization ability of our proposed object detection model.

Visual target detection for energy consumption optimization of unmanned surface vehicle

USV-Tracker: A Novel USV Tracking System for Surface Investigation with Limited Resources

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms

Water Target Recognition Method and Application for Unmanned Surface Vessels

A Novel Target Detection Method of the Unmanned Surface Vehicle under All-Weather Conditions with an Improved YOLOV3

Ship target detection of unmanned surface vehicle base on efficientdet

UAV-Assisted Target Tracking and Computation Offloading in USV-Based MEC Networks

Vessel detection and classification fusing radar and vision data

Few-Shot Object Detection Using Multimodal Sensor Systems of Unmanned Surface Vehicles

Lightweight object detection algorithm based on YOLOv5 for unmanned surface vehicles

Real-Time Obstacle Detection for Unmanned Surface Vehicle Maneuver

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Improved Object Detection Method for Unmanned Surface Vehicle Using Real-Time Neural Networks

A Vision-Based Target Detection, Tracking, and Positioning Algorithm for Unmanned Aerial Vehicle

Aero-YOLO: An Efficient Vehicle and Pedestrian Detection Algorithm Based on Unmanned Aerial Imagery

Accurate and real-time visual detection algorithm for environmental perception of USVS under all-weather conditions

A object detection and tracking method for security in intelligence of unmanned surface vehicles

Unmanned Surface Vessel Visual Object Detection under All-Weather Conditions with Optimized Feature Fusion Network in YOLOv4

Robust Small Object Detection on the Water Surface Through Fusion of Camera and Millimeter Wave Radar

Detection Technique Tailored for Small Targets on Water Surfaces in Unmanned Vessel Scenarios