Abstract:Environmental perception is a crucial requirement of Autonomous Surface Vehicles (ASVs) if required to perform tasks safely in a dynamically complex operational environment. Most existing methods for ship detection rely on camera-based methods, which are sensitive to environmental conditions and cannot directly provide spatial location information related to detected targets. To overcome this limitation, we propose a LiDAR-based ship detection and tracking framework that can be applied to busy maritime environments. The proposed framework consists of two functional modules: a ship detection and multi-object tracking. For ship detection, a modularised network structure was adapted, allowing for ease of switching between different types of detection network to prioritise either detection accuracy, detection speed or a compromise of both, depending on the task requirements. A Kalman Filter-based multi-object tracking method is also implemented to compensate for any detections that may have been missed as a result of ship motions or occlusions, relying solely on the detection results. We also collected the first-ever real-world LiDAR dataset for maritime applications across the River Thames and marinas, including a range of ship types, with lengths ranging from 5 m up to 40 m, and different hull types. The datasets are organised in a similar manner to the KITTI datasets, which can be easily applied to the well-developed point cloud detection networks. Remarkably, our methods achieve an overall detection accuracy of 74.1% in the collected datasets. The proposed framework and dataset make LiDAR-based environmental perception feasible for implementation in ASVs and support development in the autonomous maritime navigation field.

A Method with Improved Accuracy and Robustness for Object Detection in Wharf Scenarios

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

RaViDeep: Target Detection Based on Deep Fusion of Radar and Vision in Berthing Scenarios

Multi-Scale Ship Detection from SAR and Optical Imagery Via A More Accurate YOLOv3

Robust Small Object Detection on the Water Surface Through Fusion of Camera and Millimeter Wave Radar

A Millimeter-Wave Radar-Aided Vision Detection Method for Water Surface Small Object Detection

Docked Ship Detection Based on Edge Line Analysis and Aggregation Channel Features

Obstacle Detection of Unmanned Surface Vehicle Based on Lidar Point Cloud Data

Detection Technique Tailored for Small Targets on Water Surfaces in Unmanned Vessel Scenarios

A Real-Time Vessel Detection and Tracking System Based on LiDAR

Reliable LiDAR-based ship detection and tracking for Autonomous Surface Vehicles in busy maritime environments

Multi-modal Information Fusion for LiDAR-based 3D Object Detection Framework

Inshore Ship Detection Based on Multi-Modality Saliency for Synthetic Aperture Radar Images

An Efficient Extended Targets Detection Framework Based on Sampling and Spatio-Temporal Detection.

Grid Map Assisted Radar Target Tracking in a Detection Occluded Maritime Environment

Locally Oriented Scene Complexity Analysis Real-Time Ocean Ship Detection from Optical Remote Sensing Images

Estimation of Ship Berthing Parameters Based on Multi-LiDAR and MMW Radar Data Fusion

Visual Detection Algorithm for Enhanced Environmental Perception of Unmanned Surface Vehicles in Complex Marine Environments

Ship Detection in Maritime Scenes under Adverse Weather Conditions

Real-time Tracking and Berthing Aid System with Occlusion Handling Based on LiDAR

A Multi-Tiered Collaborative Network for Optical Remote Sensing Fine-Grained Ship Detection in Foggy Conditions