Abstract:Visual multi-object tracking on the maritime surface based on unmanned surface vessels (USVs) is a crucial technology for realizing intelligent maritime surveillance. However, videos obtained from the maritime surface often encounter challenges such as scene blurring, oscillations of USV observation platforms, and non-linear movements of objects, significantly affecting tracking performance. In response to these challenges, the article builds upon ByteTrack to introduce the Maritime Object Motion Tracker (MOMT), employing YOLOv7 as the object detector. Diverging from ByteTrack, MOMT proposes a new metric function and incorporates Gaussian cascade matching for a more refined handling of low-score and unmatched bounding boxes. Additionally, an augmented observation Kalman filter module is developed to diminish the effects of nonlinear motion in objects. Specifically, First, in establishing the relationship between adjacent frames, the Fuse-distance metric function is proposed by synthesizing information on IOU distance, object category, and size, to determine the optimal matching between detection boxes and Kalman filter prediction boxes. Secondly, the introduction of the Gaussian cascade matching module better addresses the issue of frequent ID switches caused by significant shaking of the USV observation platform. Additionally, to cope with the impact of non-linear object motion, the combination of camera motion compensation and the Observation-centric Kalman filter is employed to mitigate estimation errors in the Kalman filter. Finally, MOMT is compared with other state-of-the-art tracking algorithms on the Singapore Maritime Dataset, achieving competitive performance with 46.0 MOTA and 66.7 IDF1, and operating in real-time at a speed of 44.6 FPS. Experimental results demonstrate that MOMT can achieve real-time and effective multi-object tracking in complex maritime scenarios, providing technical support for intelligent maritime surface monitoring.

Simple Online and Realtime Underwater Multiple Object Tracking

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Underwater Long-Term Object Tracker for Marine Organism Capture

Online Multi-Object Tracking Method for Shrimps in High Density Using Multi-Task You Only Look Once Exceeding and Cascade Strategy

Underwater Object Tracker: UOSTrack for Marine Organism Grasping of Underwater Vehicles

Adaptive Resolution Optimization and Tracklet Reliability Assessment for Efficient Multi-Object Tracking

Underwater Object Tracking Strategy Via Multi-scale Retinex and Partial Least Squares Analysis

Online Multi-object Tracking Based on Deep Learning

A Unified Framework for Joint Moving Object Detection and Tracking in the Sky and Underwater

Real-time Multi-Object Tracking Based on Bi-directional Matching

Multi-Object Tracking by Iteratively Associating Detections with Uniform Appearance for Trawl-Based Fishing Bycatch Monitoring

A Robust Method for Multi Object Tracking in Autonomous Ship Navigation Systems

MOMT: A Maritime Real-Time Visual Multi-Object Tracking Algorithm Based on Unmanned Surface Vehicles

Real-time multiple object tracking using deep learning methods

FishMOT: A Simple and Effective Method for Fish Tracking Based on IoU Matching

An online multi-object tracking approach by adaptive labeling and kalman filter

Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes

A Real Time Video Object Tracking Method for Fish

Object detection/tracking toward underwater photographs by remotely operated vehicles (ROVs)

Real-Time Online Multi-Object Tracking