Abstract:Visual multi-object tracking on the maritime surface based on unmanned surface vessels (USVs) is a crucial technology for realizing intelligent maritime surveillance. However, videos obtained from the maritime surface often encounter challenges such as scene blurring, oscillations of USV observation platforms, and non-linear movements of objects, significantly affecting tracking performance. In response to these challenges, the article builds upon ByteTrack to introduce the Maritime Object Motion Tracker (MOMT), employing YOLOv7 as the object detector. Diverging from ByteTrack, MOMT proposes a new metric function and incorporates Gaussian cascade matching for a more refined handling of low-score and unmatched bounding boxes. Additionally, an augmented observation Kalman filter module is developed to diminish the effects of nonlinear motion in objects. Specifically, First, in establishing the relationship between adjacent frames, the Fuse-distance metric function is proposed by synthesizing information on IOU distance, object category, and size, to determine the optimal matching between detection boxes and Kalman filter prediction boxes. Secondly, the introduction of the Gaussian cascade matching module better addresses the issue of frequent ID switches caused by significant shaking of the USV observation platform. Additionally, to cope with the impact of non-linear object motion, the combination of camera motion compensation and the Observation-centric Kalman filter is employed to mitigate estimation errors in the Kalman filter. Finally, MOMT is compared with other state-of-the-art tracking algorithms on the Singapore Maritime Dataset, achieving competitive performance with 46.0 MOTA and 66.7 IDF1, and operating in real-time at a speed of 44.6 FPS. Experimental results demonstrate that MOMT can achieve real-time and effective multi-object tracking in complex maritime scenarios, providing technical support for intelligent maritime surface monitoring.

Real-Time Moving Maritime Objects Segmentation And Tracking For Video Communication

Motionobject segmentation algorithm based on spatial-temporal information

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Novel Method for Moving Maritime Objects Detection

The Approximation Algorithms Applied to Maritime Region of Interest Segmentation

Automatic Video Object Segmentation and Tracking Using an Improved Active Contour

Automatic Video Object Segmentation Based on Spatio-temporal Information

Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain

A New Method for Moving Object Segmentation Automatically in Video Sequence

MOMT: A Maritime Real-Time Visual Multi-Object Tracking Algorithm Based on Unmanned Surface Vehicles

A Unified Framework for Joint Moving Object Detection and Tracking in the Sky and Underwater

Real-time and accurate segmentation of moving objects in dynamic scene.

Motion Objects Segmentation Using a New Level Set Based Method

A method for automatic segmentation and tracking of video moving object

Fish Tracking and Segmentation From Stereo Videos on the Wild Sea Surface for Electronic Monitoring of Rail Fishing

Real-time object tracking in video pictures based on self-organizing map and image segmentation

Real-time Detection of the Moving Object in Video Sequences

Ship Detection and Tracking Method for Satellite Video Based on Multiscale Saliency and Surrounding Contrast Analysis

An automatic segmentation algorithm for moving objects in video sequences under multi-constraints

Regional Proposal Based Underwater Object Tracking

MOVING SHIP DETECTION AND MOVEMENT PREDICTION IN REMOTE SENSING VIDEOS