Abstract:Multi-object tracking determines the position of an object and estimates the trajectory of objects in remote sensing satellite videos.This method has attracted considerable interest,and its application to security monitoring,motion analysis,and intelligent transportation has been explored.Compared with surveillance videos,remote sensing satellite videos contain smaller objects and a larger background,and thus the foreground object is difficult to detect.In addition,remote sensing satellite videos are extremely large,requiring massive computation and storage.Multi-object tracking in remote sensing satellite videos have high real-time requirements.Based on the mentioned problems,a multi-object tracking method for remote sensing satellite videos is proposed in this paper,which adopts tracking-by-detection paradigm.First,the backbone added a transformer that capture the global context information in the detection stage,enabling the detector to distinguish between objects and background.Then,an attention mechanism was used to enhance objects'features,enabling the proposed method to focus on the region of objects.Finally,an extra prediction branch was added to the network to generat a high-resolution feature map,which retained the details of small objects and was beneficial to small-object detection.Owing to the small objects and occlusion in remote sensing satellite videos,the confidence of hard positive samples was quite low.In the data association stage,an association strategy was adopted,which considered high and low confidence detection simultaneously and associated detected small objects with existing trajectories.To verify the effectiveness of the proposed method,ablation and comparison experiments were carried out on the remote sensing satellite videos dataset.The proposed method achieved 63.1％MOTA and 78.0％IDF1.The proposed method showed optimal performance,which reflected its suitability for multi-object tracking in remote sensing satellite videos.The proposed method ranked second in the multi-object tracking challenge of the 2021 Gaofen Challenge.The proposed method was dedicated to solving the difficulty of small-object tracking in remote sensing satellite videos,and some helpful methods for small-object tracking were used.Experimental results showed that the proposed method can improve the performance of multi-object tracking in remote sensing satellite videos.

Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmark

Detecting and tracking moving tiny vehicles from satellite based on spatio-temporal constraints

SatSOT: A Benchmark Dataset for Satellite Video Single Object Tracking

A Multitask Benchmark Dataset for Satellite Video: Object Detection, Tracking, and Segmentation.

Single target tracking in high-resolution satellite videos: a comprehensive review

Satellite video single object tracking: A systematic review and an oriented object tracking benchmark

The First Challenge on Moving Object Detection and Tracking in Satellite Videos: Methods and Results

Needles in a Haystack: Tracking City-Scale Moving Vehicles from Continuously Moving Satellite

Object Tracking Based on Satellite Videos: A Literature Review

Deep Learning-Based Object Tracking in Satellite Videos: A Comprehensive Survey with a New Dataset

SAT-MTB-SOS: A Benchmark Dataset for Satellite Video Single Object Segmentation

Advancing Multi-Object Tracking for Small Vehicles in Satellite Videos: A More Focused and Continuous Approach

A Graph Association Motion-aware Tracker for Tiny Object in Satellite Videos

Satellite Video Object Tracking based on Location Prompts

Object Tracking in Satellite Videos Based on a Lightweight Network

Detecting Tiny Moving Vehicles in Satellite Videos

Multi-Object Tracking by Detecting Small Objects in Satellite Video

Single Object Tracking in Satellite Videos: Deep Siamese Network Incorporating an Interframe Difference Centroid Inertia Motion Model

Single Object Tracking in Satellite Videos Based on Feature Enhancement and Multi-Level Matching Strategy

Multivehicle Object Tracking in Satellite Video Enhanced by Slow Features and Motion Features

MCTracker: Satellite Video Multi-Object Tracking Considering Inter-Frame Motion Correlation and Multi-Scale Cascaded Feature Enhancement