Abstract:UAV visual-object-tracking technology based on Siamese neural networks has great scientific research and practical application value, and it is widely used in geological surveying, reconnaissance monitoring, and environmental monitoring. Due to the limited onboard computational resources and complex real-world environments of drones, most of the existing tracking systems based on Siamese neural networks struggle to combine excellent performance with high efficiency. Therefore, the key issue is to study how to improve the accuracy of target tracking under the challenges of real-time performance and the above factors. In response to this problem, this paper proposes a real-time UAV tracking system based on interframe saliency transformer and lightweight multidimensional attention network (SiamITL). Specifically, interframe saliency transformer is used to continuously perceive spatial and temporal information, making the network more closely related to the essence of the tracking task. Additionally, a lightweight multidimensional attention network is used to better capture changes in both target appearance and background information, improving the ability of the tracker to distinguish between the target and background. SiamITL is effective and efficient: extensive comparative experiments and ablation experiments have been conducted on multiple aerial tracking benchmarks, demonstrating that our algorithm can achieve more robust feature representation and more accurate target state estimation. Among them, SiamITL achieved success and accuracy rates of 0.625 and 0.818 in the UAV123 benchmark, respectively, demonstrating a certain level of leadership in this field. Furthermore, SiamITL demonstrates the potential for real-time operation on the embedded platform Xavier, highlighting its potential for practical application in real-world scenarios.

Object Tracking for an Autonomous Unmanned Surface Vehicle

USV-Tracker: A Novel USV Tracking System for Surface Investigation with Limited Resources

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Artificial Intelligence Based Object Detection and Tracking for a Small Underwater Robot

Dynamic Object Tracking on Autonomous UAV System for Surveillance Applications

Siamese Network Combined Learning Saliency and Online Leaning Interference for Aerial Object Tracking Algorithm

Visual Object Tracking for Unmanned Aerial Vehicles Based on the Template-Driven Siamese Network

Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis

A object detection and tracking method for security in intelligence of unmanned surface vehicles

Benchmarking Vision-Based Object Tracking for USVs in Complex Maritime Environments

Deep Siamese Network With Motion Fitting for Object Tracking in Satellite Videos

Real-Time Object Detection and Tracking for Unmanned Aerial Vehicles Based on Convolutional Neural Networks

Robust Object Tracking Algorithm for Autonomous Vehicles in Complex Scenes

Multi-object tracking with deep learning ensemble for unmanned aerial system applications

Proposing an Efficient Deep Learning Algorithm Based on Segment Anything Model for Detection and Tracking of Vehicles through Uncalibrated Urban Traffic Surveillance Cameras

Underwater Long-Term Object Tracker for Marine Organism Capture

Computer vision based obstacle detection and target tracking for autonomous vehicles

Interframe Saliency Transformer and Lightweight Multidimensional Attention Network for Real-Time Unmanned Aerial Vehicle Tracking

An Integrated Visual System for Unmanned Aerial Vehicles Tracking and Landing on the Ground Vehicles

A Fast Dynamic Dim Target Tracking Approach for UAVs Using Improved Lightweight Siamese Networks

Ship Recognition and Tracking System for Intelligent Ship Based on Deep Learning Framework