Abstract:In the realm of object tracking, complex backgrounds pose significant challenges, often leading to the underperformance of existing trackers that predominantly rely on deep features from the final layer of feature extraction networks. These features, while semantically rich, are not always sufficient to distinguish targets from cluttered environments. To address this limitation, we introduce the Background-aware Siamese Network (BASNet), an innovative approach that enhances the salience of features in intricate scenes. Central to our method is the Dual-Feature Fusion (DFF) model, meticulously crafted to stabilize target representation amidst distracting backgrounds. BASNet leverages the complementary strengths of deep and shallow features, harnessing the former’s semantic depth and the latter’s precision in spatial localization. This fusion not only elevates feature utilization but also mitigates the shortcomings associated with the superficial output of shallow networks. Further refining the target’s spatial definition, our attention-focusing module (AF) plays a pivotal role. It accentuates pertinent features 1 and attenuates noise emanating from the multi-layer feature amalgamation. The module’s ingenuity lies in its cyclic attention operations, which enable each pixel to establish extensive dependencies with all others , thereby spotlighting salient features. For precise target localization, BASNet employs the SIoU loss within its regression branch, a strategic choice that contributes to the model’s accuracy. Extensive experiments demonstrate the competitive performance of our method on six datasets: OTB50, OTB100, UAV123, VOT2016, VOT2018, and VOT2019.

Infrared Object Tracking Algorithm with Temporal Features Fusion Siamese Network

Twofold Structured Features-Based Siamese Network for Infrared Target Tracking

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

DSiamMFT: An RGB-T fusion tracking method via dynamic Siamese networks using multi-layer feature fusion

Exploring reliable infrared object tracking with spatio-temporal fusion transformer

Enhanced Target Tracking Algorithm for Autonomous Driving Based on Visible and Infrared Image Fusion

A Learning Frequency-Aware Feature Siamese Network for Real-Time Visual Tracking

SiamCAF: Complementary Attention Fusion-Based Siamese Network for RGBT Tracking

Siamese infrared and visible light fusion network for RGB-T tracking

Hierarchical Spatial-aware Siamese Network for Thermal Infrared Object Tracking

Asymmetric Deformable Spatio-temporal Framework for Infrared Object Tracking

Hierarchical Attention Siamese Network for Thermal Infrared Target Tracking

Mutual Learning and Feature Fusion Siamese Networks for Visual Object Tracking

SiamST: Siamese Network with Spatio-Temporal Awareness for Object Tracking

Adaptive Multi-Feature Fusion Visual Target Tracking Based on Siamese Neural Network with Cross-Attention Mechanism

SiamMDM: An Adaptive Fusion Network With Dynamic Template for Real-Time Satellite Video Single Object Tracking

SiamITO: A Lightweight Siamese Network for Infrared Tiny Object Tracking

Infrared Thermal Imaging Super-Resolution via Multiscale Spatio-Temporal Feature Fusion Network

DASTSiam: Spatio-Temporal Fusion and Discriminative Augmentation for Improved Siamese Tracking

IoU-guided Siamese network with high-confidence template fusion for visual tracking

Adaptive feature fusion for visual object tracking