Abstract:In the realm of object tracking, complex backgrounds pose significant challenges, often leading to the underperformance of existing trackers that predominantly rely on deep features from the final layer of feature extraction networks. These features, while semantically rich, are not always sufficient to distinguish targets from cluttered environments. To address this limitation, we introduce the Background-aware Siamese Network (BASNet), an innovative approach that enhances the salience of features in intricate scenes. Central to our method is the Dual-Feature Fusion (DFF) model, meticulously crafted to stabilize target representation amidst distracting backgrounds. BASNet leverages the complementary strengths of deep and shallow features, harnessing the former’s semantic depth and the latter’s precision in spatial localization. This fusion not only elevates feature utilization but also mitigates the shortcomings associated with the superficial output of shallow networks. Further refining the target’s spatial definition, our attention-focusing module (AF) plays a pivotal role. It accentuates pertinent features 1 and attenuates noise emanating from the multi-layer feature amalgamation. The module’s ingenuity lies in its cyclic attention operations, which enable each pixel to establish extensive dependencies with all others , thereby spotlighting salient features. For precise target localization, BASNet employs the SIoU loss within its regression branch, a strategic choice that contributes to the model’s accuracy. Extensive experiments demonstrate the competitive performance of our method on six datasets: OTB50, OTB100, UAV123, VOT2016, VOT2018, and VOT2019.

Learning Multi-Layer Attention Aggregation Siamese Network for Robust RGBT Tracking

Robust RGB-T Tracking via Graph Attention-Based Bilinear Pooling

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

SiamCAF: Complementary Attention Fusion-Based Siamese Network for RGBT Tracking

SiamMGT: robust RGBT tracking via graph attention and reliable modality weight learning

SiamCDA: Complementarity- and Distractor-Aware RGB-T Tracking Based on Siamese Network

Unsupervised RGB-T object tracking with attentional multi-modal feature fusion

RGBT Image Fusion Tracking via Sparse Trifurcate Transformer Aggregation Network

RGB-T Tracking Based on Mixed Attention

RGBT Tracking via All-layer Multimodal Interactions with Progressive Fusion Mamba

DSiamMFT: An RGB-T fusion tracking method via dynamic Siamese networks using multi-layer feature fusion

Multi-Scale Feature Interactive Fusion Network for RGBT Tracking

Learning Modality Complementary Features with Mixed Attention Mechanism for RGB-T Tracking

Learning a Multimodal Feature Transformer for RGBT Tracking

Siamese transformer RGBT tracking

Multi-modal multi-task feature fusion for RGBT tracking

Mutual Learning and Feature Fusion Siamese Networks for Visual Object Tracking

SiamEFT: adaptive-time feature extraction hybrid network for RGBE multi-domain object tracking

Hierarchical Attention Siamese Network for Thermal Infrared Target Tracking

Real-Time RGBT Target Tracking Based on Attention Mechanism

FANet: Quality-Aware Feature Aggregation Network for Robust RGB-T Tracking