Abstract:Nowadays, Transformer-based visual tracking algorithms have been developing quickly because of the self-attention mechanism of Transformer, which has the capability to model global information. Although the self-attention mechanism in Transformer can effectively capture long-range dependencies in feature space, they only use flattened two-dimensional features and are unable to capture long-range temporal dependencies. Furthermore, since the self-attention in Transformer functions as a low-pass filter, it picks up on low-frequency features of the target while ignoring high-frequency features. This research suggests a Transformer tracker based on action information and mix-frequency features (AMTrack) to address these problems. Specifically, to address the lack of temporal remote dependencies, we introduce the target action aware module and the target action offset module. The target action aware module sets up several pathways to extract spatio-temporal, channel, and motion feature independently. In contrast, the target action offset module computes the target's offset information by computing relative feature maps. Furthermore, in order to address the imbalance between high and low frequency features, we propose a mix-frequency attention and multi-frequency self-attention convolutional block. The mix-frequency attention uses high-frequency features within partitioned local windows as input for the high-frequency branch and average-pooled low-frequency features as the input for the low-frequency branch, calculating attention scores in both branches respectively. The multi-frequency self-attention convolutional block uses self-attention to capture low-frequency features and convolution to capture high-frequency features. Extensive experiments are carried out on eight challenging tracking datasets (e.g., OTB100 (Object Tracking Benchmark 100), NFS (Need For Speed), UAV123 (Unmanned Aerial Vehicles 123), TC128 (Temple Color 128), VOT2018 (Visual Object Tracking 2018), LaSOT (Large-scale Single Object Tracking), TrackingNet (Tracking Network), GOT-10k (Generic Object Tracking-10k)), and the experimental results show that our tracker achieves excellent tracking performance when compared with several state-of-the-art tracking algorithms. The experimental results show that on LaSOT, the success rates AUC (Area Under Curve), P Norm , and P reach 65.8%, 69.2%, and 68.0%, respectively, where the AUC value is 2.1% higher than the baseline algorithm TrDiMP (Transformer Discriminative Model Prediction). On other datasets, our tracker also achieves excellent tracking performance.

Domain Adaptation-aware Transformer for Hyperspectral Object Tracking

SiamHYPER: Learning a Hyperspectral Object Tracker from an RGB-Based Tracker

SiamOHOT: A Lightweight Dual Siamese Network for Onboard Hyperspectral Object Tracking Via Joint Spatial-Spectral Knowledge Distillation

An Anchor-Free Siamese Target Tracking Network for Hyperspectral Video.

Transformer-Based Band Regrouping With Feature Refinement for Hyperspectral Object Tracking

HHTrack: Hyperspectral Object Tracking Using Hybrid Attention

Learning a Deep Ensemble Network with Band Importance for Hyperspectral Object Tracking.

Unsupervised Nighttime Object Tracking Based on Transformer and Domain Adaptation Fusion Network

Learning Spatial-Frequency Transformer for Visual Object Tracking

Spectral-Spatial-Temporal Attention Network for Hyperspectral Tracking.

A Channel Adaptive Dual Siamese Network for Hyperspectral Object Tracking

Exploiting Temporal Coherence for Self-Supervised Visual Tracking by Using Vision Transformer

TFTN: A Transformer-Based Fusion Tracking Framework of Hyperspectral and RGB

Unsupervised Domain Adaptation for Nighttime Aerial Tracking

Progressive Domain Adaptation for Thermal Infrared Object Tracking

Domain Adaptive SiamRPN++ for Object Tracking in the Wild

SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking

Hyperspectral Video Tracker Based on Spectral Deviation Reduction and a Double Siamese Network

MATI: Multimodal Adaptive Tracking Integrator for Robust Visual Object Tracking

Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking

AMTrack:Transformer tracking via action information and mix-frequency features