Abstract:Previous visual object tracking methods employ image-feature regression models or coordinate autoregression models for bounding box prediction. Image-feature regression methods heavily depend on matching results and do not utilize positional prior, while the autoregressive approach can only be trained using bounding boxes available in the training set, potentially resulting in suboptimal performance during testing with unseen data. Inspired by the diffusion model, denoising learning enhances the model's robustness to unseen data. Therefore, We introduce noise to bounding boxes, generating noisy boxes for training, thus enhancing model robustness on testing data. We propose a new paradigm to formulate the visual object tracking problem as a denoising learning process. However, tracking algorithms are usually asked to run in real-time, directly applying the diffusion model to object tracking would severely impair tracking speed. Therefore, we decompose the denoising learning process into every denoising block within a model, not by running the model multiple times, and thus we summarize the proposed paradigm as an in-model latent denoising learning process. Specifically, we propose a denoising Vision Transformer (ViT), which is composed of multiple denoising blocks. In the denoising block, template and search embeddings are projected into every denoising block as conditions. A denoising block is responsible for removing the noise in a predicted bounding box, and multiple stacked denoising blocks cooperate to accomplish the whole denoising process. Subsequently, we utilize image features and trajectory information to refine the denoised bounding box. Besides, we also utilize trajectory memory and visual memory to improve tracking stability. Experimental results validate the effectiveness of our approach, achieving competitive performance on several challenging datasets.

DiffusionTrack: Point Set Diffusion Model for Visual Object Tracking

DiffusionTrack: Diffusion Model for Multi-Object Tracking

TrackDiffusion: Multi-object Tracking Data Generation via Diffusion Models

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

DeTrack: In-model Latent Denoising Learning for Visual Object Tracking

DINTR: Tracking via Diffusion-based Interpolation

Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking

Distractor-Aware Visual Tracking by Online Siamese Network

Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers

Motion Guided Siamese Trackers for Visual Tracking

Anti-distractors: Two-Branch Siamese Tracker with Both Static and Dynamic Filters for Object Tracking

TrackDiffusion: Tracklet-Conditioned Video Generation via Diffusion Models

ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model

Online Parallel Framework for Real-Time Visual Tracking.

Visual Object Tracking with Multi-Frame Distractor Suppression

Exploring Reliable Visual Tracking Via Target Embedding Network

Siamese Template Diffusion Networks for Robust Visual Tracking

Diffusion Models for Multi-target Adversarial Tracking

EasyTrack: Efficient and Compact One-stream 3D Point Clouds Tracker

Object Tracking Via Discriminative Anisotropic Propagation