Abstract:Over the last decade, Siamese network architectures have emerged as dominating tracking paradigms, which have led to significant progress. These architectures are made up of a backbone network and a head network. The backbone network comprises two identical feature extraction sub-branches, one for the target template and one for the search candidate. The head network takes both the template and candidate features as inputs and produces a local similarity score for the target object in each location of the search candidate. Despite promising results that have been attained in visual tracking, challenges persist in developing efficient and lightweight models due to the inherent complexity of the task. Specifically, manually designed tracking models that rely heavily on the knowledge and experience of relevant experts are lacking. In addition, the existing tracking approaches achieve excellent performance at the cost of large numbers of parameters and vast amounts of computations. A novel Siamese tracking approach called TrackNAS based on neural architecture search is proposed to reduce the complexity of the neural architecture applied in visual tracking. First, according to the principle of the Siamese network, backbone and head network search spaces are constructed, constituting the search space for the network architecture. Next, under the given resource constraints, the network architecture that meets the tracking performance requirements is obtained by optimizing a hybrid search strategy that combines distributed and joint approaches. Then, an evolutionary method is used to lighten the network architecture obtained from the search phase to facilitate deployment to devices with resource constraints (FLOPs). Finally, to verify the performance of TrackNAS, comparison and ablation experiments are conducted using several large-scale visual tracking benchmark datasets, such as OTB100, VOT2018, UAV123, LaSOT, and GOT-10k. The results indicate that the proposed TrackNAS achieves competitive performance in terms of accuracy and robustness, and the number of network parameters and computation volume are far smaller than those of other advanced Siamese trackers, meeting the requirements for lightweight deployment to resource-constrained devices.

A low-complexity visual tracking approach with single hidden layer neural networks

A Real-Time Visual Tracking Approach Using Sparse Autoencoder and Extreme Learning Machine

Learning a Deep Compact Image Representation for Visual Tracking

DeepTrack: Learning Discriminative Feature Representations Online for Robust Visual Tracking

Dual Deep Network for Visual Tracking

Robust Visual Tracking Method via Deep Learning

Online Scale Adaptive Visual Tracking Based on Multilayer Convolutional Features

Distractor-Aware Visual Tracking by Online Siamese Network

Robust Visual Tracking Using Dynamic Classifier Selection with Sparse Representation of Label Noise

An ensemble of deep neural networks for object tracking

Study on Deep Learning and Its Application in Visual Tracking.

Efficient and Lightweight Visual Tracking with Differentiable Neural Architecture Search

A Novel Simple Visual Tracking Algorithm Based on Hashing and Deep Learning

Tracking with a small single Convolutional Neural Network

Deep visual tracking: Review and experimental comparison

Lightweight Deep Neural Network for Real-Time Visual Tracking with Mutual Learning

Visual Tracking Using Multi-stage Random Simple Features

A Dense Connection Based Network for Real-Time Object Tracking

Visual Tracking Based on Stacked Denoising Autoencoder Network with Genetic Algorithm Optimization.

A Visual Tracker Offering More Solutions.

Active Learning for Deep Visual Tracking