Abstract:Visual object tracking is an active and challenging research topic in computer vision, as objects often undergo significant appearance changes caused by occlusion, deformation, and background clutter. Although convolutional neural network (CNN)-based trackers have achieved competitive results, there are still some limitations. Most existing CNN-based trackers track the object by leveraging high-level semantic features of the highest convolutional layer, which may lead to low-spatial resolution feature maps and degrade the localization precision of tracking. Furthermore, these trackers hardly benefit from end-toend training since the extraction of features and the learning of classifier are separated. To deal with the above-mentioned issues, we design an adaptive weighted CNN features-based Siamese network for tracking. To capture spatial and semantic information of the object, we design a feature extraction network that derives feature maps by concatenating features of all convolutional layers. To make the features representation more discriminative, we propose a feature integration network. In the feature integration network, we propose a holistic-part network to capture strong visual cues and learn the semantic relations between the holistic object and its parts and combine the holistic-part network with spatial and channel attention mechanisms to adaptively assign weights to each region and channel of the feature maps. In addition, the designed Siamese network can be trained offline end-to-end. The experimental results on the benchmark datasets OTB50 and OTB100 demonstrate that the proposed tracker achieves favorable performance against several state-of-the-art trackers while running at an average speed of 20.5 frames/s.

DCFNet++: More Advanced Correlation Filters Network for Real-Time Object Tracking

CFNN: Correlation Filter Neural Network for Visual Object Tracking

TICNet: A Target-Insight Correlation Network for Object Tracking

Correlation Filter Tracker with Siamese: A Robust and Real-Time Object Tracking Framework.

Deep Correlation Filter based Real-Time Tracker

Staged Depthwise Correlation and Feature Fusion for Siamese Object Tracking

When Correlation Filters Meet Siamese Networks for Real-Time Complementary Tracking.

End-to-End Correlation Tracking With Enhanced Multi-Level Feature Fusion

Online Parallel Framework for Real-Time Visual Tracking.

Correlation-Aware Deep Tracking

An object tracking framework with recapture based on correlation filters and Siamese networks

Object Tracking Based on Vector Convolutional Network and Discriminant Correlation Filters.

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

Visual object tracking based on residual network and cascaded correlation filters

Adaptive Weighted CNN Features Integration for Correlation Filter Tracking.

Deep Correlation Filter Tracking With Shepherded Instance-Aware Proposals

A Robust Visual Tracker Based on DCF Algorithm

A Dense Connection Based Network for Real-Time Object Tracking

DCF-ASN: Coarse-to-fine Real-time Visual Tracking via Discriminative Correlation Filter and Attentional Siamese Network

Visual Tracking Using Multi-Layer Cnn Features Based Discriminant Correlation Filters With Foreground Mask

Spatio-Temporal Discriminative Correlation Filter Based Object Tracking