Abstract:Siamese networks for visual tracking have been widely applied due to their good performance. However, the performance of Siamese networks relies on the selection of several hyperparameters, including the cosine window weight and target scale penalty. Inappropriate parameter selection will lead to biased target localization and unsteady tracking. The parameter selection is dataset-specific and time-consuming. The necessity of these parameters is caused by the diffused and background-interfered target response map. In addition, the comparison between the target template and candidates in Siamese networks is performed by a simple inner product, which is linear, unbounded, covariate shifted, and cannot benefit the learning of target-background discriminant features. To address the above issues, a novel feature-comparison network (FCNet) has been developed, which combines a feature extraction network and a feature comparison network. First, an RoIAlign layer is incorporated for efficient target proposal generation. Then, the Siamese structure is borrowed to form the feature extraction network but with a different network architecture. Instead of the simple inner product in Siamese networks, a feature concatenation and comparison structure have been adopted for sample feature similarity evaluation, which has combined several convolutional and fully-connected layers for similarity computation. The comparison network, which is nonlinear, bounded and covariate unshifted, performs more efficient correlation computation and provides similarity feedback for target-background discriminant feature learning with stronger representation and generalization. A more compact and target-dominant response map has been obtained by FCNet, which assures robust and steady tracking. Experiments on benchmarks OTB2013, OTB2015, VOT2016 and UAV123 show that FCNet has obtained state-of-the-art real-time tracking performance with 30 FPS. The code and models will be available on GitHub.

FCN and Siamese Network for Small Target Tracking in Forward-looking Sonar Images

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

Siamese Network with Multi-Scale Fusion Attention for Visual Tracking

ACSiam: Asymmetric Convolution Structures for Visual Tracking with Siamese Network

Hyper-Siamese Network for Robust Visual Tracking

SiamFCA: A new fish single object tracking method based on siamese network with coordinate attention in aquaculture

Siamese Network with Bidirectional Feature Pyramid for Small Target Tracking.

Feature-comparison Network for Visual Tracking

Inverted Residual Siamese Visual Tracking with Feature Crossing Network

Siamese Neural Network Object Tracking with Distractor-Aware Model

Siamese Centerness Prediction Network for Real-Time Visual Object Tracking

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network

Siamese Multi-Scale Adaptive Search Network for Remote Sensing Single-Object Tracking

Hyper-feature Based Tracking with the Fully-Convolutional Siamese Network

A Location-Aware Siamese Network for High-Speed Visual Tracking

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

Siamese Network Tracking Based on Feature Enhancement

Anchor-free Siamese Network Based on Visual Tracking

MFST: Multi-Features Siamese Tracker

Single Target Tracking Algorithm for Lightweight Siamese Networks Based on Global Attention

Real-Time Tracking and Positioning of Underwater Visual Targets Based on Siamese Network