Abstract:An essential need for accurate visual object tracking is to capture better correlations between the tracking target and the search region. However, the dominant Siamese-based trackers are limited to producing dense similarity maps at once via a cross-correlations operation, ignoring to remedy the contamination caused by erroneous or ambiguous matches. In this paper, we propose a novel tracker, termed neighborhood consensus constraint-based siamese tracker (NCSiam), which takes the idea of neighborhood consensus constraint to refine the produced correlation maps. The intuition behind our approach is that we can support the nearby erroneous or ambiguous matches by analyzing a larger context of the scene that contains a unique match. Specifically, we devise a 4D convolution-based multi-level similarity refinement (MLSR) strategy. Taking the primary similarity maps obtained from a cross-correlation as input, MLSR acquires reliable matches by analyzing neighborhood consensus patterns in 4D space, thus enhancing the discriminability between the tracking target and the distractors. Besides, traditional Siamese-based trackers directly perform classification and regression on similarity response maps which discard appearance or semantic information. Therefore, an appearance affinity decoder (AAD) is developed to take full advantage of the semantic information of the search region. To further improve performance, we design a task-specific disentanglement (TSD) module to decouple the learned representations into classification-specific and regression-specific embeddings. Extensive experiments are conducted on six challenging benchmarks, including GOT-10k, TrackingNet, LaSOT, UAV123, OTB2015, and VOT2020. The results demonstrate the effectiveness of our method. The code will be available at https://github.com/laybebe/NCSiam.

Assessing similarities between spatial point patterns with a Siamese neural network discriminant model

Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification

A Siamese neural network for learning the similarity metrics of linear features

Non-Intrusive Adaptive Load Identification Based on Siamese Network

Embedded Spectral Descriptors: Learning the point-wise correspondence metric via Siamese neural networks

Common Variable Learning and Invariant Representation Learning using Siamese Neural Networks

Improving Text Semantic Similarity Modeling through a 3D Siamese Network

A Novel Discrimination Structure for Assessing Text Semantic Similarity

Learning to Match Using Siamese Network for Object Tracking.

Multitarget Tracking Using Siamese Neural Networks

Semi-Supervised Learning using Siamese Networks

Siamese Networks for Weakly Supervised Human Activity Recognition

SSCNN-S: A Spectral-Spatial Convolution Neural Network with Siamese Architecture for Change Detection

MultiSiam: A Multiple Input Siamese Network For Social Media Text Classification And Duplicate Text Detection

Host-Based Intrusion Detection Model Using Siamese Network

Similarity-based Text Recognition by Deeply Supervised Siamese Network

Siamese network for classification of Raman spectroscopy with inter-instrument variation for biological applications

Validating Siamese embedded neural networks with identical representations for efficient model convergence

NCSiam: Reliable Matching Via Neighborhood Consensus for Siamese-Based Object Tracking.

Enhancing Human Activity Recognition with Siamese Networks: A Comparative Study of Contrastive and Triplet Learning Approaches

DASTSiam: Spatio‐temporal Fusion and Discriminative Enhancement for Siamese Visual Tracking