Abstract:Visual tracking addresses the problem of identifying and localizing an unknown target in a video given the target specified by a bounding box in the first frame. In this paper, we propose a dual network to better utilize features among layers for visual tracking. It is observed that features in higher layers encode semantic context while its counterparts in lower layers are sensitive to discriminative appearance. Thus we exploit the hierarchical features in different layers of a deep model and design a dual structure to obtain better feature representation from various streams, which is rarely investigated in previous work. To highlight geometric contours of the target, we integrate the hierarchical feature maps with an edge detector as the coarse prior maps to further embed local details around the target. To leverage the robustness of our dual network, we train it with random patches measuring the similarities between the network activation and target appearance, which serves as a regularization to enforce the dual network to focus on target object. The proposed dual network is updated online in a unique manner based on the observation that the target being tracked in consecutive frames should share more similar feature representations than those in the surrounding background. It is also found that for a target object, the prior maps can help further enhance performance by passing message into the output maps of the dual network. Therefore, an independent component analysis with reference algorithm (ICA-R) is employed to extract target context using prior maps as guidance. Online tracking is conducted by maximizing the posterior estimate on the final maps with stochastic and periodic update. Quantitative and qualitative evaluations on two large-scale benchmark data sets show that the proposed algorithm performs favourably against the state-of-the-arts.

Object Tracking Via Deep Multi-View Compressive Model for Visible and Infrared Sequences.

Deep Object Tracking with Multi-Modal Data

Multi-features Guided Robust Visual Tracking.

Multi-object Tracking Based on Thermal-Visible Video Sequence Fusion

Visual Tracking Based on Semantic and Similarity Learning

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

Visible and Infrared Tracking Based on Multi-View Multi-Kernel Fusion Model

Object Tracking over Multiple Uncalibrated Cameras Using Visual, Spatial and Temporal Similarities.

Transformer-Based Dual-Modal Visual Target Tracking Using Visible Light and Thermal Infrared.

Multi-object Tracking by Expanding Long-Tracklets

Object Tracking with Multi-View Support Vector Machines.

Object Fusion Tracking Based on Visible and Infrared Images Using Fully Convolutional Siamese Networks

Relative Object Tracking Algorithm Based on Convolutional Neural Network for Visible and Infrared Video Sequences

MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

Dual Deep Network for Visual Tracking

Dual Integration of Multi‐model with Spatial‐temporal Occlusion‐awareness for Visual Object Tracking

Deep Adaptive Discriminate Siamese Network with Multi-Level Response for Visual Object Tracking

Multiple object tracking with appearance feature prediction and similarity fusion

Visual tracking with multilevel feature, similarity attention, color constraint, and global redetection

Reliable Object Tracking by Multimodal Hybrid Feature Extraction and Transformer-Based Fusion

Sequence-tracker: Multiple object tracking with sequence features in severe occlusion scene