Abstract:Intelligently tracking objects with varied shapes, color, lighting conditions, and backgrounds is an extremely useful application in many HCI applications, such as human body motion capture, hand gesture recognition, and virtual reality (VR) games. However, accurately tracking different objects under uncontrolled environments is a tough challenge due to the possibly dynamic object parts, varied lighting conditions, and sophisticated backgrounds. In this work, we propose a novel semantically-aware object tracking framework, wherein the key is weakly-supervised learning paradigm that optimally transfers the video-level semantic tags into various regions. More specifically, give a set of training video clips, each of which is associated with multiple video-level semantic tags, we first propose a weakly-supervised learning algorithm to transfer the semantic tags into various video regions. The key is a MIL (Zhong et al., 2020) [1]-based manifold embedding algorithm that maps the entire video regions into a semantic space, wherein the video-level semantic tags are well encoded. Afterward, for each video region, we use the semantic feature combined with the appearance feature as its representation. We designed a multi-view learning algorithm to optimally fuse the above two types of features. Based on the fused feature, we learn a probabilistic Gaussian mixture model to predict the target probability of each candidate window, where the window with the maximal probability is output as the tracking result. Comprehensive comparative results on a challenging pedestrian tracking task as well as the human hand gesture recognition have demonstrated the effectiveness of our method. Moreover, visualized tracking results have shown that non-rigid objects with moderate occlusions can be well localized by our method.

The application of intrinsic variable preserving manifold learning method to tracking multiple people with occlusion reasoning

Tracking Multiple People under Occlusion and Across Cameras Using Probabilistic Models

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Spatio-Temporal clustering model for multi-object tracking through occlusions

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

A Multiple People Tracking Algorithm for Large View Scene

Tracking Occluded Objects And Recovering Incomplete Trajectories By Reasoning About Containment Relations And Human Actions

Occlusion Reasoning for Tracking Multiple People.

Multi-object Tracking with Explicit Reasoning about Occlusion

Deep Alignment Network Based Multi-person Tracking with Occlusion and Motion Reasoning

Segmentation and Tracking Multiple Objects under Occlusion from Multiview Video

Multiple people tracking with articulation detection and stitching strategy

Online Multiple Person Tracking Using Fully-Convolutional Neural Networks and Motion Invariance Constraints

Learning an Intrinsic-Variable Preserving Manifold for Dynamic Visual Tracking

Multiple Pedestrian Tracking from Monocular Videos in an Interacting Multiple Model Framework

Long-short Term Prediction for Occluded Multiple Object Tracking.

Inter-Person Occlusion Handling with Social Interaction for Online Multi-Pedestrian Tracking.

A New Hybrid Synthetic Aperture Imaging Model for Tracking and Seeing People Through Occlusion

Multiple Human Tracking Based on Multi-view Upper-Body Detection and Discriminative Learning

Visual Tracking Via Feature Tensor Multimanifold Discriminate Analysis

Multiple Instance Deep Learning for Weakly-Supervised Visual Object Tracking