Abstract:Multi-object tracking (MOT) in the scenario of low-frame-rate videos is a promising solution to better meet the computing, storage, and transmitting bandwidth resource constraints of edge devices. Tracking with a low frame rate poses particular challenges in the association stage as objects in two successive frames typically exhibit much quicker variations in locations, velocities, appearances, and visibilities than those in normal frame rates. In this paper, we observe severe performance degeneration of many existing association strategies caused by such variations. Though optical-flow-based methods like CenterTrack can handle the large displacement to some extent due to their large receptive field, the temporally local nature makes them fail to give reliable displacement estimations of objects that newly appear in the current frame (i.e., not visible in the previous frame). To overcome the local nature of optical-flow-based methods, we propose an online tracking method by extending the CenterTrack architecture with a new head, named APP, to recognize unreliable displacement estimations. Further, to capture the fine-grained and private unreliability of each displacement estimation, we extend the binary APP predictions to displacement uncertainties. To this end, we reformulate the displacement estimation task via Bayesian deep learning tools. With APP predictions, we propose to conduct association in a multi-stage manner where vision cues or historical motion cues are leveraged in the corresponding stage. By rethinking the commonly used bipartite matching algorithms, we equip the proposed multi-stage association policy with a hybrid matching strategy conditioned on displacement uncertainties. Our method shows robustness in preserving identities in low-frame-rate video sequences. Experimental results on public datasets in various low-frame-rate settings demonstrate the advantages of the proposed method.

Self-Adaptive Motion Tracking Against On-body Displacement of Flexible Sensors.

Frame-by-frame Motion Retargeting with Self-Collision Avoidance from Diverse Human Demonstrations

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

A Scalable and Wearable Self-Sensing IMU Sensor Network for Personalized Human Motion and Deformation Capture

Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors

3D Deformation Capture Via a Configurable Self-Sensing IMU Sensor Network

DisPad: Flexible On-Body Displacement of Fabric Sensors for Robust Joint-Motion Tracking

Human posture tracking with flexible sensors for motion recognition

Markerless Motion Capture Using Appearance and Inertial Data

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

Displacement Estimation for Different Gait Patterns in Micro-Sensor Motion Capture

APPTracker+: Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Self-adaptive Pose-tracking Algorithm for Mobile Robots in Dynamic and Highly-occluded Environments

Adaptive Sensor Data Fusion in Motion Capture.

MotionTrack: Learning Motion Predictor for Multiple Object Tracking

A Flexible Sensor and MIMU-Based Multisensor Wearable System for Human Motion Analysis

LSDM: Long-Short Diffeomorphic Motion for Weakly-Supervised Ultrasound Landmark Tracking

On Exploiting Per-Pixel Motion Conflicts to Extract Secondary Motions.

Automatic tracking of moving human body based on remote sensing spatial information

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging