Abstract:Defining a multi-target motion model, which is an important step of tracking algorithms, can be very challenging. Using fixed models (as in several generative Bayesian algorithms, such as Kalman filters) can fail to accurately predict sophisticated target motions. On the other hand, sequential learning of the motion model (for example, using recurrent neural networks) can be computationally complex and difficult due to the variable unknown number of targets. In this paper, we propose a multi-target filtering and tracking algorithm which learns the motion model, simultaneously for all targets, from an implicitly represented state map and performs spatio-temporal data prediction. To this end, the multi-target state is modelled over a continuous hypothetical target space, using random finite sets and Gaussian mixture probability hypothesis density formulations. The prediction step is recursively performed using a deep convolutional recurrent neural network with a long short-term memory architecture, which is trained as a regression block, on the fly, over "probability density difference" maps. Our approach is evaluated over widely used pedestrian tracking benchmarks, remarkably outperforming state-of-the-art multi-target filtering algorithms, while giving competitive results when compared with other tracking approaches: The proposed approach generates an average 40.40 and 62.29 optimal sub-pattern assignment (OSPA) errors on MOT15 and MOT16/17 datasets, respectively, while producing 62.0%, 70.0% and 66.9% multi-object tracking accuracy (MOTA) on MOT16/17, PNNL Parking Lot and PETS09 pedestrian tracking datasets, respectively, when publicly available detectors are used.

A Deep Recurrent Framework for Cleaning Motion Capture Data

Motion Capture in Mixed-Reality Applications: A Deep Denoising Approach

Mining Spatial-Temporal Patterns and Structural Sparsity for Human Motion Data Denoising

Tracking Human-like Natural Motion Using Deep Recurrent Neural Networks

Real-Time Cleaning and Refinement of Facial Animation Signals

Joint Multi-Scale Residual and Motion Feature Learning for Action Recognition.

Reconstruction of Dexterous 3D Motion Data from a Flexible Magnetic Sensor with Deep Learning and Structure-Aware Filtering

A Unified Framework for Real Time Motion Completion.

Learning Event-Based Motion Deblurring

Deep-Learning-Based Recovery of Missing Optical Marker Trajectories in 3D Motion Capture Systems

Unsupervised Learning of Long-Term Motion Dynamics for Videos

Continuous-Time Human Motion Field from Events

Video Action Recognition Based on Deeper Convolution Networks with Pair-Wise Frame Motion Concatenation

Learning Blind Motion Deblurring

Noise-in, Bias-out: Balanced and Real-time MoCap Solving

Reconstruction of Fragmented Trajectories of Collective Motion using Hadamard Deep Autoencoders

Motion Rectification Network for Unsupervised Learning of Monocular Depth and Camera Motion

Convolutional Recurrent Predictor: Implicit Representation for Multi-target Filtering and Tracking

A New Depth Residual Network Combined Recurrent with Residual Structure for Human Action Recognition from Videos

Full-Dimensional Optimizable Network: A Channel, Frame and Joint-Specific Network Modeling for Skeleton-Based Action Recognition

Recurrent Neural Network Enabled Continuous Motion Estimation of Lower Limb Joints From Incomplete sEMG Signals