Abstract:Defining a multi-target motion model, which is an important step of tracking algorithms, can be very challenging. Using fixed models (as in several generative Bayesian algorithms, such as Kalman filters) can fail to accurately predict sophisticated target motions. On the other hand, sequential learning of the motion model (for example, using recurrent neural networks) can be computationally complex and difficult due to the variable unknown number of targets. In this paper, we propose a multi-target filtering and tracking algorithm which learns the motion model, simultaneously for all targets, from an implicitly represented state map and performs spatio-temporal data prediction. To this end, the multi-target state is modelled over a continuous hypothetical target space, using random finite sets and Gaussian mixture probability hypothesis density formulations. The prediction step is recursively performed using a deep convolutional recurrent neural network with a long short-term memory architecture, which is trained as a regression block, on the fly, over "probability density difference" maps. Our approach is evaluated over widely used pedestrian tracking benchmarks, remarkably outperforming state-of-the-art multi-target filtering algorithms, while giving competitive results when compared with other tracking approaches: The proposed approach generates an average 40.40 and 62.29 optimal sub-pattern assignment (OSPA) errors on MOT15 and MOT16/17 datasets, respectively, while producing 62.0%, 70.0% and 66.9% multi-object tracking accuracy (MOTA) on MOT16/17, PNNL Parking Lot and PETS09 pedestrian tracking datasets, respectively, when publicly available detectors are used.

Handling Missing Observations with an RNN-based Prediction-Update Cycle

A Two-Block RNN-based Trajectory Prediction from Incomplete Trajectory

An RNN-based IMM Filter Surrogate

Learning to Update for Object Tracking with Recurrent Meta-learner

On human motion prediction using recurrent neural networks

Convolutional Recurrent Predictor: Implicit Representation for Multi-target Filtering and Tracking

Markovian RNN: An Adaptive Time Series Prediction Network With HMM-Based Switching for Nonstationary Environments

Multistep Prediction of Dynamic Systems With Recurrent Neural Networks

MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motions

Imitative Non-Autoregressive Modeling for Trajectory Forecasting and Imputation

A Spatiotemporal Prediction Framework for Air Pollution Based on Deep RNN

Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks

Switching Recurrent Kalman Networks

Online Multi-Target Tracking Using Recurrent Neural Networks

Learning The Sequential Temporal Information with Recurrent Neural Networks

Recurrent Neural Network Architectures for Vulnerable Road User Trajectory Prediction.

BRITS: Bidirectional Recurrent Imputation for Time Series

Robust Cubature Kalman Filter for Moving-Target Tracking with Missing Measurements

Time Series Imputation with Multivariate Radial Basis Function Neural Network

Neural Differential Recurrent Neural Network with Adaptive Time Steps

A spatiotemporal recurrent neural network for missing data imputation in tunnel monitoring