Abstract:Multiple Object Tracking (MOT) plays an important role in solving many fundamental problems in video analysis in computer vision. Most MOT methods employ two steps: Object Detection and Data Association. The first step detects objects of interest in every frame of a video, and the second establishes correspondence between the detected objects in different frames to obtain their tracks. Object detection has made tremendous progress in the last few years due to deep learning. However, data association for tracking still relies on hand crafted constraints such as appearance, motion, spatial proximity, grouping etc. to compute affinities between the objects in different frames. In this paper, we harness the power of deep learning for data association in tracking by jointly modelling object appearances and their affinities between different frames in an end-to-end fashion. The proposed Deep Affinity Network (DAN) learns compact; yet comprehensive features of pre-detected objects at several levels of abstraction, and performs exhaustive pairing permutations of those features in any two frames to infer object affinities. DAN also accounts for multiple objects appearing and disappearing between video frames. We exploit the resulting efficient affinity computations to associate objects in the current frame deep into the previous frames for reliable on-line tracking. Our technique is evaluated on popular multiple object tracking challenges MOT15, MOT17 and UA-DETRAC. Comprehensive benchmarking under twelve evaluation metrics demonstrates that our approach is among the best performing techniques on the leader board for these challenges. The open source implementation of our work is available at <a class="link-external link-https" href="https://github.com/shijieS/SST.git" rel="external noopener nofollow">this https URL</a>.

Deep learning in video multi-object tracking: A survey

Multiple Object Tracking in Deep Learning Approaches: A Survey

Deep learning for multiple object tracking: a survey

Review of Multi-Object Tracking Based on Deep Learning

Deep learning and multi-modal fusion for real-time multi-object tracking: Algorithms, challenges, datasets, and comparative study

Analysis Based on Recent Deep Learning Approaches Applied in Real-Time Multi-Object Tracking: A Review

Can Deep Learning be Applied to Model-Based Multi-Object Tracking?

Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey

Exploring the State-of-the-Art in Multi-Object Tracking: A Comprehensive Survey, Evaluation, Challenges, and Future Directions

Simultaneous Detection and Tracking with Motion Modelling for Multiple Object Tracking

Multi-Object Multi-Camera Tracking Based on Deep Learning for Intelligent Transportation: A Review

A Survey of Multi-object Video Tracking Algorithms

Deep learning in multi-object detection and tracking: state of the art

Multi-object tracking with deep learning ensemble for unmanned aerial system applications

Real-time multiple object tracking using deep learning methods

Advances on Application of Deep Learning for Video Ob ject Tracking

Multi-target tracking for video surveillance using deep affinity network: a brief review

Deep Affinity Network for Multiple Object Tracking

Review on Video Object Tracking Based on Deep Learning