Abstract:Nowadays, with more and more video surveillance systems constructed in our society, pedestrian tracking has become an important issue that has always been discussed in the computer vision domain all over the world. How to propose a real-time tracking system with great accuracy has always been the core of this problem, it’s a bit of a paradox because you want to have a precise detection result and a real-time tracking system at the same time, but we know the best method to make target detection is a deep neural network, which is time-consuming to process immense amounts of data. And to solve the ID-switches problem, we introduce the DeepSort algorithm to make the tracking process done. So in this paper, we propose a real-time tracking system using top-view depth data by integrating the newest YOLOv5 with DeepSort that can achieve nearly 40 frames per second of a high-quality video stream. And the orientation of our camera is top-view, which can help the neural network distinguish a bunch of people with occlusion easily, at the same time we choose depth data to avoid privacy leaks problem. Once we have an accurate detection result then we use the Kalman filter and Hungarian algorithm and matching cascade to handle the matching process of multiple detection and tracks. To authenticate the surveillance system we proposed, we conducted a few experiments on different datasets that meet our data requirements, we also recorded two datasets by various cameras in our laboratory and outdoor environment. In addition, the results showed the superior advantages of top-view depth data in tracking by the detection system and improved the tracking accuracy to 99.3% which is the best mAP@0.5 of alike methods. And all experiments conducted on different video streams can reach a real-time level and verify the effectiveness of this system as well.

A Robust Real-Time Detecting And Tracking Framework For Multiple Kinds Of Unmarked Object

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Robust Object Tracking with a Hierarchical Ensemble Framework

DeepBhvTracking: A Novel Behavior Tracking Method for Laboratory Animals Based on Deep Learning

A Real-Time Motion Detection and Object Tracking Framework for Future Robot-Rat Interaction

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

Real-time multiple object tracking using deep learning methods

A Top-View Multiple People Tracking System Based on Newest YOLOv5 and DeepSort Using Depth Data

Real-Time Online Multi-Object Tracking

Real-Time Visual Perception System for a Robotic Rat

Reliable Multi-Object Tracking in the Presence of Unreliable Detections

A Tracking-By-Detection Based 3D Multiple Object Tracking for Autonomous Driving

Online Multi-Object Tracking Method for Shrimps in High Density Using Multi-Task You Only Look Once Exceeding and Cascade Strategy

A deep learning-based approach for real-time rodent detection and behaviour classification

A Real Time Video Object Tracking Method for Fish

Simple Online and Realtime Underwater Multiple Object Tracking

An online multi-object tracking approach by adaptive labeling and kalman filter

ADT: Object Tracking Algorithm Based on Adaptive Detection

Detection and Tracking of Multiple Mice Using Part Proposal Networks

A Fast and Robust Multiple Individuals Tracking Algorithm Based on Artificial Neural Networks

Achieving Adaptive Visual Multi-Object Tracking with Unscented Kalman Filter