Abstract:Nowadays, with more and more video surveillance systems constructed in our society, pedestrian tracking has become an important issue that has always been discussed in the computer vision domain all over the world. How to propose a real-time tracking system with great accuracy has always been the core of this problem, it’s a bit of a paradox because you want to have a precise detection result and a real-time tracking system at the same time, but we know the best method to make target detection is a deep neural network, which is time-consuming to process immense amounts of data. And to solve the ID-switches problem, we introduce the DeepSort algorithm to make the tracking process done. So in this paper, we propose a real-time tracking system using top-view depth data by integrating the newest YOLOv5 with DeepSort that can achieve nearly 40 frames per second of a high-quality video stream. And the orientation of our camera is top-view, which can help the neural network distinguish a bunch of people with occlusion easily, at the same time we choose depth data to avoid privacy leaks problem. Once we have an accurate detection result then we use the Kalman filter and Hungarian algorithm and matching cascade to handle the matching process of multiple detection and tracks. To authenticate the surveillance system we proposed, we conducted a few experiments on different datasets that meet our data requirements, we also recorded two datasets by various cameras in our laboratory and outdoor environment. In addition, the results showed the superior advantages of top-view depth data in tracking by the detection system and improved the tracking accuracy to 99.3% which is the best mAP@0.5 of alike methods. And all experiments conducted on different video streams can reach a real-time level and verify the effectiveness of this system as well.

Design of a Robust System Architecture for Tracking Vehicle on Highway Based on Monocular Camera

Multi-Vehicle Tracking Based on Monocular Camera in Driver View

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

A Top-View Multiple People Tracking System Based on Newest YOLOv5 and DeepSort Using Depth Data

Research on Tracking Method of Multiple Vehicles Based on Monocular Camera

Multi-object Tracking for Autonomous Driving with a Monocular Camera Subject to Missing Data

Simultaneous Multi-Vehicle Detection and Tracking Framework with Pavement Constraints Based on Machine Learning and Particle Filter Algorithm

A Vehicle Overtake Accessorial Navigation System Based on Monocular Vision

A Robust On-Road Vehicle Detection and Tracking Method Based on Monocular Vision.

Multi-Vehicle Tracking Via Real-Time Detection Probes and a Markov Decision Process Policy.

Enhanced Detection Model and Joint Scoring Strategy for Multi-Vehicle Tracking

Fast Segmentation-Based Object Tracking Model for Autonomous Vehicles

A Vehicle Tracking Algorithm Combining Detector and Tracker

YOLOv3-MT: A YOLOv3 using multi-target tracking for vehicle visual detection

Machine vision-based autonomous road hazard avoidance system for self-driving vehicles

Multitarget Vehicle Tracking and Motion State Estimation Using a Novel Driving Environment Perception System of Intelligent Vehicles

A Real-time Framework of Multi-Camera Vehicle Tracking System*

Multiple Moving Vehicles Tracking Algorithm with Attention Mechanism and Motion Model

Vehicle Tracking with Non-overlapping Views for Multi-camera Surveillance System

Omni-directional Detection and Tracking of On-Road Vehicles Using Multiple Horizontal Laser Scanners

Multi-Object Vehicle Detection and Tracking Algorithm Based on Improved YOLOv8 and ByteTrack