Abstract:Nowadays, with more and more video surveillance systems constructed in our society, pedestrian tracking has become an important issue that has always been discussed in the computer vision domain all over the world. How to propose a real-time tracking system with great accuracy has always been the core of this problem, it’s a bit of a paradox because you want to have a precise detection result and a real-time tracking system at the same time, but we know the best method to make target detection is a deep neural network, which is time-consuming to process immense amounts of data. And to solve the ID-switches problem, we introduce the DeepSort algorithm to make the tracking process done. So in this paper, we propose a real-time tracking system using top-view depth data by integrating the newest YOLOv5 with DeepSort that can achieve nearly 40 frames per second of a high-quality video stream. And the orientation of our camera is top-view, which can help the neural network distinguish a bunch of people with occlusion easily, at the same time we choose depth data to avoid privacy leaks problem. Once we have an accurate detection result then we use the Kalman filter and Hungarian algorithm and matching cascade to handle the matching process of multiple detection and tracks. To authenticate the surveillance system we proposed, we conducted a few experiments on different datasets that meet our data requirements, we also recorded two datasets by various cameras in our laboratory and outdoor environment. In addition, the results showed the superior advantages of top-view depth data in tracking by the detection system and improved the tracking accuracy to 99.3% which is the best mAP@0.5 of alike methods. And all experiments conducted on different video streams can reach a real-time level and verify the effectiveness of this system as well.

Fast Algorithm for Automatic Generating Field of View Line of Multiple Cameras

Light Field Camera Based Automatic Algorithm for Optimal Face Search

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Obstacle Detection In Unstructured Environment With A Single Camera And Linear Method

Global Pose Estimation Iterative Algorithm for Multi-camera from Point and Line Correspondences

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Line-preserving video stitching for asymmetric cameras

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

A Object Tracking Method In Two Cameras With Common View Field

A Top-View Multiple People Tracking System Based on Newest YOLOv5 and DeepSort Using Depth Data

Real-time and ultrahigh accuracy image synthesis algorithm for full field of view imaging system

Object Tracking over Multiple Uncalibrated Cameras Using Visual, Spatial and Temporal Similarities.

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

A Fast and Robust Multi-Camera Object Tracking Algorithm

Multi-camera tracking optimization design in video surveillance system

Virtual Viewpoint Synthesis In Multi-View Video System

Online Adaptive Fast Multipose Face Tracking Based on Visual Cue Selection

An Auto-calibration method in Multi-view tracking system

Fast detection of overlapped areas in smart camera network

Multi-view Moving Human Detection and Correspondence Based on Object Occupancy Random Field

Real-time distance field acceleration based free-viewpoint video synthesis for large sports fields