Abstract:Nowadays, with more and more video surveillance systems constructed in our society, pedestrian tracking has become an important issue that has always been discussed in the computer vision domain all over the world. How to propose a real-time tracking system with great accuracy has always been the core of this problem, it’s a bit of a paradox because you want to have a precise detection result and a real-time tracking system at the same time, but we know the best method to make target detection is a deep neural network, which is time-consuming to process immense amounts of data. And to solve the ID-switches problem, we introduce the DeepSort algorithm to make the tracking process done. So in this paper, we propose a real-time tracking system using top-view depth data by integrating the newest YOLOv5 with DeepSort that can achieve nearly 40 frames per second of a high-quality video stream. And the orientation of our camera is top-view, which can help the neural network distinguish a bunch of people with occlusion easily, at the same time we choose depth data to avoid privacy leaks problem. Once we have an accurate detection result then we use the Kalman filter and Hungarian algorithm and matching cascade to handle the matching process of multiple detection and tracks. To authenticate the surveillance system we proposed, we conducted a few experiments on different datasets that meet our data requirements, we also recorded two datasets by various cameras in our laboratory and outdoor environment. In addition, the results showed the superior advantages of top-view depth data in tracking by the detection system and improved the tracking accuracy to 99.3% which is the best mAP@0.5 of alike methods. And all experiments conducted on different video streams can reach a real-time level and verify the effectiveness of this system as well.

A robust target recognition and tracking panoramic surveillance system based on deep learning

Real-Time Target Detection and Recognition with Deep Convolutional Networks for Intelligent Visual Surveillance

Video Based Head Detection and Tracking Surveillance System

Target Detection and Recognition for Wide Area Border Defense Intelligent Surveillance.

A Top-View Multiple People Tracking System Based on Newest YOLOv5 and DeepSort Using Depth Data

Algorithm for Panoramic Video Tracking Based on Improved SiameseRPN

Non-line-of-sight imaging and tracking of moving objects based on deep learning

Real-Time Object Detection for 360-Degree Panoramic Image Using CNN

A Panoramic Video Face Detection System Design and Implement

Tracking of small infrared targets based on convolutional neural network

Object Tracking for an Autonomous Unmanned Surface Vehicle

Intelligent Wearable Devices Enabled Automatic Vehicle Detection and Tracking System with Video-Enabled UAV Networks Using Deep Convolutional Neural Network and IoT Surveillance

Deep Siamese Cross-Residual Learning for Robust Visual Tracking

Deep Learning and Hybrid Approaches for Dynamic Scene Analysis, Object Detection and Motion Tracking

CNN and Binocular Vision-Based Target Detection and Ranging Framework of Intelligent Railway System

Robust Video-Based Surveillance by Integrating Target Detection with Tracking

MPNET: An End-to-End Deep Neural Network for Object Detection in Surveillance Video.

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network

Target Recognition and Location Based on Deep Learning

Robust Visual Tracking Method via Deep Learning

A Fast Dynamic Dim Target Tracking Approach for UAVs Using Improved Lightweight Siamese Networks