Abstract:Multi-camera vehicle tracking (MCVT) system is a key technology to build an intelligent city and intelligent transportation system. The MCVT system utilizes roadside monitoring devices and computing platforms to achieve city-level road traffic perception at a finer scale by tracking each vehicle on the road to obtain the trajectory. The existing MCVT system mainly focuses on dealing with the algorithm modules separately, without studying the real-time performance and system architecture of the entire pipeline. However, in real-world applications, many of the tricks in improving evaluation metrics are not applicable since there is endless traffic flow running all the time. Therefore, this paper proposes a real-time framework of the MCVT system to streamline all the algorithm modules with proper data flow. Firstly, a multi-threaded multi-vehicle tracking (MVT) module is developed to detect vehicles in each camera. Re-identification is implemented during MVT to provide the feature for tracking in the same camera and across different cameras. Then, after the vehicle leaves the camera field of view, the feature of vehicle trajectory is calculated by averaging the feature at each frame. Meanwhile, a background thread runs continuously to match the incoming feature of vehicle trajectory with past features by conducting a topology searching method. In the end, the vehicle trajectories with well-matched features are considered to be the same vehicle. The entire pipeline has been validated on two different datasets, the precision is 0.64 in the CityFlow dataset which uses 6 cameras simultaneously. In the customized dataset, the same method can still reach real-time when using 16 cameras at the same time with smaller network modules.

Multi-Perspective Tracking for Intelligent Vehicle.

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaboration

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Multi-Vehicle Tracking Via Real-Time Detection Probes and a Markov Decision Process Policy.

Multi-Vehicle Tracking Based on Monocular Camera in Driver View

City-Scale Multi-Camera Vehicle Tracking Based on Space-Time-Appearance Features

Integrating Appearance and Spatial-Temporal Information for Multi-Camera People Tracking.

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

A Real-time Framework of Multi-Camera Vehicle Tracking System*

Multi-Camera Object Fusion Tracking Model for Autonomous Driving.

Multi-View Vehicle Detection And Tracking In Crossroads

A Real-Time Multi-Vehicle Tracking Framework in Intelligent Vehicular Networks

A New Approach for Vehicle Recognition and Tracking in Multi-camera Traffic System.

Multitarget Vehicle Tracking and Motion State Estimation Using a Novel Driving Environment Perception System of Intelligent Vehicles

Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehicles

Enhanced Detection Model and Joint Scoring Strategy for Multi-Vehicle Tracking

A close-loop tracking approach for multi-view pedestrian tracking

Spatial-Temporal Correlation 3D Vehicle Detection and Tracking System with Multiple Surveillance Cameras