Abstract:A large-scale system for obtaining fine-grained vehicle trajectories is becoming increasingly important because it lays a solid foundation for a wide range of downstream applications, such as urban traffic optimization, road network profiling, route planning, etc. Traditional methods recover the trajectories from GPS data from apps or coarse-grained traces collected from base stations, which are costly and, more importantly, only cover limited vehicles on the road. Thus, they are not applicable to downstream tasks. To fill this gap, we explore the possibility of recovering vehicle trajectories from the video data recorded by widely deployed traffic cameras. The major challenges lie in the quality of the captured image, low sampling rate, and unbalanced temporal and spatial distribution. To address these challenges, we propose a general system to recover vehicle trajectories at the level of the road intersection, where a novel iterative framework is developed to combine both vehicle clustering and trajectory recovery tasks, which improve their performance simultaneously. The key motivation is that vehicle clustering based on visual features can provide essential discrete points for trajectory recovery, while the recovered routes can introduce spatial-temporal constraints to the initial vehicle clusters for de-noising the false results and complement the missing results. To prove the feasibility of our framework, we collect and plan to release a city-scale traffic camera dataset consisting of 24 hours of videos from 673 cameras across 1,106 intersections. To the best of our knowledge, this benchmark is the first to contain the ground truth of vehicle trajectories with a wide range of spatial and temporal coverage in an urban environment. We conduct extensive experiments and analysis on datasets of different scales to demonstrate the robustness of our framework. Last but not least, we have already deployed the whole system in the business applications of SenseTime, China, including traffic signal control and traffic flow analysis. We highly expect this dataset to further facilitate the research in this field and contribute more to traffic optimization systems in the real world.

Wi-Eye: Tracking Urban Private Vehicles with Inter-Vehicle Communications and Sparse Video Surveillance Cameras.

Urban Network-Wide Traffic Speed Estimation with Massive Ride-Sourcing GPS Traces

On Detecting Hidden Wireless Cameras: A Traffic Pattern-based Approach.

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Turning traffic surveillance cameras into intelligent sensors for traffic density estimation

Vehicle Trajectory Recovery on Road Network Based on Traffic Camera Video Data.

TrajRecovery: an Efficient Vehicle Trajectory Recovery Framework Based on Urban-Scale Traffic Camera Records

Video-Based Traffic Parameter Extraction with an Improved Vehicle Tracking Algorithm

Spatio-Temporal Vehicle Trajectory Recovery on Road Network Based on Traffic Camera Video Data

High-Resolution Vehicle Trajectory Extraction and Denoising from Aerial Videos.

Real-time Traffic Pattern Analysis and Inference with Sparse Video Surveillance Information

Vehicle Feature Point Trajectory Clustering and Vehicle Behavior Analysis in Complex Traffic Scenes.

Machine-Learning-Based Real-Time Multi-Camera Vehicle Tracking and Travel-Time Estimation

An Intelligent Networked Car-Hailing System Based on the Multi Sensor Fusion and UWB Positioning Technology under Complex Scenes Condition

WITM: Intelligent Traffic Monitoring Using Fine-Grained Wireless Signal

DeepWiTraffic: Low Cost WiFi-Based Traffic Monitoring System Using Deep Learning

Roadside Cross-Camera Vehicle Tracking Combining Visual and Spatial-Temporal Information for a Cloud Control System

Hidden Vehicle Sensing via Asynchronous V2V Transmission: A Multi-Path-Geometry Approach

Multitarget Vehicle Tracking and Motion State Estimation Using a Novel Driving Environment Perception System of Intelligent Vehicles