Abstract:A large-scale system for obtaining fine-grained vehicle trajectories is becoming increasingly important because it lays a solid foundation for a wide range of downstream applications, such as urban traffic optimization, road network profiling, route planning, etc. Traditional methods recover the trajectories from GPS data from apps or coarse-grained traces collected from base stations, which are costly and, more importantly, only cover limited vehicles on the road. Thus, they are not applicable to downstream tasks. To fill this gap, we explore the possibility of recovering vehicle trajectories from the video data recorded by widely deployed traffic cameras. The major challenges lie in the quality of the captured image, low sampling rate, and unbalanced temporal and spatial distribution. To address these challenges, we propose a general system to recover vehicle trajectories at the level of the road intersection, where a novel iterative framework is developed to combine both vehicle clustering and trajectory recovery tasks, which improve their performance simultaneously. The key motivation is that vehicle clustering based on visual features can provide essential discrete points for trajectory recovery, while the recovered routes can introduce spatial-temporal constraints to the initial vehicle clusters for de-noising the false results and complement the missing results. To prove the feasibility of our framework, we collect and plan to release a city-scale traffic camera dataset consisting of 24 hours of videos from 673 cameras across 1,106 intersections. To the best of our knowledge, this benchmark is the first to contain the ground truth of vehicle trajectories with a wide range of spatial and temporal coverage in an urban environment. We conduct extensive experiments and analysis on datasets of different scales to demonstrate the robustness of our framework. Last but not least, we have already deployed the whole system in the business applications of SenseTime, China, including traffic signal control and traffic flow analysis. We highly expect this dataset to further facilitate the research in this field and contribute more to traffic optimization systems in the real world.

LRATD: a Lightweight Real-Time Abnormal Trajectory Detection Approach for Road Traffic Surveillance.

Real-Time And Robust 3D Object Detection with Roadside LiDARs

Roadside LiDAR Vehicle Detection and Tracking Using Range and Intensity Background Subtraction

Efficient Online Transfer Learning for Road Participants Detection in Autonomous Driving

uTRAND: Unsupervised Anomaly Detection in Traffic Trajectories

An Automated Learning Framework With Limited and Cross-Domain Data for Traffic Equipment Detection From Surveillance Videos

Real-time Traffic Object Detection for Autonomous Driving

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

Deep learning detection of anomalous patterns from bus trajectories for traffic insight analysis

3D Object Detection and High-Resolution Traffic Parameters Extraction Using Low-Resolution LiDAR Data

A Framework of Abnormal Behavior Detection and Classification Based on Big Trajectory Data for Mobile Networks

Automatic Background Construction and Object Detection Based on Roadside LiDAR

Real-Time 3D Object Detection on Crowded Pedestrians

Dual-Modality Vehicle Anomaly Detection via Bilateral Trajectory Tracing

Developing a new real-time traffic safety management framework for urban expressways utilizing reinforcement learning tree

Lightweight Real-Time Object Detection via Enhanced Global Perception and Intra-Layer Interaction for Complex Traffic Scenarios

Vehicle Detection and Tracking with Roadside LiDAR Using Improved ResNet18 and the Hungarian Algorithm

Text-Driven Traffic Anomaly Detection with Temporal High-Frequency Modeling in Driving Videos

A novel approach for reliable pedestrian trajectory collection with behavior-based trajectory reconstruction for urban surveillance systems

Vehicle Trajectory Recovery on Road Network Based on Traffic Camera Video Data.

Driver Behavior Analysis Using Lane Departure Detection Under Challenging Conditions