Abstract:Surveillance cameras are widely deployed traffic sensors, due to their affordable prices and being able to capture rich information. However, current surveillance systems have not been fully exploited: these cameras are isolated and can only extract information from their own fixed views. To enable a collaborative sensing system, we propose a novel framework called Traffic-Informed Multi-camera Sensing (TIMS) system for network-level traffic information estimation. By pushing multi-camera Re-IDentification (ReID) workflow towards network-wide traffic information extraction, TIMS system integrates a customized metric-learning vision-based vehicle ReID method (TIM-ReID) and establishing a traffic-informed workflow. To integrate the traffic network connection information along with visual and vehicle attributes features, the road network is extracted as a weighted graph through the Spatial-temporal Camera Graph Inference Model (StCGIM) and serves for matching and re-ranking ReID candidates. Moreover, an Accuracy Model (AAM) is designed to provide accurate, reliable and comprehensive traffic information estimation, including both the values and distribution of parameters under a high penetration rate. In experiments based on real-world multi-camera datasets captured in the city of Seattle, the customized TIM-ReID outperforms existing state-of-the-art methods, and delivers accurate cross-camera information estimation, whose value error is less than 8% and the Kullback-Leibler (KL) distance between the estimated and real distribution is less than 3.42 among all the evaluated camera pairs. TIMS system empowers cameras to work collaboratively through an interactive brain, and provides users with valuable and comprehensive traffic information.

Multi-model Traffic Scene Simulation with Road Image Sequences and GIS Information

Rapid Modeling Scheme of Virtual Scene for Urban Road Traffic

Three-Dimensional Traffic Scenes Simulation from Road Image Sequences

Spatiotemporal Analysis of Static and Dynamic Traffic Elements from Road Scenes.

Road Scene Simulation Based on Vehicle Sensors: an Intelligent Framework Using Random Walk Detection and Scene Stage Reconstruction.

Coarse-to-fine 3D Road Model Registration for Traffic Video Augmentation

Novel Framework for 3D Road Extraction Based on Airborne LiDAR and High-Resolution Remote Sensing Imagery

Geometric and Semantic Analysis of Road Image Sequences for Traffic Scene Construction

Traffic-Informed Multi-Camera Sensing (TIMS) System Based on Vehicle Re-Identification

RoadView: A traffic scene simulator for autonomous vehicle simulation testing

Road Scene Layout Reconstruction Based on CNN and Its Application in Traffic Simulation.

TPMT based Automatic Road Extraction from 3D Real Scenes

Road Scene Segmentation Via Fusing Camera and Lidar Data.

Raw GIS to 3D road modeling for real-time traffic simulation

Semantic Segmentation and Scene Reconstruction for Traffic Simulation Using CNN

3D Traffic Scenes Construction and Simulation Based on Scene Stages

A Comprehensive Framework for Transportation Infrastructure Digitalization: TJYRoad-Net for Enhanced Point Cloud Segmentation

Research on Intelligent Vehicle Traffic Scenes Mapping Algorithm Considering Dynamic Objects

Generating Image Sequences of Augmented Road Scenarios

Transforming GIS data into functional road models for large-scale traffic simulation

3D Road Network Modeling and Road Structure Recognition in Internet of Vehicles