Abstract:Surveillance cameras are widely deployed traffic sensors, due to their affordable prices and being able to capture rich information. However, current surveillance systems have not been fully exploited: these cameras are isolated and can only extract information from their own fixed views. To enable a collaborative sensing system, we propose a novel framework called Traffic-Informed Multi-camera Sensing (TIMS) system for network-level traffic information estimation. By pushing multi-camera Re-IDentification (ReID) workflow towards network-wide traffic information extraction, TIMS system integrates a customized metric-learning vision-based vehicle ReID method (TIM-ReID) and establishing a traffic-informed workflow. To integrate the traffic network connection information along with visual and vehicle attributes features, the road network is extracted as a weighted graph through the Spatial-temporal Camera Graph Inference Model (StCGIM) and serves for matching and re-ranking ReID candidates. Moreover, an Accuracy Model (AAM) is designed to provide accurate, reliable and comprehensive traffic information estimation, including both the values and distribution of parameters under a high penetration rate. In experiments based on real-world multi-camera datasets captured in the city of Seattle, the customized TIM-ReID outperforms existing state-of-the-art methods, and delivers accurate cross-camera information estimation, whose value error is less than 8% and the Kullback-Leibler (KL) distance between the estimated and real distribution is less than 3.42 among all the evaluated camera pairs. TIMS system empowers cameras to work collaboratively through an interactive brain, and provides users with valuable and comprehensive traffic information.

An Improved Cross-Camera Vehicle Tracking Method: Re-Identification Feature Matching of Confidence Based on Spatio-Temporal Information

Single-Camera and Inter-Camera Vehicle Tracking and 3D Speed Estimation Based on Fusion of Visual and Semantic Features

Vehicles Detection and Tracking Based on the Sub-Feature

Traffic-Informed Multi-Camera Sensing (TIMS) System Based on Vehicle Re-Identification

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Vehicle Re-Identification With Image Processing and Car-Following Model Using Multiple Surveillance Cameras From Urban Arterials

Vehicle Re-Identification and Tracking Based on Video Segmentation.

Multi-Target Vehicle Tracking Algorithm Based on Improved DeepSORT

City-Scale Multi-Camera Vehicle Tracking Guided by Crossroad Zones

Roadside Cross-Camera Vehicle Tracking Combining Visual and Spatial-Temporal Information for a Cloud Control System

Detection and Classification of Moving Vehicle from Video Using Multiple Spatio-Temporal Features

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

City-Scale Multi-Camera Vehicle Tracking System with Improved Self-Supervised Camera Link Model

A vehicle re-identification framework based on the improved multi-branch feature fusion network

Traffic-Aware Multi-Camera Tracking of Vehicles Based on ReID and Camera Link Model

Vehicle Re-ID for Surround-view Camera System

Eliminating cross-camera bias for vehicle re-identification

Visual Features with Spatio-Temporal-Based Fusion Model for Cross-Dataset Vehicle Re-Identification

Vehicle Counting System using Deep Learning and Multi-Object Tracking Methods

Complete solution for vehicle Re-ID in surround-view camera system

Scalable and Real-time Multi-Camera Vehicle Detection, Re-Identification, and Tracking