Abstract:Abstract The task of environmental perception is an extremely important part of the automatic driving project, and mainstream schemes are divided into visual perception and radar perception. Visual algorithms have advantages in cost and object detection or image segmentation methods are usually used for perception. We adopt computer vision scheme to collect data and establish Transportation of Wuhan China (TOWC) datasets based on Chinese urban situation. After optimizing the selection of anchor boxes, the Yolov4 model is retrained as the object detector, which is combined with Simple Online and Real-time Tracking (SORT) algorithm and Perspective-n-Point (PnP) monocular algorithm to realize the integration of object detection, tracking and ranging. The detection and tracking methods have been evaluated against the Microsoft Common Objects in Context (MSCOCO) datasets and Multiple Object Tracking (MOT) challenge respectively. And the detection performance also has been evaluated again in our TOWC datasets. The evaluation has been conducted in challenging conditions, including occlusion, partial visibility, and under lighting variations with the mean average precision of 97.17% and the real-time speed of 30.2 FPS. The results show that our fusion detection algorithm is not inferior to other most advanced methods on the premise of excellent real-time performance. The developed model is a generic and accurate solution for traffic object detection, tracking and ranging, which can be applied to many other fields, such as automatic driving vehicle, traffic sign recognition, anomaly detection, motion analysis, or any other research areas where the traffic environmental perception is in the center of attention.

Spatial-Temporal Correlation 3D Vehicle Detection and Tracking System with Multiple Surveillance Cameras

Single-Camera and Inter-Camera Vehicle Tracking and 3D Speed Estimation Based on Fusion of Visual and Semantic Features

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Vehicle Tracking with Non-overlapping Views for Multi-camera Surveillance System

Multi-Camera Object Fusion Tracking Model for Autonomous Driving.

City-Scale Multi-Camera Vehicle Tracking Based on Space-Time-Appearance Features

Rear-View Vehicle Detection and Tracking by Combining Multiple Parts for Complex Urban Surveillance.

CC-3DT: Panoramic 3D Object Tracking via Cross-Camera Fusion

3D Multiple Object Tracking with Multi-modal Fusion of Low-cost Sensors for Autonomous Driving.

Roadside Cross-Camera Vehicle Tracking Combining Visual and Spatial-Temporal Information for a Cloud Control System

Vehicle Detection and Tracking in Remote Sensing Satellite Vidio Based on Dynamic Association.

Collaborative Tracking Method in Multi-Camera System

A Tracking-By-Detection Based 3D Multiple Object Tracking for Autonomous Driving

Continuous Vehicle Detection and Tracking for Non-overlapping Multi-camera Surveillance System.

Joint Monocular 3D Vehicle Detection and Tracking

A Vehicle Tracking Algorithm Combining Detector and Tracker

Multi-Camera Vehicle Tracking System Based on Spatial-Temporal Filtering

Enhanced Detection Model and Joint Scoring Strategy for Multi-Vehicle Tracking

Multi-View Vehicle Detection And Tracking In Crossroads

Target Tracking and 3D Trajectory Reconstruction Based on Multicamera Calibration