Abstract:Due to the large variations of environment with ever-changing background and vehicles with different shapes, colors and appearances, to implement a real-time on-board vehicle recognition system with high adaptability, efficiency and robustness in complicated environments, remains challenging. This paper introduces a simultaneous detection and tracking framework for robust on-board vehicle recognition based on monocular vision technology. The framework utilizes a novel layered machine learning and particle filter to build a multi-vehicle detection and tracking system. In the vehicle detection stage, a layered machine learning method is presented, which combines coarse-search and fine-search to obtain the target using the AdaBoost-based training algorithm. The pavement segmentation method based on characteristic similarity is proposed to estimate the most likely pavement area. Efficiency and accuracy are enhanced by restricting vehicle detection within the downsized area of pavement. In vehicle tracking stage, a multi-objective tracking algorithm based on target state management and particle filter is proposed. The proposed system is evaluated by roadway video captured in a variety of traffics, illumination, and weather conditions. The evaluating results show that, under conditions of proper illumination and clear vehicle appearance, the proposed system achieves 91.2% detection rate and 2.6% false detection rate. Experiments compared to typical algorithms show that, the presented algorithm reduces the false detection rate nearly by half at the cost of decreasing 2.7%–8.6% detection rate. This paper proposes a multi-vehicle detection and tracking system, which is promising for implementation in an on-board vehicle recognition system with high precision, strong robustness and low computational cost.

Real-time Vehicle Detection and Tracking in Video Based on Faster R-CNN

Vehicles Detection and Tracking Based on the Sub-Feature

Tracking System for Driving Assistance with the Faster R-CNN

A Vehicle Tracking Algorithm Combining Detector and Tracker

Design of Real-Time Vehicle Detection Based on YOLOv4

Faster CNN-based vehicle detection and counting strategy for fixed camera scenes

Real-time Vehicle Detection and Counting in Complex Traffic Scenes Using Background Subtraction Model with Low-Rank Decomposition

Application Research of Key Frames Extraction Technology Combined with Optimized Faster R-CNN Algorithm in Traffic Video Analysis

Enhanced Detection Model and Joint Scoring Strategy for Multi-Vehicle Tracking

Continuous Vehicle Detection and Tracking for Non-overlapping Multi-camera Surveillance System.

Vehicle Detection Under Traffic Scenarios Based on Faster RCNN and YOLO

Multi-Vehicle Tracking Based on Monocular Camera in Driver View

Scalable and Real-time Multi-Camera Vehicle Detection, Re-Identification, and Tracking

Real-time Vehicle Detection under Complex Road Conditions

Efficient Online Vehicle Tracking for Real—Virtual Mapping Systems

Automatic Multi-Vehicle Tracking Using Video Cameras: an Improved Camshift Approach

Simultaneous Multi-Vehicle Detection and Tracking Framework with Pavement Constraints Based on Machine Learning and Particle Filter Algorithm

Effective Real-Time Vehicle Tracking Using Discriminative Sparse Coding on Local Patches

Real-time Vehicle Detection and Tracking Based on the Combination of YOLOv7 and ByteTrack

Real-time multiple vehicles tracking with occlusion handling

Real-Time Detection of Vehicle Speed Based on Video Image