Abstract:Due to the large variations of environment with ever-changing background and vehicles with different shapes, colors and appearances, to implement a real-time on-board vehicle recognition system with high adaptability, efficiency and robustness in complicated environments, remains challenging. This paper introduces a simultaneous detection and tracking framework for robust on-board vehicle recognition based on monocular vision technology. The framework utilizes a novel layered machine learning and particle filter to build a multi-vehicle detection and tracking system. In the vehicle detection stage, a layered machine learning method is presented, which combines coarse-search and fine-search to obtain the target using the AdaBoost-based training algorithm. The pavement segmentation method based on characteristic similarity is proposed to estimate the most likely pavement area. Efficiency and accuracy are enhanced by restricting vehicle detection within the downsized area of pavement. In vehicle tracking stage, a multi-objective tracking algorithm based on target state management and particle filter is proposed. The proposed system is evaluated by roadway video captured in a variety of traffics, illumination, and weather conditions. The evaluating results show that, under conditions of proper illumination and clear vehicle appearance, the proposed system achieves 91.2% detection rate and 2.6% false detection rate. Experiments compared to typical algorithms show that, the presented algorithm reduces the false detection rate nearly by half at the cost of decreasing 2.7%–8.6% detection rate. This paper proposes a multi-vehicle detection and tracking system, which is promising for implementation in an on-board vehicle recognition system with high precision, strong robustness and low computational cost.

A Robust On-Road Vehicle Detection and Tracking Method Based on Monocular Vision.

Vehicles Detection and Tracking Based on the Sub-Feature

Detection of engineering vehicles in high-resolution monitoring images

Multi-Vehicle Tracking Based on Monocular Camera in Driver View

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

Vehicle detection and tracking based on monocular vision

A Real-time Multi-lane Detection Approach Using Features Geometric Uncertainty and Stereo Vision

A Robust Framework for Vehicle Detection and Tracking Based on Particle Filter

Simultaneous Multi-Vehicle Detection and Tracking Framework with Pavement Constraints Based on Machine Learning and Particle Filter Algorithm

Robust vehicle tracking and detection from UAVs

Robust Object Tracking with a Hierarchical Ensemble Framework

A Robust Lane Detection and Tracking Method Based on Computer Vision

Design of a Robust System Architecture for Tracking Vehicle on Highway Based on Monocular Camera

Scene-Adaptive Off-Road Detection Using a Monocular Camera

On-board Robust Vehicle Detection Using Knowledge-based Features and Motion Trajectory

A Monocular On-Road Vehicle Extraction Algorithm Utilizing Markov Random Field Model

Real-time obstacle detection with motion features using monocular vision

Multi-Object Vehicle Detection and Tracking Algorithm Based on Improved YOLOv8 and ByteTrack

Robust and Long-Term Object Tracking With an Application to Vehicles.

An Efficient Vehicle Localization Method by Using Monocular Vision

Multi-View Vehicle Detection And Tracking In Crossroads