Abstract:Reliable multi-vehicle detection in unregulated traffic environments is a crucial computer vision task in the development of Intelligent Transportation Systems (ITS). Despite the promising potential of Deep Learning (DL) methods for vehicle detection, the presence of uncertainties such as varying vehicle shapes and sizes, intricate background clutter, and unpredictable vehicle flow contribute to the chaotic unregulated traffic. For real-time vehicle detection in an unregulated traffic environment this paper proposes the Hybrid Learning Multi-Vehicle Detection framework (HL-MVD) based on the C onvolutional M ulti-head A ttention T ransformer D etector (CMATDet). The primary objective of this study is to generate a dataset containing highly informative video frames using a Pool-based Active Learning Strategy (PALS). Additionally, transfer learning will be implemented to train CMATDet to achieve improved accuracy and reduced detection latency. The proposed approach restructures the baseline YOLOv5x and incorporates a Multi-head Attention transformer encoder to effectively extract global features and a Scale Specific Bidirectional Feature Pyramid Network (SS-BiFPN) to facilitate multi-scale feature representation. Simplified Optimal Transport Algorithm with top-q approximation technique (Sim-OTA) is utilized for label assignment approach. Heatmap analysis demonstrated the suitability of the newly generated dataset "AU-INV-P-PALS" for detecting specific Indian native vehicles. The performance of the proposed framework is evaluated on our custom-developed AU-INV-P-PALS vehicle dataset and the IITM-HeTra Dataset 1. In comparison with contemporary detection models, the proposed HL-MVD framework resulted with higher mAP scores (91.1% on and 78.3% on :0.95) for AU-INV-P-PALS. The proposed model demonstrated lower inference latency (8.1 ms), higher precision score (82.7% for IoU = 0.5), and higher recall score (90.8% for IoU = 0.5) than recent deep learning-based detection models in the literature. The top-q approximation technique in the detection head results in a reduced false-positive rate compared to conventional models. Finally, the performance of the proposed framework is tested on CCTV traffic footage captured on city roads in Chennai, India.

An Efficient Optimal Neural Network-Based Moving Vehicle Detection in Traffic Video Surveillance System

A Robust Video Based Traffic Light Detection Algorithm for Intelligent Vehicles

A Method for Vehicle Detection Based on Local Gradients Vector

Proactive hybrid learning framework for real-time multi-vehicle detection in unregulated traffic environments

Moving Vehicle Detection for Automatic Traffic Monitoring

Vehicle Detection and Recognition Approach in Multi-Scale Traffic Monitoring System via Graph-Based Data Optimization

High Efficient Moving Object Extraction and Classification in Traffic Video Surveillance

A fast detection algorithm for moving vehicle in traffic scenes

Moving Vehicle Detection Using AdaBoost and Haar-Like Feature in Surveillance Videos

A comprehensive analysis of real-time video anomaly detection methods for human and vehicular movement

Artificial Intelligence Enabled Traffic Monitoring System

A Resource-Efficient CNN-Based Method for Moving Vehicle Detection

Detection and classification of vehicles using audio visual cues

Vehicle Detection in a Video Frame Using Machine Learning Technology

Video Analysis for Traffic Anomaly Detection Using Support Vector Machines

Detection and Classification of Moving Vehicle from Video Using Multiple Spatio-Temporal Features

Faster CNN-based vehicle detection and counting strategy for fixed camera scenes

Proposing an Efficient Deep Learning Algorithm Based on Segment Anything Model for Detection and Tracking of Vehicles through Uncalibrated Urban Traffic Surveillance Cameras

Robust Vehicle Detection and Counting Algorithm Employing a Convolution Neural Network and Optical Flow

Real-time Moving Vehicle Detection, Tracking, and Counting System Implemented with OpenCV

A Real-Time Vehicle Counting, Speed Estimation, and Classification System Based on Virtual Detection Zone and YOLO