Abstract:Reliable multi-vehicle detection in unregulated traffic environments is a crucial computer vision task in the development of Intelligent Transportation Systems (ITS). Despite the promising potential of Deep Learning (DL) methods for vehicle detection, the presence of uncertainties such as varying vehicle shapes and sizes, intricate background clutter, and unpredictable vehicle flow contribute to the chaotic unregulated traffic. For real-time vehicle detection in an unregulated traffic environment this paper proposes the Hybrid Learning Multi-Vehicle Detection framework (HL-MVD) based on the C onvolutional M ulti-head A ttention T ransformer D etector (CMATDet). The primary objective of this study is to generate a dataset containing highly informative video frames using a Pool-based Active Learning Strategy (PALS). Additionally, transfer learning will be implemented to train CMATDet to achieve improved accuracy and reduced detection latency. The proposed approach restructures the baseline YOLOv5x and incorporates a Multi-head Attention transformer encoder to effectively extract global features and a Scale Specific Bidirectional Feature Pyramid Network (SS-BiFPN) to facilitate multi-scale feature representation. Simplified Optimal Transport Algorithm with top-q approximation technique (Sim-OTA) is utilized for label assignment approach. Heatmap analysis demonstrated the suitability of the newly generated dataset "AU-INV-P-PALS" for detecting specific Indian native vehicles. The performance of the proposed framework is evaluated on our custom-developed AU-INV-P-PALS vehicle dataset and the IITM-HeTra Dataset 1. In comparison with contemporary detection models, the proposed HL-MVD framework resulted with higher mAP scores (91.1% on and 78.3% on :0.95) for AU-INV-P-PALS. The proposed model demonstrated lower inference latency (8.1 ms), higher precision score (82.7% for IoU = 0.5), and higher recall score (90.8% for IoU = 0.5) than recent deep learning-based detection models in the literature. The top-q approximation technique in the detection head results in a reduced false-positive rate compared to conventional models. Finally, the performance of the proposed framework is tested on CCTV traffic footage captured on city roads in Chennai, India.

Multi-View Vehicle Detection Based on Fusion Part Model With Active Learning

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

Vehicle Detection Based on Deep Dual-Vehicle Deformable Part Models

Vehicle Detection by Fusing Part Model Learning and Semantic Scene Information for Complex Urban Surveillance

Multiview CNN Model for Sensor Fusion Based Vehicle Detection.

Vehicle Detection with a Part-Based Model for Complex Traffic Conditions

Multi-View Feature Fusion Network for Vehicle Re-Identification

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera

A Multi-View Vehicle Detection Method Based on Deep Neural Networks

Rear-View Vehicle Detection and Tracking by Combining Multiple Parts for Complex Urban Surveillance.

Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving

On-road Vehicle Detection Through Part Model Learning and Probabilistic Inference

Multi-View Vehicle Detection And Tracking In Crossroads

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

Part-Aware Region Proposal for Vehicle Detection in High Occlusion Environment

Vehicle detection method based on deep learning and multi-layer feature fusion

Multi-View Vehicle Type Recognition with Feedback-Enhancement Multi-Branch CNNs

A multi-scale model integrating multiple features for vehicle detection

Probabilistic Inference for Occluded and Multiview On-road Vehicle Detection

Proactive hybrid learning framework for real-time multi-vehicle detection in unregulated traffic environments

Vehicle Recognition Using Improved SIFT and Multi-View Model