Abstract:Reliable multi-vehicle detection in unregulated traffic environments is a crucial computer vision task in the development of Intelligent Transportation Systems (ITS). Despite the promising potential of Deep Learning (DL) methods for vehicle detection, the presence of uncertainties such as varying vehicle shapes and sizes, intricate background clutter, and unpredictable vehicle flow contribute to the chaotic unregulated traffic. For real-time vehicle detection in an unregulated traffic environment this paper proposes the Hybrid Learning Multi-Vehicle Detection framework (HL-MVD) based on the C onvolutional M ulti-head A ttention T ransformer D etector (CMATDet). The primary objective of this study is to generate a dataset containing highly informative video frames using a Pool-based Active Learning Strategy (PALS). Additionally, transfer learning will be implemented to train CMATDet to achieve improved accuracy and reduced detection latency. The proposed approach restructures the baseline YOLOv5x and incorporates a Multi-head Attention transformer encoder to effectively extract global features and a Scale Specific Bidirectional Feature Pyramid Network (SS-BiFPN) to facilitate multi-scale feature representation. Simplified Optimal Transport Algorithm with top-q approximation technique (Sim-OTA) is utilized for label assignment approach. Heatmap analysis demonstrated the suitability of the newly generated dataset "AU-INV-P-PALS" for detecting specific Indian native vehicles. The performance of the proposed framework is evaluated on our custom-developed AU-INV-P-PALS vehicle dataset and the IITM-HeTra Dataset 1. In comparison with contemporary detection models, the proposed HL-MVD framework resulted with higher mAP scores (91.1% on and 78.3% on :0.95) for AU-INV-P-PALS. The proposed model demonstrated lower inference latency (8.1 ms), higher precision score (82.7% for IoU = 0.5), and higher recall score (90.8% for IoU = 0.5) than recent deep learning-based detection models in the literature. The top-q approximation technique in the detection head results in a reduced false-positive rate compared to conventional models. Finally, the performance of the proposed framework is tested on CCTV traffic footage captured on city roads in Chennai, India.

Cost-Based Feature Transfer for Vehicle Occupant Classification

Seat detection in a car for a smart airbag application

Automatic detection of vehicle occupancy and driver's seat belt status using deep learning

Autoencoder Based Inter-Vehicle Generalization for In-Cabin Occupant Classification

Research on occupant injury severity prediction of autonomous vehicles based on transfer learning

Ridesharing car detection by transfer learning

Robust Seatbelt Detection and Usage Recognition for Driver Monitoring Systems

Vehicle Detection through Instance Segmentation using Mask R-CNN for Intelligent Vehicle System

Multitask Network for Joint Object Detection, Semantic Segmentation and Human Pose Estimation in Vehicle Occupancy Monitoring

Integrated In-vehicle Monitoring System Using 3D Human Pose Estimation and Seat Belt Segmentation

Occupancy Detection in Vehicles Using Fisher Vector Image Representation

The left-behind human detection and tracking system based on vision with multi-model fusion and microwave radar inside the bus

Ridesourcing Car Detection by Transfer Learning

Multisensor Online Transfer Learning for 3D LiDAR-Based Human Detection with a Mobile Robot

Efficient Online Transfer Learning for Road Participants Detection in Autonomous Driving

Child face detection on front passenger seat through deep learning

Proactive hybrid learning framework for real-time multi-vehicle detection in unregulated traffic environments

Vehicle Occupant Detection Based on MM-Wave Radar

On Transferability of Driver Observation Models from Simulated to Real Environments in Autonomous Cars

Vision Based Automatic Occupant Classification and Pose Recognition for Smart Airbag Deployment

Neuromorphic Seatbelt State Detection for In-Cabin Monitoring with Event Cameras