Abstract:Reliable multi-vehicle detection in unregulated traffic environments is a crucial computer vision task in the development of Intelligent Transportation Systems (ITS). Despite the promising potential of Deep Learning (DL) methods for vehicle detection, the presence of uncertainties such as varying vehicle shapes and sizes, intricate background clutter, and unpredictable vehicle flow contribute to the chaotic unregulated traffic. For real-time vehicle detection in an unregulated traffic environment this paper proposes the Hybrid Learning Multi-Vehicle Detection framework (HL-MVD) based on the C onvolutional M ulti-head A ttention T ransformer D etector (CMATDet). The primary objective of this study is to generate a dataset containing highly informative video frames using a Pool-based Active Learning Strategy (PALS). Additionally, transfer learning will be implemented to train CMATDet to achieve improved accuracy and reduced detection latency. The proposed approach restructures the baseline YOLOv5x and incorporates a Multi-head Attention transformer encoder to effectively extract global features and a Scale Specific Bidirectional Feature Pyramid Network (SS-BiFPN) to facilitate multi-scale feature representation. Simplified Optimal Transport Algorithm with top-q approximation technique (Sim-OTA) is utilized for label assignment approach. Heatmap analysis demonstrated the suitability of the newly generated dataset "AU-INV-P-PALS" for detecting specific Indian native vehicles. The performance of the proposed framework is evaluated on our custom-developed AU-INV-P-PALS vehicle dataset and the IITM-HeTra Dataset 1. In comparison with contemporary detection models, the proposed HL-MVD framework resulted with higher mAP scores (91.1% on and 78.3% on :0.95) for AU-INV-P-PALS. The proposed model demonstrated lower inference latency (8.1 ms), higher precision score (82.7% for IoU = 0.5), and higher recall score (90.8% for IoU = 0.5) than recent deep learning-based detection models in the literature. The top-q approximation technique in the detection head results in a reduced false-positive rate compared to conventional models. Finally, the performance of the proposed framework is tested on CCTV traffic footage captured on city roads in Chennai, India.

Proactive hybrid learning framework for real-time multi-vehicle detection in unregulated traffic environments

A Fast and Accurate Real-Time Vehicle Detection Method Using Deep Learning for Unconstrained Environments

A Comparative Analysis of Multi-Label Deep Learning Classifiers for Real-Time Vehicle Detection to Support Intelligent Transportation Systems

Proposing an Efficient Deep Learning Algorithm Based on Segment Anything Model for Detection and Tracking of Vehicles through Uncalibrated Urban Traffic Surveillance Cameras

An Intelligent Traffic Analysis and Prediction System Using Deep Learning Technique

Real-time video surveillance on highways using combination of extended Kalman Filter and deep reinforcement learning

Object Detection and Classification Framework for Analysis of Video Data Acquired from Indian Roads

EfficientLiteDet: a real-time pedestrian and vehicle detection algorithm

Real-time Traffic Surveillance and Detection using Deep Learning and Computer Vision Techniques

Deep Learning Based Traffic Surveillance System For Missing and Suspicious Car Detection

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera

YOLOv3-MT: A YOLOv3 using multi-target tracking for vehicle visual detection

Monocular Camera Viewpoint-Invariant Vehicular Traffic Segmentation and Classification Utilizing Small Datasets

EnsembleNet: a hybrid approach for vehicle detection and estimation of traffic density based on faster R-CNN and YOLO models

A Multi-Scale Feature Fusion Based Lightweight Vehicle Target Detection Network on Aerial Optical Images

An intelligent traffic detection approach for vehicles on highway using pattern recognition and deep learning

Multi-View Vehicle Detection Based on Fusion Part Model With Active Learning

Application of improved you only look once model in road traffic monitoring system

Deep Learning Based Vehicle Detection and Counting System for Intelligent Transportation

Multiple Moving Vehicles Tracking Algorithm with Attention Mechanism and Motion Model

Improved Deep Learning-Based Vehicle Detection for Urban Applications Using Remote Sensing Imagery