Abstract:Reliable multi-vehicle detection in unregulated traffic environments is a crucial computer vision task in the development of Intelligent Transportation Systems (ITS). Despite the promising potential of Deep Learning (DL) methods for vehicle detection, the presence of uncertainties such as varying vehicle shapes and sizes, intricate background clutter, and unpredictable vehicle flow contribute to the chaotic unregulated traffic. For real-time vehicle detection in an unregulated traffic environment this paper proposes the Hybrid Learning Multi-Vehicle Detection framework (HL-MVD) based on the C onvolutional M ulti-head A ttention T ransformer D etector (CMATDet). The primary objective of this study is to generate a dataset containing highly informative video frames using a Pool-based Active Learning Strategy (PALS). Additionally, transfer learning will be implemented to train CMATDet to achieve improved accuracy and reduced detection latency. The proposed approach restructures the baseline YOLOv5x and incorporates a Multi-head Attention transformer encoder to effectively extract global features and a Scale Specific Bidirectional Feature Pyramid Network (SS-BiFPN) to facilitate multi-scale feature representation. Simplified Optimal Transport Algorithm with top-q approximation technique (Sim-OTA) is utilized for label assignment approach. Heatmap analysis demonstrated the suitability of the newly generated dataset "AU-INV-P-PALS" for detecting specific Indian native vehicles. The performance of the proposed framework is evaluated on our custom-developed AU-INV-P-PALS vehicle dataset and the IITM-HeTra Dataset 1. In comparison with contemporary detection models, the proposed HL-MVD framework resulted with higher mAP scores (91.1% on and 78.3% on :0.95) for AU-INV-P-PALS. The proposed model demonstrated lower inference latency (8.1 ms), higher precision score (82.7% for IoU = 0.5), and higher recall score (90.8% for IoU = 0.5) than recent deep learning-based detection models in the literature. The top-q approximation technique in the detection head results in a reduced false-positive rate compared to conventional models. Finally, the performance of the proposed framework is tested on CCTV traffic footage captured on city roads in Chennai, India.

An Efficient Real-Time Vehicle Classification from a Complex Image Dataset Using eXtreme Gradient Boosting and the Multi-Objective Genetic Algorithm

A Method for Vehicle Detection Based on Local Gradients Vector

Application of an ensemble CatBoost model over complex dataset for vehicle classification

Vehicle Classification Using Deep Feature Fusion and Genetic Algorithms

Improved Waveform‐feature‐based Vehicle Classification Using a Single‐point Magnetic Sensor

AdaBoost-Bagging Vehicle Detection Algorithm Based on Multi-Mode Weak Classifier

Exploiting Remote Sensing Imagery For Vehicle Detection And Classification Using Robust Competitive Algorithm With Deep Convolutional Neural Network

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

Proactive hybrid learning framework for real-time multi-vehicle detection in unregulated traffic environments

Monocular Camera Viewpoint-Invariant Vehicular Traffic Segmentation and Classification Utilizing Small Datasets

Exploiting Remote Sensing Imagery for Vehicle Detection and Classification Using an Artificial Intelligence Technique

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

An Evaluation of Boosted Features for Vehicle Detection

A Real-Time Vehicle Counting, Speed Estimation, and Classification System Based on Virtual Detection Zone and YOLO

Vehicle Detection and Recognition Approach in Multi-Scale Traffic Monitoring System via Graph-Based Data Optimization

Optimizing Road Traffic Surveillance: A Robust Hyper-Heuristic Approach for Vehicle Segmentation

Vehicle recognition algorithm based on Haar-like features and improved Adaboost classifier

Spotted hyena optimizer with deep learning enabled vehicle counting and classification model for intelligent transportation systems

Vehicle Detection and Classification via YOLOv8 and Deep Belief Network over Aerial Image Sequences

Artificial Intelligence-Empowered Logistic Traffic Management System Using Empirical Intelligent XGBoost Technique in Vehicular Edge Networks

An Efficient Optimal Neural Network-Based Moving Vehicle Detection in Traffic Video Surveillance System