Abstract:This study presents YOLO‐IR and YOLO‐DeepOC‐IR, innovative methods for infrared object detection and tracking in dense urban traffic, emphasizing image processing techniques. The work employs infrared image enhancement techniques (local contrast multi‐scale enhancement, non‐local means, and contrast limited adaptive histogram equalization), a MobileVITv3 backbone, and a multi‐layer feature extraction module with canny edge detection, Gabor filtering, and open operation layers for improved detection in infrared imagery. The tracker's feature processing is further optimized using the learned arrangements of three patch codes descriptor and locality‐sensitive hashing, showcasing the pivotal role of image processing in enhanced traffic surveillance in infrared scenes. Infrared object detection and tracking in dense urban traffic remain a challenge due to factors such as low contrast, small intra‐class differences, and frequent false positives and negatives. To overcome these, the authors introduce YOLO‐IR, an algorithm based on the enhanced YOLOv8s, and YOLO‐DeepOC‐IR, a comprehensive infrared multi‐object tracking method for urban traffic, integrating both detection and tracking. During preprocessing, three infrared image enhancement techniques, local contrast multi‐scale enhancement, non‐local means, and contrast limited adaptive histogram equalization, are applied for better reliability in dense scenes. To further improve the performance, the original YOLOv8s backbone is replaced with MobileVITv3 to enhance detection accuracy and robustness. This infrared feature extraction module, incorporated into the detector, combines canny edge detection, Gabor filtering, and open operation layers, significantly boosting object detection in infrared imagery. The tracker's feature processing capabilities are improved using the learned arrangements of three patch codes descriptor and locality‐sensitive hashing for feature extraction and matching. Experimental results on FLIR ADAS v2 and InfiRay datasets indicate superior performance of this method, achieving 78.6% mAP and 151.1 FPS in detection, and up to 80.8% moving object tracking accuracy, 78.6% identification F1 score, and 62.1% higher order tracking accuracy in multi‐object tracking.

Monitoring-Based Traffic Participant Detection in Urban Mixed Traffic: A Novel Dataset and A Tailored Detector

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Real-Time Monitoring Method for Traffic Surveillance Scenarios Based on Enhanced YOLOv7

TLDM: An Enhanced Traffic Light Detection Model Based on YOLOv5

Traffic Scene Parsing through the TSP6K Dataset

UR-YOLO: an urban road small object detection algorithm

A Multi-Scale Traffic Object Detection Algorithm for Road Scenes Based on Improved YOLOv5

Improved Real-Time Traffic Obstacle Detection and Classification Method Applied in Intelligent and Connected Vehicles in Mixed Traffic Environment

TJU-DHD: A Diverse High-Resolution Dataset for Object Detection

High-precision real-time autonomous driving target detection based on YOLOv8

A Small-Scale Object Detection Algorithm in Intelligent Transportation Scenarios

An object detection method for the work of an unmanned sweeper in a noisy environment on an improved YOLO algorithm

Infrared multi‐target detection and tracking in dense urban traffic scenes

DoTA: Unsupervised Detection of Traffic Anomaly in Driving Videos

A Multi-object Detection Method Based on Connected Vehicles

Yolo-3DMM for Simultaneous Multiple Object Detection and Tracking in Traffic Scenarios

PDT-YOLO: A Roadside Object-Detection Algorithm for Multiscale and Occluded Targets

Improving real-time object detection in Internet-of-Things smart city traffic with YOLOv8-DSAF method

DAN-YOLO: A Lightweight and Accurate Object Detector Using Dilated Aggregation Network for Autonomous Driving

TRD-YOLO: A Real-Time, High-Performance Small Traffic Sign Detection Algorithm