Abstract:This study presents YOLO‐IR and YOLO‐DeepOC‐IR, innovative methods for infrared object detection and tracking in dense urban traffic, emphasizing image processing techniques. The work employs infrared image enhancement techniques (local contrast multi‐scale enhancement, non‐local means, and contrast limited adaptive histogram equalization), a MobileVITv3 backbone, and a multi‐layer feature extraction module with canny edge detection, Gabor filtering, and open operation layers for improved detection in infrared imagery. The tracker's feature processing is further optimized using the learned arrangements of three patch codes descriptor and locality‐sensitive hashing, showcasing the pivotal role of image processing in enhanced traffic surveillance in infrared scenes. Infrared object detection and tracking in dense urban traffic remain a challenge due to factors such as low contrast, small intra‐class differences, and frequent false positives and negatives. To overcome these, the authors introduce YOLO‐IR, an algorithm based on the enhanced YOLOv8s, and YOLO‐DeepOC‐IR, a comprehensive infrared multi‐object tracking method for urban traffic, integrating both detection and tracking. During preprocessing, three infrared image enhancement techniques, local contrast multi‐scale enhancement, non‐local means, and contrast limited adaptive histogram equalization, are applied for better reliability in dense scenes. To further improve the performance, the original YOLOv8s backbone is replaced with MobileVITv3 to enhance detection accuracy and robustness. This infrared feature extraction module, incorporated into the detector, combines canny edge detection, Gabor filtering, and open operation layers, significantly boosting object detection in infrared imagery. The tracker's feature processing capabilities are improved using the learned arrangements of three patch codes descriptor and locality‐sensitive hashing for feature extraction and matching. Experimental results on FLIR ADAS v2 and InfiRay datasets indicate superior performance of this method, achieving 78.6% mAP and 151.1 FPS in detection, and up to 80.8% moving object tracking accuracy, 78.6% identification F1 score, and 62.1% higher order tracking accuracy in multi‐object tracking.

TIRDet: Mono-Modality Thermal InfraRed Object Detection Based on Prior Thermal-To-Visible Translation

A Fourier-Transform-Based Framework with Asymptotic Attention for Mobile Thermal InfraRed Object Detection

Modality-transfer Generative Adversarial Network and Dual-Level Unified Latent Representation for Visible Thermal Person Re-Identification

Visible-Thermal Image Object Detection via the Combination of Illumination Conditions and Temperature Information

Unsupervised Cross-Modal Distillation for Thermal Infrared Tracking

Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detection

TFDet: Target-Aware Fusion for RGB-T Pedestrian Detection

DPDETR: Decoupled Position Detection Transformer for Infrared-Visible Object Detection

Borrow from Anywhere: Pseudo Multi-modal Object Detection in Thermal Imagery

Learning Cross-Modality High-Resolution Representation for Thermal Small-Object Detection

Learning Dual-Level Deep Representation for Thermal Infrared Tracking

Multi-Level Fusion for Robust RGBT Tracking via Enhanced Thermal Representation

M2FNet: Multi-modal Fusion Network for Object Detection from Visible and Thermal Infrared Images

Improving RGB-infrared object detection with cascade alignment-guided transformer

Enhancing Object Detection in Adverse Conditions using Thermal Imaging

Reversible Modal Conversion Model for Thermal Infrared Tracking

C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detection

Object Detection in Multispectral Remote Sensing Images Based on Cross-Modal Cross-Attention

Infrared multi‐target detection and tracking in dense urban traffic scenes

Thermal Infrared Image Colorization for Nighttime Driving Scenes With Top-Down Guided Attention

A robust infrared and visible image fusion framework via multi-receptive-field attention and color visual perception