Abstract:With the rapid growth in demand for security surveillance, assisted driving, and remote sensing, object detection networks with robust environmental perception and high detection accuracy have become a research focus. However, single-modality image detection technologies face limitations in environmental adaptability, often affected by factors such as lighting conditions, fog, rain, and obstacles like vegetation, leading to information loss and reduced detection accuracy. We propose an object detection network that integrates features from visible light and infrared images—IV-YOLO—to address these challenges. This network is based on YOLOv8 (You Only Look Once v8) and employs a dual-branch fusion structure that leverages the complementary features of infrared and visible light images for target detection. We designed a Bidirectional Pyramid Feature Fusion structure (Bi-Fusion) to effectively integrate multimodal features, reducing errors from feature redundancy and extracting fine-grained features for small object detection. Additionally, we developed a Shuffle-SPP structure that combines channel and spatial attention to enhance the focus on deep features and extract richer information through upsampling. Regarding model optimization, we designed a loss function tailored for multi-scale object detection, accelerating the convergence speed of the network during training. Compared with the current state-of-the-art Dual-YOLO model, IV-YOLO achieves mAP improvements of 2.8%, 1.1%, and 2.2% on the Drone Vehicle, FLIR, and KAIST datasets, respectively. On the Drone Vehicle and FLIR datasets, IV-YOLO has a parameter count of 4.31 M and achieves a frame rate of 203.2 fps, significantly outperforming YOLOv8n (5.92 M parameters, 188.6 fps on the Drone Vehicle dataset) and YOLO-FIR (7.1 M parameters, 83.3 fps on the FLIR dataset), which had previously achieved the best performance on these datasets. This demonstrates that IV-YOLO achieves higher real-time detection performance while maintaining lower parameter complexity, making it highly promising for applications in autonomous driving, public safety, and beyond.

ComS-YOLO: a combinational and sparse network for detecting vehicles in aerial thermal infrared images

A Vehicle Detection Method Based on an Improved U-YOLO Network for High-Resolution Remote-Sensing Images

LFIR-YOLO: Lightweight Model for Infrared Vehicle and Pedestrian Detection

Vehicle Target Detection Method for Wide-Area SAR Images Based on Coarse-Grained Judgment and Fine-Grained Detection

Real-Time Vehicle Detection from UAV Aerial Images Based on Improved YOLOv5

Vehicle Detection in Aerial Images Using Modified YOLO.

YOLO-IR-Free: An Improved Algorithm for Real-Time Detection of Vehicles in Infrared Images

A lightweight vehicles detection network model based on YOLOv5

Special Vehicle Detection from UAV Perspective via YOLO-GNS Based Deep Learning Network

IV-YOLO: A Lightweight Dual-Branch Object Detection Network

Multiple Mechanisms to Strengthen the Ability of YOLOv5s for Real-Time Identification of Vehicle Type

YOLO-MPAM: Efficient real-time neural networks based on multi-channel feature fusion

Accurate Detection and Tracking of Small-Scale Vehicles in High-Altitude Unmanned Aerial Vehicle Bird-View Imagery

LittleYOLO-SPP: A Delicate Real-Time Vehicle Detection Algorithm

Dual-YOLO Architecture from Infrared and Visible Images for Object Detection

SatDetX-YOLO: A More Accurate Method for Vehicle Target Detection in Satellite Remote Sensing Imagery

Research on Deep Learning Automatic Vehicle Recognition Algorithm Based on RES-YOLO Model

PVswin-YOLOv8s: UAV-Based Pedestrian and Vehicle Detection for Traffic Management in Smart Cities Using Improved YOLOv8

Information Extraction of the Vehicle from High-Resolution Remote Sensing Image Based on Convolution Neural Network

MME-YOLO: Multi-Sensor Multi-Level Enhanced YOLO for Robust Vehicle Detection in Traffic Surveillance