Abstract:Small object detection is one of the difficulties in the development of computer vision, especially in the case of complex image backgrounds, and the accuracy of small object detection still needs to be improved. In this article, we present a small object detection network based on YOLOv4, which solves some obstacles that hinder the performance of traditional methods in small object detection tasks in complex road environments, such as few effective features, the influence of image noise, and occlusion by large objects, and improves the detection of small objects in complex background situations such as drone aerial survey images. The improved network architecture reduces the computation and GPU memory consumption of the network by including the cross-stage partial network (CSPNet) structure into the spatial pyramid pool (SPP) structure in the YOLOv4 network and convolutional layers after concatenation operation. Secondly, the accuracy of the model on the small object detection task is improved by adding a more suitable small object detection head and removing one used for large object detection. Then, a new branch is added to extract feature information at a shallow location in the backbone part, and the feature information extracted from this branch is fused in the neck part to enrich the small object location information extracted by the model; when fusing feature information from different levels in the backbone, the fusion weight of useful information is increased by adding a weighting mechanism to improve detection performance at each scale. Finally, a coordinated attention (CA) module is embedded at a suitable location in the neck part, which enables the model to focus on spatial location relationships and inter-channel relationships and enhances feature representation capability. The proposed model has been tested to detect 10 different target objects in aerial images from drones and five different road traffic signal signs in images taken from vehicles in a complex road environment. The detection speed of the model meets the criteria of real-time detection, the model has better performance in terms of accuracy compared to the existing state-of-the-art detection models, and the model has only 44M parameters. On the drone aerial photography dataset, the average accuracy of YOLOv4 and YOLOv5L is 42.79% and 42.10%, respectively, while our model achieves an average accuracy (mAP) of 52.76%; on the urban road traffic light dataset, the proposed model achieves an average accuracy of 96.98%, which is also better than YOLOv4 (95.32%), YOLOv5L (94.79%) and other advanced models. The current work provides an efficient method for small object detection in complex road environments, which can be extended to scenarios involving small object detection, such as drone cruising and autonomous driving.

I-YOLO: a novel single-stage framework for small object detection

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

FFCA-YOLO for Small Object Detection in Remote Sensing Images

MC-YOLOv5: A Multi-Class Small Object Detection Algorithm

An advanced YOLOv3 method for small object detection

AIE-YOLO: Auxiliary Information Enhanced YOLO for Small Object Detection

MCF-YOLOv5: A Small Target Detection Algorithm Based on Multi-Scale Feature Fusion Improved YOLOv5

RS-YOLO: A YOLO-Based Method for Small Object Detection in Remote Sensing

MSF-YOLO: A multi-scale features fusion-based method for small object detection

ESL-YOLO: Small Object Detection with Effective Feature Enhancement and Spatial-Context-Guided Fusion Network for Remote Sensing

An improved algorithm for small object detection based on YOLO v4 and multi-scale contextual information

A novel algorithm for small object detection based on YOLOv4

YOLO-TLA: An Efficient and Lightweight Small Object Detection Model based on YOLOv5

YOLO‐RSFM: An efficient road small object detection method

YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications

M2YOLOF: Based on effective receptive fields and multiple-in-single-out encoder for object detection

DC-YOLOv8: Small-Size Object Detection Algorithm Based on Camera Sensor

Efficient-Lightweight YOLO: Improving Small Object Detection in YOLO for Aerial Images

YOLO-Z: Improving small object detection in YOLOv5 for autonomous vehicles

A YOLO-NL object detector for real-time detection