Abstract:Small object detection is one of the difficulties in the development of computer vision, especially in the case of complex image backgrounds, and the accuracy of small object detection still needs to be improved. In this article, we present a small object detection network based on YOLOv4, which solves some obstacles that hinder the performance of traditional methods in small object detection tasks in complex road environments, such as few effective features, the influence of image noise, and occlusion by large objects, and improves the detection of small objects in complex background situations such as drone aerial survey images. The improved network architecture reduces the computation and GPU memory consumption of the network by including the cross-stage partial network (CSPNet) structure into the spatial pyramid pool (SPP) structure in the YOLOv4 network and convolutional layers after concatenation operation. Secondly, the accuracy of the model on the small object detection task is improved by adding a more suitable small object detection head and removing one used for large object detection. Then, a new branch is added to extract feature information at a shallow location in the backbone part, and the feature information extracted from this branch is fused in the neck part to enrich the small object location information extracted by the model; when fusing feature information from different levels in the backbone, the fusion weight of useful information is increased by adding a weighting mechanism to improve detection performance at each scale. Finally, a coordinated attention (CA) module is embedded at a suitable location in the neck part, which enables the model to focus on spatial location relationships and inter-channel relationships and enhances feature representation capability. The proposed model has been tested to detect 10 different target objects in aerial images from drones and five different road traffic signal signs in images taken from vehicles in a complex road environment. The detection speed of the model meets the criteria of real-time detection, the model has better performance in terms of accuracy compared to the existing state-of-the-art detection models, and the model has only 44M parameters. On the drone aerial photography dataset, the average accuracy of YOLOv4 and YOLOv5L is 42.79% and 42.10%, respectively, while our model achieves an average accuracy (mAP) of 52.76%; on the urban road traffic light dataset, the proposed model achieves an average accuracy of 96.98%, which is also better than YOLOv4 (95.32%), YOLOv5L (94.79%) and other advanced models. The current work provides an efficient method for small object detection in complex road environments, which can be extended to scenarios involving small object detection, such as drone cruising and autonomous driving.

Virtual Sample Generation Technology for Object Detection with Few-Shot of Workpieces

Virtual Sample Generation Methods and Application in Few-Shot Object Detection for Industrial Scenarios

Detect Everything with Few Examples

Virtual sample generation for small sample learning: A survey, recent developments and future prospects

A Deep Meta-Metric Learning Method for Few-Shot Weld Seam Visual Detection

Small-scale defect detection in industrial environment based on lightweight deep learning network

Novel virtual sample generation using conditional GAN for developing soft sensor with small data

Real-time tool detection in smart manufacturing using You-Only-Look-Once (YOLO)v5

Innovative Research on Small Object Detection and Recognition in Remote Sensing Images Using YOLOv5

Training and Testing Object Detectors with Virtual Images

Object Detection Based on Deep Learning of Small Samples

Few-Shot Detection of Surface Roughness of Workpieces Processed by Different Machining Techniques

Few-shot semantic segmentation in complex industrial components

IoT-Enabled Few-Shot Image Generation for Power Scene Defect Detection Based on Self-Attention and Global–Local Fusion

A novel algorithm for small object detection based on YOLOv4

Small Object Few-shot Segmentation for Vision-based Industrial Inspection

Novel Virtual Sample Generation Using Target-Relevant Autoencoder for Small Data-Based Soft Sensor

A Machine Vision-based Realtime Anomaly Detection Method for Industrial Products Using Deep Learning

Yolo-sd: simulated feature fusion for few-shot industrial defect detection based on YOLOv8 and stable diffusion

Enhanced YOLOv5s-Based Algorithm for Industrial Part Detection

A Method for Target Detection Based on Synthetic Samples of Digital Twins