YOLOv10: Real-Time End-to-End Object Detection

Ao Wang,Hui Chen,Lihao Liu,Kai Chen,Zijia Lin,Jungong Han,Guiguang Ding

2024-10-30

Abstract:Over the past years, YOLOs have emerged as the predominant paradigm in the field of real-time object detection owing to their effective balance between computational cost and detection performance. Researchers have explored the architectural designs, optimization objectives, data augmentation strategies, and others for YOLOs, achieving notable progress. However, the reliance on the non-maximum suppression (NMS) for post-processing hampers the end-to-end deployment of YOLOs and adversely impacts the inference latency. Besides, the design of various components in YOLOs lacks the comprehensive and thorough inspection, resulting in noticeable computational redundancy and limiting the model's capability. It renders the suboptimal efficiency, along with considerable potential for performance improvements. In this work, we aim to further advance the performance-efficiency boundary of YOLOs from both the post-processing and model architecture. To this end, we first present the consistent dual assignments for NMS-free training of YOLOs, which brings competitive performance and low inference latency simultaneously. Moreover, we introduce the holistic efficiency-accuracy driven model design strategy for YOLOs. We comprehensively optimize various components of YOLOs from both efficiency and accuracy perspectives, which greatly reduces the computational overhead and enhances the capability. The outcome of our effort is a new generation of YOLO series for real-time end-to-end object detection, dubbed YOLOv10. Extensive experiments show that YOLOv10 achieves state-of-the-art performance and efficiency across various model scales. For example, our YOLOv10-S is 1.8$\times$ faster than RT-DETR-R18 under the similar AP on COCO, meanwhile enjoying 2.8$\times$ smaller number of parameters and FLOPs. Compared with YOLOv9-C, YOLOv10-B has 46\% less latency and 25\% fewer parameters for the same performance.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The main problem this paper attempts to address is the deficiencies in the post-processing and model architecture design of existing YOLO series object detection models. Specifically:

1. **Post-processing dependency on Non-Maximum Suppression (NMS)**: Existing YOLO models rely on NMS for post-processing during inference, which not only increases inference latency but also makes performance sensitive to NMS hyperparameters, affecting the efficiency of end-to-end deployment.
2. **Computational redundancy in model architecture**: Various components of YOLO models lack comprehensive and thorough optimization, leading to significant computational redundancy, which limits the model's capability and efficiency.

To address these issues, the authors propose the following two main methods:

1. **Consistent Dual Assignment Strategy for NMS-free Training**:
- **Dual Label Assignment**: By introducing a one-to-one head combined with the original many-to-one head, using a consistent matching metric, it retains rich supervision signals while eliminating the need for NMS during inference.
- **Consistent Matching Metric**: A unified matching metric method is designed to ensure that the one-to-one and many-to-one heads can be consistently optimized during training, thereby improving performance and efficiency.

2. **Holistic Efficient and Accurate Model Design Strategy**:
- **Lightweight Classification Head**: By adopting depthwise separable convolutions and 1x1 convolutions, the computational overhead of the classification head is reduced without significantly affecting model performance.
- **Spatial-Channel Decoupled Downsampling**: Separating spatial downsampling and channel transformation reduces computational cost and parameter count while retaining more information.
- **Rank-based Block Design**: Utilizing intrinsic rank analysis to assess the redundancy at each stage, an adaptive compact block design strategy is proposed, dynamically adjusting block design according to the model's intrinsic characteristics to achieve optimal efficiency and performance.

Through these methods, the authors successfully developed a new generation of YOLO series models—YOLOv10, which demonstrates outstanding performance and efficiency across various model scales. Experimental results show that YOLOv10 significantly outperforms existing state-of-the-art models on the COCO dataset.