Abstract:This study presents a comprehensive benchmark analysis of various YOLO (You Only Look Once) algorithms, from YOLOv3 to the newest addition. It represents the first research to comprehensively evaluate the performance of YOLO11, the latest addition to the YOLO family. It evaluates their performance on three diverse datasets: Traffic Signs (with varying object sizes), African Wildlife (with diverse aspect ratios and at least one instance of the object per image), and Ships and Vessels (with small-sized objects of a single class), ensuring a comprehensive assessment across datasets with distinct challenges. To ensure a robust evaluation, we employ a comprehensive set of metrics, including Precision, Recall, Mean Average Precision (mAP), Processing Time, GFLOPs count, and Model Size. Our analysis highlights the distinctive strengths and limitations of each YOLO version. For example: YOLOv9 demonstrates substantial accuracy but struggles with detecting small objects and efficiency whereas YOLOv10 exhibits relatively lower accuracy due to architectural choices that affect its performance in overlapping object detection but excels in speed and efficiency. Additionally, the YOLO11 family consistently shows superior performance in terms of accuracy, speed, computational efficiency, and model size. YOLO11m achieved a remarkable balance of accuracy and efficiency, scoring mAP50-95 scores of 0.795, 0.81, and 0.325 on the Traffic Signs, African Wildlife, and Ships datasets, respectively, while maintaining an average inference time of 2.4ms, a model size of 38.8Mb, and around 67.6 GFLOPs on average. These results provide critical insights for both industry and academia, facilitating the selection of the most suitable YOLO algorithm for diverse applications and guiding future enhancements.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to comprehensively evaluate the performance of the latest version of the YOLO series algorithm, YOLO11, and its predecessors on different datasets. Specifically, the research aims to: 1. **Provide a comprehensive benchmark analysis**: Conduct a detailed performance evaluation of each version from YOLOv3 to the latest YOLO11. This is the first study to comprehensively evaluate YOLO11. 2. **Evaluate performance on different datasets**: Use three datasets with different challenges (traffic signs, African wild animals, ships and vessels) to evaluate the performance of the YOLO algorithm, ensuring comprehensiveness and diversity of the evaluation. 3. **Adopt multi - dimensional evaluation metrics**: In addition to the commonly used Precision, Recall, and Mean Average Precision (mAP), also consider metrics such as processing time, GFLOPs (Giga - Floating - Point Operations per Second), and model size to comprehensively evaluate the advantages and disadvantages of each version. 4. **Reveal the characteristics and limitations of each version**: Through detailed analysis, highlight the unique advantages and limitations of each YOLO version. For example, YOLOv9 shows remarkable performance in accuracy but has problems in detecting small objects and efficiency, while YOLOv10 performs well in speed and efficiency but is insufficient in overlapping object detection. 5. **Provide practical guidance**: Through the performance evaluation of the YOLO11 family, especially the excellent balance between accuracy and efficiency of YOLO11m, provide key insights for the industry and academia to select the most suitable YOLO algorithm, and guide future research and improvement directions. In summary, through systematic benchmark tests, this paper aims to provide researchers and practitioners with in - depth understanding and practical suggestions regarding the performance of the YOLO series algorithms.

Evaluating the Evolution of YOLO (You Only Look Once) Models: A Comprehensive Benchmark Study of YOLO11 and Its Predecessors

YOLOv11: An Overview of the Key Architectural Enhancements

YOLOv5, YOLOv8 and YOLOv10: The Go-To Detectors for Real-time Vision

YOLOv10 to Its Genesis: A Decadal and Comprehensive Review of The You Only Look Once (YOLO) Series

YOLOv10: Real-Time End-to-End Object Detection

YOLOv11 Optimization for Efficient Resource Utilization

YOLOv8: A Novel Object Detection Algorithm with Enhanced Performance and Robustness

YOLOv10 to Its Genesis: A Decadal and Comprehensive Review of The You Only Look Once Series

A Comprehensive Review of YOLO: From YOLOv1 to YOLOv8 and Beyond

Overview of Research on Object Detection Based on YOLO

What is YOLOv6? A Deep Insight into the Object Detection Model

A review of the development of YOLO object detection algorithm

What is YOLOv9: An In-Depth Exploration of the Internal Features of the Next-Generation Object Detector

Performance Validation of Yolo Variants for Object Detection

A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS

YOLOv3: An Incremental Improvement

YOLOv1 to v8: Unveiling Each Variant–A Comprehensive Review of YOLO

Precision and Adaptability of YOLOv5 and YOLOv8 in Dynamic Robotic Environments

YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications

YOLO9000: Better, Faster, Stronger