Abstract:With the rapid development of remote sensing with small, lightweight unmanned aerial vehicles (UAV), efficient and accurate crop spike counting, and yield estimation methods based on deep learning (DL) methods have begun to emerge, greatly reducing labor costs and enabling fast and accurate counting of sorghum spikes. However, there has not been a systematic, comprehensive evaluation of their applicability in cereal crop spike identification in UAV images, especially in sorghum head counting. To this end, this paper conducts a comparative study of the performance of three common DL algorithms, EfficientDet, Single Shot MultiBox Detector (SSD), and You Only Look Once (YOLOv4), for sorghum head detection based on lightweight UAV remote sensing data. The paper explores the effects of overlap ratio, confidence, and intersection over union (IoU) parameters, using the evaluation metrics of precision P, recall R, average precision AP, F1 score, computational efficiency, and the number of detected positive/negative samples (Objects detected consistent/inconsistent with real samples). The experiment results show the following. (1) The detection results of the three methods under dense coverage conditions were better than those under medium and sparse conditions. YOLOv4 had the most accurate detection under different coverage conditions; on the contrary, EfficientDet was the worst. While SSD obtained better detection results under dense conditions, the number of over-detections was larger. (2) It was concluded that although EfficientDet had a good positive sample detection rate, it detected the fewest samples, had the smallest R and F1, and its actual precision was poor, while its training time, although medium, had the lowest detection efficiency, and the detection time per image was 2.82-times that of SSD. SSD had medium values for P, AP, and the number of detected samples, but had the highest training and detection efficiency. YOLOv4 detected the largest number of positive samples, and its values for R, AP, and F1 were the highest among the three methods. Although the training time was the slowest, the detection efficiency was better than EfficientDet. (3) With an increase in the overlap ratios, both positive and negative samples tended to increase, and when the threshold value was 0.3, all three methods had better detection results. With an increase in the confidence value, the number of positive and negative samples significantly decreased, and when the threshold value was 0.3, it balanced the numbers for sample detection and detection accuracy. An increase in IoU was accompanied by a gradual decrease in the number of positive samples and a gradual increase in the number of negative samples. When the threshold value was 0.3, better detection was achieved. The research findings can provide a methodological basis for accurately detecting and counting sorghum heads using UAV.

Advancing precision agriculture: The potential of deep learning for cereal plant head detection

A deep learning-based algorithm for crop Disease identification positioning using computer vision

Deep learning techniques for in-crop weed recognition in large-scale grain production systems: a review

A Review of Deep Learning in Multiscale Agricultural Sensing

Recent Advancements in Fruit Detection and Classification Using Deep Learning Techniques

Active learning with point supervision for cost-effective panicle detection in cereal crops

Deep Learning-Based Weed–Crop Recognition for Smart Agricultural Equipment: A Review

Deep learning approaches for object recognition in plant diseases: a review

Deep learning in cropland field identification: A review

Applied Deep Learning-Based Crop Yield Prediction: A Systematic Analysis of Current Developments and Potential Challenges

Automated Counting of Rice Panicle by Applying Deep Learning Model to Images from Unmanned Aerial Vehicle Platform

Deep learning-based rice pest detection research

Deep learning techniques to classify agricultural crops through UAV imagery: a review

Comparison of Deep Learning Methods for Detecting and Counting Sorghum Heads in UAV Imagery

Crop-saving with AI: latest trends in deep learning techniques for plant pathology

Application of Color Featuring and Deep Learning in Maize Plant Detection

A Method for Wheat Head Detection Based on Yolov4

A Survey on Deep Learning in Crop Planting

Image-Based Sorghum Head Counting When You Only Look Once

Design of a Crop Disease and Pest Identification System Based on Deep Learning

Deep Learning-based Agricultural Pest and Disease Recognition