Abstract:Mechanical weed management is a drudging task that requires manpower and has risks when conducted within rows of orchards. However, intrarow weeding must still be conducted by manual labor due to the restricted movements of riding mowers within the rows of orchards due to their confined structures with nets and poles. However, autonomous robotic weeders still face challenges identifying uncut weeds due to the obstruction of Global Navigation Satellite System (GNSS) signals caused by poles and tree canopies. A properly designed intelligent vision system would have the potential to achieve the desired outcome by utilizing an autonomous weeder to perform operations in uncut sections. Therefore, the objective of this study is to develop a vision module using a custom-trained dataset on YOLO instance segmentation algorithms to support autonomous robotic weeders in recognizing uncut weeds and obstacles (i.e., fruit tree trunks, fixed poles) within rows. The training dataset was acquired from a pear orchard located at the Tsukuba Plant Innovation Research Center (T-PIRC) at the University of Tsukuba, Japan. In total, 5000 images were preprocessed and labeled for training and testing using YOLO models. Four versions of edge-device-dedicated YOLO instance segmentation were utilized in this research—YOLOv5n-seg, YOLOv5s-seg, YOLOv8n-seg, and YOLOv8s-seg—for real-time application with an autonomous weeder. A comparison study was conducted to evaluate all YOLO models in terms of detection accuracy, model complexity, and inference speed. The smaller YOLOv5-based and YOLOv8-based models were found to be more efficient than the larger models, and YOLOv8n-seg was selected as the vision module for the autonomous weeder. In the evaluation process, YOLOv8n-seg had better segmentation accuracy than YOLOv5n-seg, while the latter had the fastest inference time. The performance of YOLOv8n-seg was also acceptable when it was deployed on a resource-constrained device that is appropriate for robotic weeders. The results indicated that the proposed deep learning-based detection accuracy and inference speed can be used for object recognition via edge devices for robotic operation during intrarow weeding operations in orchards.

Development of a small scale cartesian coordinate farming robot with deep learning based weed detection

Design of an Autonomous Agriculture Robot for Real Time Weed Detection using CNN

Autonomous diode laser weeding mobile robot in cotton field using deep learning, visual servoing and finite state machine

AI Driven Applications for Precision Weed Management in Agricultural Crops

Detecting Crops and Weeds in Fields Using YOLOv6 and Faster R-CNN Object Detection Models

Formation of a Lightweight, Deep Learning-Based Weed Detection System for a Commercial Autonomous Laser Weeding Robot

Revolutionizing Weed Detection in Agriculture through the Integration of IoT, Big Data, and Deep Learning with Robotic Technology

CNN based Synchronal recognition of Weeds in Farm Crops

Deep learning-based Crop Row Detection for Infield Navigation of Agri-Robots

Robust Guidance and Selective Spraying Based on Deep Learning for an Advanced Four-Wheeled Farming Robot

Neural Network Based Weeding Robot For Crop And Weed Discrimination

Autonomous smart farming system using FLANN-based feature matcher with robotic arm

Deep-CNN based Robotic Multi-Class Under-Canopy Weed Control in Precision Farming

Deep learning‐based crop row detection for infield navigation of agri‐robots

Deep learning based weed detection and target spraying robot system at seedling stage of cotton field

Intrarow Uncut Weed Detection Using You-Only-Look-Once Instance Segmentation for Orchard Plantations

A Low-cost Robot with Autonomous Recharge and Navigation for Weed Control in Fields with Narrow Row Spacing

Smart Farming and Surveillance using a Multipurpose Robot and Machine Learning

Deep Learning-Based Object Detection System for Identifying Weeds Using UAS Imagery

Towards deep learning based smart farming for intelligent weeds management in crops

Agricultural Robot-Centered Recognition of Early-Developmental Pest Stage Based on Deep Learning: A Case Study on Fall Armyworm (Spodoptera frugiperda)