Abstract:Pruning is a time-consuming and labor-intensive practice for managing of dormant jujube orchards, in which dormant pruning is still mainly dependent on manual operation. Automated pruning using a robotic platform could be a better solution to overcome the skilled labor shortage and increased labor costs. With the development of dwarf and dense planting of jujube trees, the tree architectures are suitable for robotic pruning. This study concentrated on the detection and identification of pruning branches, which was a critical step for automating pruning operations. The method in this study mainly consisted of three steps: first, present a vision system based on two synchronous consumer-level RGB-D cameras to obtain the high-quality 3D point cloud in filed; second, propose the reconstruction pipeline for the desired three-dimensional model (basically a complete 3D model) using only two perspectives; and third, automatically segment the trunks and branches based on deep learning method (SPGNet), and then apply the DBSCAN clustering algorithm for estimating branch counts of jujube trees. For the reconstruction of jujube tree, registration errors II (0 degrees-180 degrees) were greater than errors I (0 degrees-55 degrees), and registration errors I (0 degrees-55 degrees) were less than 1 mm under different light conditions. Experimental results demonstrated that trunks and branches were segmented successfully with class accuracies of 0.93 and 0.84, and another metric intersection-over-union (IoU) was 0.85 and 0.76, respectively; the coefficient of determination (R2) values analyzed between the ground-truth and cluster results were 0.83, 0.88, and 0.89 in sunny, cloudy, and night conditions, respectively. These results showed that the proposed method for detecting branches could be utilized to generate substantial information, such as the diameter length and diameter of the branch, which was critical for the automated dormant pruning of jujube trees in the future orchard field.

Using deep learning for pruning region detection and plant organ segmentation in dormant spur-pruned grapevines

Enhancing Grapevine Node Detection to Support Pruning Automation: Leveraging State-of-the-Art YOLO Detection Models for 2D Image Analysis

Towards automated grape vine pruning: Learning by example using recurrent graph neural networks

Towards practical 2D grapevine bud detection with fully convolutional networks

An Adaptive Approach for Automated Grapevine Phenotyping using VGG-based Convolutional Neural Networks

3D Skeletonization of Complex Grapevines for Robotic Pruning

Fruit Detection and Pose Estimation for Grape Cluster-Harvesting Robot Using Binocular Imagery Based on Deep Neural Networks

Detection of Single Grapevine Berries in Images Using Fully Convolutional Neural Networks

Counting of Grapevine Berries in Images via Semantic Segmentation using Convolutional Neural Networks

A Robot System for Pruning Grape Vines

Rapid Grapevine Health Diagnosis Based on Digital Imaging and Deep Learning

Semi-supervised deep learning and low-cost cameras for the semantic segmentation of natural images in viticulture

Surgical fine-tuning for Grape Bunch Segmentation under Visual Domain Shifts

Predicting Grapevine Physiological Parameters Using Hyperspectral Remote Sensing Integrated with Hybrid Convolutional Neural Network and Ensemble Stacked Regression

A Deep-Learning-Based Real-Time Detector for Grape Leaf Diseases Using Improved Convolutional Neural Networks

Detection and Reconstruction of Passion Fruit Branches via CNN and Bidirectional Sector Search

Reproducible Pruning System on Dynamic Natural Plants for Field Agricultural Robots

Research on Key Algorithm for Sichuan Pepper Pruning Based on Improved Mask R-CNN

Grape detection with convolutional neural networks

A real-time table grape detection method based on improved YOLOv4-tiny network in complex background

Automatic Branch Detection of Jujube Trees Based on 3D Reconstruction for Dormant Pruning Using the Deep Learning-Based Method