Abstract:The leaf phenotypic traits of plants have a significant impact on the efficiency of canopy photosynthesis. However, traditional methods such as destructive sampling will hinder the continuous monitoring of plant growth, while manual measurements in the field are both time-consuming and laborious. Nondestructive and accurate measurements of leaf phenotypic parameters can be achieved through the use of 3D canopy models and object segmentation techniques. This paper proposed an automatic branch–leaf segmentation pipeline based on lidar point cloud and conducted the automatic measurement of leaf inclination angle, length, width, and area, using pear canopy as an example. Firstly, a three-dimensional model using a lidar point cloud was established using SCENE software. Next, 305 pear tree branches were manually divided into branch points and leaf points, and 45 branch samples were selected as test data. Leaf points were further marked as 572 leaf instances on these test data. The PointNet++ model was used, with 260 point clouds as training input to carry out semantic segmentation of branches and leaves. Using the leaf point clouds in the test dataset as input, a single leaf instance was extracted by means of a mean shift clustering algorithm. Finally, based on the single leaf point cloud, the leaf inclination angle was calculated by plane fitting, while the leaf length, width, and area were calculated by midrib fitting and triangulation. The semantic segmentation model was tested on 45 branches, with a mean Precisionsem, mean Recallsem, mean F1-score, and mean Intersection over Union (IoU) of branches and leaves of 0.93, 0.94, 0.93, and 0.88, respectively. For single leaf extraction, the Precisionins, Recallins, and mean coverage (mCoV) were 0.89, 0.92, and 0.87, respectively. Using the proposed method, the estimated leaf inclination, length, width, and area of pear leaves showed a high correlation with manual measurements, with correlation coefficients of 0.94 (root mean squared error: 4.44°), 0.94 (root mean squared error: 0.43 cm), 0.91 (root mean squared error: 0.39 cm), and 0.93 (root mean squared error: 5.21 cm2), respectively. These results demonstrate that the method can automatically and accurately measure the phenotypic parameters of pear leaves. This has great significance for monitoring pear tree growth, simulating canopy photosynthesis, and optimizing orchard management.

An Active Structured Light 3D Point Cloud Measurement for Orange Shape Based On Adaptive Co-Opposite-Direction Slicing Method

Research on 3D Reconstruction Algorithm of Citrus Seedlings Based on Multi-View Geometry

Irregular Object Measurement Method Based on Improved Adaptive Slicing Method

Enhancing Fruit SSC Detection Accuracy Via a Light Attenuation Theory-Based Correction Method to Mitigate Measurement Orientation Variability

Dynamic Slicing and Reconstruction Algorithm for Precise Canopy Volume Estimation in 3D Citrus Tree Point Clouds

Automatic Branch–Leaf Segmentation and Leaf Phenotypic Parameter Estimation of Pear Trees Based on Three-Dimensional Point Clouds

Three-Dimensional Morphological Measurement Method for a Fruit Tree Canopy Based on Kinect Sensor Self-Calibration

Deep-learning-based in-field citrus fruit detection and tracking

A novel algorithm for segmenting fruit from unorganized point clouds

On-line detection of orange soluble solid content using visible and near infrared transmission measurements

Mobile LiDAR Scanning System Combined with Canopy Morphology Extracting Methods for Tree Crown Parameters Evaluation in Orchards

Citrus Canopy Volume Estimation Using UAV Oblique Photography

A Novel Method For Extracting Skeleton Of Fruit Tree From 3d Point Clouds

Automatic Detection of Common Surface Defects on Oranges Using Combined Lighting Transform and Image Ratio Methods

A pipeline for multiple orange detection and tracking with 3-D fruit relocalization and neural-net based yield regression in commercial citrus orchards

Canopy Volume Measurement of Fruit Trees Using Robotic Platform Loaded LiDAR Data

A Method for Predicting Canopy Light Distribution in Cherry Trees Based on Fused Point Cloud Data

Fruit Mapping with Shape Completion for Autonomous Crop Monitoring

Occluded Apple Fruit Detection and Localization with a Frustum-Based Point-Cloud-Processing Approach for Robotic Harvesting

Detection and localization of citrus fruit based on improved You Only Look Once v5s and binocular vision in the orchard

A Method for Organs Classification and Fruit Counting on Pomegranate Trees Based on Multi-Features Fusion and Support Vector Machine by 3D Point Cloud