Abstract:Rapid and precise 3D organ segmentation is crucial for the automatic extraction of phenotypic traits, forming a fundamental prerequisite for intelligent plant breeding. The advancement of deep learning technology has replaced labor-intensive manual measurements and traditional computer vision methods, which are sensitive to parameters, in phenotypic trait extraction. However, current larger network structures not only require extensive point cloud data but also consume substantial computational resources, rendering them unsuitable for agricultural tasks with limited plant samples. Therefore, this study developed a lightweight 3D deep learning network (PEPNet) that achieves precise plant organ segmentation and stem-leaf phenotypic trait extraction. The adopted simple-but-effective network architecture and innovative modern operations, including a high-dimensional feature mapping strategy for preprocessing input points, a local feature extraction module based on inverted residual bottleneck block, and a cost-free attention block for spatial feature fusion, effectively implement multiscale hierarchies and adaptively reduce computational overheads. Experimental results from cotton stem-leaf segmentation demonstrated that PEPNet not only presented approximately 2 x faster inference speed (9.59 ms) and throughput (146.32 plants per second) but also achieved competitive segmentation performance compared to other six state-of-the-art deep learning networks, namely PointNet++, DGCNN, CurveNet, Point Cloud Transformer, PointMLP, and SPoTr, achieving 95.99 %, 94.66 %, 95.32 %, and 91.31 % in Precision, Recall, F1-score, and mIoU, respectively. In transferability experiments with tomato and soybean plants, PEPNet achieved almost all the best metrics and significantly outperformed the second-best model (CurveNet). Furthermore, ablation study verified the optimal trade-off between efficiency and accuracy in this network. Any modifications to the modules could potentially disrupt the optimal trade-off. This work could contribute to reducing computational resources and annotation costs for applying segmentation methods in high-throughput phenotyping tasks.

LFPNet: Lightweight Network on Real Point Sets for Fruit Classification and Segmentation

A Novel Adaptive Zone-fusion Network for Precise Waxberry Semantic Segmentation to Improve Automated-Harvesting in a Complex Orchard Environment

Fruit Detection from Digital Images Using CenterNet

DLNet: Accurate segmentation of green fruit in obscured environments

BFP Net: Balanced Feature Pyramid Network for Small Apple Detection in Complex Orchard Environment

FF-Net: Feature-Fusion-Based Network for Semantic Segmentation of 3D Plant Point Cloud

Transfer Learning Based Fruits Image Segmentation for Fruit-Picking Robots

A novel green apple segmentation algorithm based on ensemble U-Net under complex orchard environment

Prototype Network for Predicting Occluded Picking Position Based on Lychee Phenotypic Features

DFSNet: A 3D Point Cloud Segmentation Network toward Trees Detection in an Orchard Scene

Lightweight and efficient deep learning models for fruit detection in orchards

Using color and 3D geometry features to segment fruit point cloud and improve fruit recognition accuracy

YOLOF-Snake: An Efficient Segmentation Model for Green Object Fruit

Fruit Image Classification Based on MobileNetV2 with Transfer Learning Technique

CF-PRNet: Coarse-to-Fine Prototype Refining Network for Point Cloud Completion and Reconstruction

Polar-Net: Green fruit instance segmentation in complex orchard environment

Fruit Stalk Recognition and Picking Point Localization of New Plums Based on Improved DeepLabv3+

Stem–Leaf Segmentation and Phenotypic Trait Extraction of Individual Plant Using a Precise and Efficient Point Cloud Segmentation Network

3D Point Cloud Instance Segmentation of Lettuce Based on PartNet

FF3D: A Rapid and Accurate 3D Fruit Detector for Robotic Harvesting

Fruit Detection Research Based on Near-Infrared Spectroscopy and Lightweight Neural Network