Abstract:ABS T R A C T The accurate plant organ segmentation is crucial and challenging to the quantification of plant architecture and selection of plant ideotype. The popularity of point cloud data and deep learning methods make plant organ segmentation a feasible and cutting-edge research. However, current plant organ segmentation methods are specially designed for only one species or variety, and they rarely perform semantic segmentation (stems and leaves) and instance segmentation (individual leaf) simultaneously. This study innovates a dual-function deep learning neural network (PlantNet) to realize semantic segmentation and instance segmentation of two di-cotyledons and one monocotyledon from point clouds. The innovations of the PlantNet include a 3D Edge-Preserving Sampling (3DEPS) strategy for preprocessing input points, a Local Feature Extraction Operation (LFEO) module based on dynamic graph convolutions, and a semantic-instance Feature Fusion Module (FFM). The semantic segmentation results of tobacco, tomato, and sorghum in average Precision, Recall, F1-score, and IoU reached 92.49%, 92.04%, 92.13%, and 85.86%, respectively; and the instance segmentation results in the mean precision (mPrec), the mean recall (mRec), the mean coverage (mCov), and the mean weighted coverage (mWCov) reached 83.30%, 74.08%, 78.62%, and 84.38%, respectively. The PlantNet outperformed state-of-the-art deep learning networks including PointNet, PointNet++, SGPN, and ASIS, which achieved an average improvement of 5.56%, 3.58%, 4.78%, and 6.74% in Precision, Recall, F1-score, IoU on semantic segmentation, and an average improvement of 22.18%, 16.37%, 14.13%, and 13.35% in mPrec, mRec, mCov, and mWCov on instance seg-mentation. In addition, the effectiveness of 3DEPS, sub-modules, and the new loss function were verified separately by the ablation analysis, in which the removal of any of them can result in a segmentation perfor-mance decline of up to 2.0% on average quantitative measures. This study may contribute to the development of plant phenotype extraction, ideotype selection, and intelligent agriculture.

A Multi-Organ Plant Identification Method Using Convolutional Neural Networks

Multi-organ Plant Identification with Multi-Column Deep Convolutional Neural Networks

Plant Identification Based on Multi-branch Convolutional Neural Network with Attention.

Plant Species Identification by Bi-channel Deep Convolutional Networks

Research on the Fine-Grained Plant Image Classification

Crop Disease Identification by Fusing Multiscale Convolution and Vision Transformer.

Plant identification based on very deep convolutional neural networks

Convolutional Recurrent Neural Networks for Observation-Centered Plant Identification

Transfer Learning with Deep Convolutional Neural Network for Automated Plant Identification

An Effective Plant Recognition Method with Feature Recalibration of Multiple Pretrained CNN and Layers

Plant Taxonomy-Guided Path-Based Tree Classifier for Large-Scale Plant Species Identification

Plant Identification Using New Architecture Convolutional Neural Networks Combine with Replacing the Red of Color Channel Image by Vein Morphology Leaf

PlantNet: A dual-function point cloud segmentation network for multiple plant species

Plant identification using deep neural networks via optimization of transfer learning parameters

Plant Taxonomy In Hainan Based On Deep Convolutional Neural Network And Transfer Learning

Central Attention and a Dual Path Convolutional Neural Network in Real-World Tree Species Recognition

Plant Leaf Identification Via A Growing Convolution Neural Network With Progressive Sample Learning

Ensemble of the Deep Convolutional Network for Multiclass of Plant Disease Classification Using Leaf Images

Real-world plant species identification based on deep convolutional neural networks and visual attention

Plant Identification Via Multipath Sparse Coding

Plant leaf identification based on shape and convolutional features