Using high-throughput phenotype platform MVS-Pheno to reconstruct the 3D morphological structure of wheat

Wenrui Li,Sheng Wu,Weiliang Wen,Xianju Lu,Haishen Liu,Minggang Zhang,Pengliang Xiao,Xinyu Guo,Chunjiang Zhao
DOI: https://doi.org/10.1093/aobpla/plae019
2024-03-29
AoB Plants
Abstract:Abstract It is of great significance to study the plant morphological structure for improving crop yield and achieving efficient use of resources. Three dimensional (3D) information can more accurately describe the morphological and structural characteristics of crop plants. Automatic acquisition of 3D information is one of the key steps in plant morphological structure research. Taking wheat as the research object, we propose a point cloud data-driven 3D reconstruction method that achieves 3D structure reconstruction and plant morphology parameterization at the phytomer scale. Specifically, we use the MVS-Pheno platform to reconstruct the point cloud of wheat plants and segment organs through the deep learning algorithm. On this basis, we automatically reconstructed the 3D structure of leaves and tillers and extracted the morphological parameters of wheat. The results show that the semantic segmentation accuracy of organs is 95.2%, and the instance segmentation accuracy AP50 is 0.665. The R2 values for extracted leaf length, leaf width, leaf attachment height, stem leaf angle, tiller length, and spike length were 0.97, 0.80, 1.00, 0.95, 0.99, and 0.95, respectively. This method can significantly improve the accuracy and efficiency of 3D morphological analysis of wheat plants, providing strong technical support for research in fields such as agricultural production optimization and genetic breeding.
plant sciences,ecology
What problem does this paper attempt to address?
This paper aims to solve the problem of automatic acquisition and reconstruction of the three - dimensional morphological structure of wheat plants. Specifically, the research objectives include: 1. **Improve the accuracy and efficiency of three - dimensional morphological analysis of wheat plants**: Traditional manual measurement methods have problems such as large workload, low efficiency, inability to fully represent the three - dimensional structure of plants, and interference from human factors. Therefore, how to accurately and automatically obtain the three - dimensional data of wheat plants and construct their three - dimensional morphological structure models has become a key problem that needs to be solved urgently. 2. **Realize the accurate segmentation and parameter extraction of wheat plant organs**: The paper proposes a three - dimensional reconstruction method of wheat plants driven by point cloud data. The point cloud of wheat plants is reconstructed by the multi - view image acquisition device MVS - Pheno, and the organs are segmented by using deep learning algorithms. On this basis, the three - dimensional structures of leaves and tillers are automatically reconstructed, and the morphological parameters of wheat plants are extracted. 3. **Provide technical support for agricultural production and genetic breeding**: This method can significantly improve the accuracy and efficiency of three - dimensional morphological analysis of wheat plants, and provide strong technical support for research in fields such as agricultural production optimization and genetic breeding. ### Main technical means - **Multi - view image acquisition and point cloud reconstruction**: Use the MVS - Pheno platform to collect multi - view images, and reconstruct the three - dimensional point cloud of wheat plants through the SFM - MVS algorithm. - **Point cloud data pre - processing**: Remove the background point cloud, correct the coordinates, and filter out the noise. - **Deep learning model for organ segmentation**: Based on the SoftGroup network model, perform instance segmentation on the tillers, leaves and ears of wheat plants. - **3D structure reconstruction and parameter extraction**: According to the segmentation results, model the tillers and leaves of wheat plants, and extract morphological parameters such as leaf length, leaf width, attachment height, stem - leaf angle, tiller length and ear length. ### Experimental design and methods - **Experimental design**: Conducted in the experimental fields of Beijing Academy of Agriculture and Forestry Sciences, covering 20 winter wheat varieties, with one plot planted for each variety and multiple samplings. - **Data collection and pre - processing**: Use the improved MVS - Pheno V2 Plus platform to collect multi - view images, reconstruct point clouds and perform pre - processing. - **Deep learning model**: Construct a data set containing 100 wheat plant samples, and train the SoftGroup network model for point cloud organ segmentation. - **3D structure reconstruction**: Perform 3D structure reconstruction on tillers and leaves, and extract morphological parameters. ### Results - **Accuracy of organ semantic segmentation**: 95.2%. - **Accuracy of instance segmentation AP50**: 0.665. - **R² values of morphological parameter extraction**: - Leaf length: 0.97 - Leaf width: 0.80 - Leaf attachment height: 1.00 - Stem - leaf angle: 0.95 - Tiller length: 0.99 - Ear length: 0.95 Through these techniques and methods, the paper has successfully achieved high - precision three - dimensional reconstruction and morphological parameter extraction of wheat plants, providing important technical support for research in related fields.