Abstract:Plant architecture is an important determinant of the canopy light interception and photosynthesis. Therefore, effective and nondestructive methods for obtaining plant architecture can help us understand the relationships between plant physiological processes and morphogenesis. Digital camera technology has become relatively ubiquitous and inexpensive, leading to a recent surge in utilizing plant imaging to capture data. Therefore, a three-dimensional (3-D) reconstruction of plant architecture based on these photographed image sequences can be realized. However, the accuracyevaluation of reconstruction is always determined from visual effect and or from 1-D or 2-D measured data. In this study, image sequences were obtained around experimental plants (e.g. egg plant, sweet pepper and cucumber) by slightly moving a commercial camera for image generation so that each neighboring image pair shared short baseline. Structure from motion (SFM) method was applied to produce a set of sparse point cloud based on plant image sequences. As the sparse point cloud was inadequate for the reconstruction of complicated plant architecture, multiple-view stereo (MVS) method was further used to produce dense and accurate point cloud based on the output of SFM. Software Bundler and CMVS were applied to implement the SFM and MVS methods, respectively. Bundlertakes a set of images as input, and produces a 3D reconstruction of sparse scene geometry and camera parameters as output. CMVS takes a set of images and camera parameters (the output of Bundler) as input, and outputs a set of dense points with geometry details. Once original point cloud has been obtained, point cloud processing procedures were conducted to refine point cloud, including deleting noise points and scaling to the actual size of experimental plants. In order to obtain point cloud of individual blade, segmentation of point cloud of plants was conducted based on region growing segmentation algorithm. Once point cloud of individual blade was obtained, Poisson surface reconstruction algorithm was used to reconstruct each leaf. Before accuracy evaluation, point cloud of individual leaf blade and corresponding laser scanning point cloud were aligned to the same 3-D coordinate system using the Iterative Closest Point algorithm. Then, comparison on 3-D scale based on Hausdorff distance was made between point cloud data obtained from plant image sequences and referenced point cloud data with laser scanning on individual leaf blade level. Furthermore, phenotypic attributes, such as leaf blade width, leaf blade length and blade area were extracted based on data from image sequences and from laser scanning methods. Besides, these attributes of each blade were manually measured. Finally, comparisons were made for blade area, blade length and blade maximum width between data from the image sequence-based model, laser scanning based model and manually measured data. The results showed that high accuracy of 3-D reconstruction was obtained based on plant image sequence method. Hausdorff distances of experimental plants were ranged from 0 to 10 mm, and most of the values were less than 4.0 mm. There was a good agreement between measured and calculated blade area, blade length and maximum width withR2> 0.95 for blade area, RMSE< 4.5 mm for blade width, and RMSE < 5.6 mm for blade length. There was no significant difference for each attribute between measured and calculated data (ANOVA,P> 0.05). A key advance of the current 3-D reconstruction of plant architecture is the capability to non-destructively capture plant traits with high accuracy. This advance permits time-series measurements that are necessary to follow the progression of growth and stress on individual plants, and will play an important role in related research fields, such as plant phenotyping, genetic breeding, interactions between plant phenotype and environment.

Three-dimensional Quantifications of Plant Growth Dynamics in Field-grown Plants Based on Machine Vision Method

Three-Dimensional Quantification of Intercropping Crops in Field by Ground and Aerial Photography

Machine Vision System for 3D Plant Phenotyping

Image-based dynamic quantification and high-accuracy 3D evaluation of canopy structure of plant populations.

Three-dimensional reconstruction and its precision evaluation of plant architecture based on multiple view stereo method

A field-based high-throughput method for acquiring canopy architecture using unmanned aerial vehicle images

Three-dimensional reconstruction and phenotype measurement of maize seedlings based on multi-view image sequences

Non-Destructive Measurement of Three-Dimensional Plants Based on Point Cloud

In-field High Throughput Phenotyping and Cotton Plant Growth Analysis Using LiDAR

Research on automatic 3D reconstruction of plant phenotype based on Multi-View images

Three-Dimensional Reconstruction of Soybean Canopy Based on Multivision Technology for Calculation of Phenotypic Traits

3D Scanning System for Automatic High-Resolution Plant Phenotyping

Calculation Method for Phenotypic Traits Based on the 3D Reconstruction of Maize Canopies

Multi-modal three-dimensional reconstruction of greenhouse tomato plants based on phase-correlation method

Three-Dimensional Reconstruction of Soybean Canopies Using Multisource Imaging for Phenotyping Analysis

3D image monitoring and modeling for corn plants growth in field condition

Novel 3D Imaging Systems for High-Throughput Phenotyping of Plants

Fast Multi-View 3D Reconstruction of Seedlings Based on Automatic Viewpoint Planning

A Calculation Method of Phenotypic Traits Based on Three-Dimensional Reconstruction of Tomato Canopy

Leveraging Image Analysis to Compute 3D Plant Phenotypes Based on Voxel-Grid Plant Reconstruction

High-Throughput Volumetric Reconstruction for 3d Wheat Plant Architecture Studies