Abstract:Skeleton extraction from 3D plant point cloud data is an essential prior for myriads of phenotyping studies. Although skeleton extraction from 3D shapes have been studied extensively in the computer vision and graphics literature, handling the case of plants is still an open problem. Drawbacks of the existing approaches include the zigzag structure of the skeleton, nonuniform density of skeleton points, lack of points in the areas having complex geometry structure, and most importantly the lack of biological relevance. With the aim to improve existing skeleton structures of state-of-the-art, we propose a stochastic framework which is supported by the biological structure of the original plant (we consider plants without any leaves). Initially we estimate the branching structure of the plant by the notion of β-splines to form a <i>curve tree</i> defined as a finite set of curves joined in a tree topology with certain level of smoothness. In the next phase, we force the discrete points in the curve tree to move toward the original point cloud by treating each point in the curve tree as a center of Gaussian, and points in the input cloud data as observations from the Gaussians. The task is to find the correct locations of the Gaussian centroids by maximizing a likelihood. The optimization technique is iterative and is based on the Expectation Maximization (EM) algorithm. The E-step estimates which Gaussian the observed point cloud was sampled from, and the M-step maximizes the negative log-likelihood that the observed points were sampled from the Gaussian Mixture Model (GMM) with respect to the model parameters. We experiment with several real world and synthetic datasets and demonstrate the robustness of the approach over the state-of-the-art.

Quantifying robustness: 3D tree point cloud skeletonization with smart-tree in noisy domains

Smart-Tree: Neural Medial Axis Approximation of Point Clouds for 3D Tree Skeletonization

Bayesian mesh reconstruction from noisy point data

Quasi-Balanced Self-Training on Noise-Aware Synthesis of Object Point Clouds for Closing Domain Gap

A novel tree-structured point cloud dataset for skeletonization algorithm evaluation

3D Branch Point Cloud Completion for Robotic Pruning in Apple Orchards

Skeletonization of Plant Point Cloud Data Using Stochastic Optimization Framework

Completing 3D point clouds of individual trees using deep learning

Automatic Reconstruction of Tree Skeletal Structures from Point Clouds

PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Clouds

TreeNet3D : A large scale tree benchmark for 3D tree modeling, carbon storage estimation and tree segmentation

Tree Annotations in LiDAR Data Using Point Densities and Convolutional Neural Networks

TreePartNet

Using Synthetic Tree Data in Deep Learning-Based Tree Segmentation Using LiDAR Point Clouds

Triangle-Net: Towards Robustness in Point Cloud Learning

CherryPicker: Semantic Skeletonization and Topological Reconstruction of Cherry Trees

Branching Gaussian Processes with Applications to Spatiotemporal Reconstruction of 3D Trees

RobustTree: An adaptive, robust PCA algorithm for embedded tree structure recovery from single-cell sequencing data

Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptions

Deep Learning-Based Quality Assessment Of 3d Point Clouds Without Reference