Abstract:Plant phenotyping plays a crucial role in crop science and plant breeding. However, traditional methods often involve time-consuming and manual observations. Therefore, it is essential to develop automated, sensor-driven techniques that can provide objective and rapid information. Various methods rely on camera systems, including RGB, multi-spectral, and hyper-spectral cameras, which offer valuable insights into plant physiology. In recent years, 3D sensing systems such as laser scanners have gained popularity due to their ability to capture structural plant parameters that are difficult to obtain using spectral sensors. Unlike images, point clouds are not structured and require pre-processing steps to extract precise information and handle noise or missing points. One approach is to generate mesh-based surface representations using triangulation. A key challenge in the 3D surface reconstruction of plants is the pre-processing of point clouds, which involves removing non-plant noise from the scene, segmenting point clouds from populations to individual plants, and further dividing individual plants into their respective organs. In this study, we will not focus on the segmentation aspect but rather on the other pre-processing steps, like denoising parameters, which depend on the data type. We present an automated pipeline for converting high-resolution point clouds into surface models of plants. The pipeline incorporates additional pre-processing steps such as outlier removal, denoising, and subsampling to ensure the accuracy and quality of the reconstructed surfaces. Data were collected using three different sensors: a handheld scanner, a terrestrial laser scanner (TLS), and a mobile mapping platform, under varying conditions from controlled laboratory environments to complex field settings. The investigation includes five different plant species, each with distinct characteristics, to demonstrate the potential of the pipeline. In a next step, phenotypic traits such as leaf area, leaf area index (LAI), and leaf angle distribution (LAD) were calculated to further illustrate the pipeline's potential and effectiveness. The pipeline is based on the Open3D framework and is available open source.

Automatic stitching and segmentation of roots images for the generation of labelled deep learning-ready data

Segmentation of roots in soil with U-Net

RhizoNet segments plant roots to assess biomass and growth for enabling self-driving labs

Computer vision and machine learning enabled soybean root phenotyping pipeline

High-Throughput in situ Root Image Segmentation Based on the Improved DeepLabv3+ Method

PRMI: A Dataset of Minirhizotron Images for Diverse Plant Root Study

Unsupervised Pre-Training for 3D Leaf Instance Segmentation

Fast and efficient root phenotyping via pose estimation

An Improved U-Net-based in Situ Root System Phenotype Segmentation Method for Plants

MultipleXLab: A high-throughput portable live-imaging root phenotyping platform using deep learning and computer vision

Research on Fine‐Grained Phenotypic Analysis of Temporal Root Systems – Improved YoloV8seg Applied for Fine‐Grained Analysis of In Situ Root Temporal Phenotypes

Image-based Root Phenotyping for Field-Grown Crops: an Example under Maize/soybean Intercropping

Plant-part Segmentation Using Deep Learning and Multi-View Vision

Eff-3DPSeg: 3D organ-level plant shoot segmentation using annotation-efficient point clouds

Hierarchical Approach for Joint Semantic, Plant Instance, and Leaf Instance Segmentation in the Agricultural Domain

A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth

NeRF-based 3D reconstruction pipeline for acquisition and analysis of tomato crop morphology

Automatic segmentation of cotton roots in high-resolution minirhizotron images based on improved OCRNet

Deep machine learning for cell segmentation and quantitative analysis of radial plant growth

A 3D Surface Reconstruction Pipeline for Plant Phenotyping