Abstract:Maize (Zea mays L.) is one of the three major cereal crops in the world. Leaf angle is an important architectural trait of crops due to its substantial role in light interception by the canopy and hence photosynthetic efficiency. Traditionally, leaf angle has been measured using a protractor, a process that is both slow and laborious. Efficiently measuring leaf angle under field conditions via imaging is challenging due to leaf density in the canopy and the resulting occlusions. However, advances in imaging technologies and machine learning have provided new tools for image acquisition and analysis that could be used to characterize leaf angle using three‐dimensional (3D) models of field‐grown plants. In this study, PhenoBot 3.0, a robotic vehicle designed to traverse between pairs of agronomically spaced rows of crops, was equipped with multiple tiers of PhenoStereo cameras to capture side‐view images of maize plants in the field. PhenoStereo is a customized stereo camera module with integrated strobe lighting for high‐speed stereoscopic image acquisition under variable outdoor lighting conditions. An automated image processing pipeline (AngleNet) was developed to measure leaf angles of nonoccluded leaves. In this pipeline, a novel representation form of leaf angle as a triplet of keypoints was proposed. The pipeline employs convolutional neural networks to detect each leaf angle in two‐dimensional images and 3D modeling approaches to extract quantitative data from reconstructed models. Satisfactory accuracies in terms of correlation coefficient (r) and mean absolute error (MAE) were achieved for leaf angle (r > 0.87 , M A E < 5 ° ) and internode heights (r > 0.99 , M A E < 3.5 cm ). Our study demonstrates the feasibility of using stereo vision to investigate the distribution of leaf angles in maize under field conditions. The proposed system is an efficient alternative to traditional leaf angle phenotyping and thus could accelerate breeding for improved plant architecture.

Plant Phenotyping by Deep-Learning-Based Planner for Multi-Robots

A Multi-robot System for High-Throughput Plant Phenotyping

Pheno-Robot: An Auto-Digital Modelling System for In-Situ Phenotyping in the Field

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Recent developments and potential of robotics in plant eco-phenotyping

Field Robot for High-throughput and High-resolution 3D Plant Phenotyping

A Robot to Shape your Natural Plant: The Machine Learning Approach to Model and Control Bio-Hybrid Systems

Robotic Technologies for High-Throughput Plant Phenotyping: Contemporary Reviews and Future Perspectives

Field-Based High-Throughput Phenotyping for Maize Plant Using 3D LiDAR Point Cloud Generated With a "Phenomobile"

A Ground Mobile Robot for Autonomous Terrestrial Laser Scanning-Based Field Phenotyping

High precision control and deep learning-based corn stand counting algorithms for agricultural robot

Machine Vision System for 3D Plant Phenotyping

Plant Phenotyping: An Active Vision Cell for Three-Dimensional Plant Shoot Reconstruction

Mobile terrestrial proximal sensing system for 3D plant structure phenotyping

3D Scanning System for Automatic High-Resolution Plant Phenotyping

Field‐based robotic leaf angle detection and characterization of maize plants using stereo vision and deep convolutional neural networks

A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth

Research on automatic 3D reconstruction of plant phenotype based on Multi-View images

Hierarchical Tri-manual Planning for Vision-assisted Fruit Harvesting with Quadrupedal Robots

A Robotic Platform for Corn Seedling Morphological Traits Characterization

Crop Height and Plot Estimation for Phenotyping from Unmanned Aerial Vehicles using 3D LiDAR