Abstract:Plant breeders, scientists, and commercial producers commonly use growth rate as an integrated signal of crop productivity and stress. Plant growth monitoring is often done destructively via growth rate estimation by harvesting plants at different growth stages and simply weighing each individual plant. Within plant breeding and research applications, and more recently in commercial applications, non-destructive growth monitoring is done using computer vision to segment plants in images from the background, either in 2D or 3D, and relating these image-based features to destructive biomass measurements. Recent advancements in machine learning have improved image-based localization and detection of plants, but such techniques are not well suited to make biomass predictions when there is significant self-occlusion or occlusion from neighboring plants, such as those encountered under leafy green production in controlled environment agriculture. To enable prediction of plant biomass under occluded growing conditions, we develop an end-to-end deep learning approach that directly predicts lettuce plant biomass from color and depth image data as provided by a low cost and commercially available sensor. We test the performance of the proposed deep neural network for lettuce production, observing a mean prediction error of 7.3% on a comprehensive test dataset of 864 individuals and substantially outperforming previous work on plant biomass estimation. The modeling approach is robust to the busy and occluded scenes often found in commercial leafy green production and requires only measured mass values for training. We then demonstrate that this level of prediction accuracy allows for rapid, non-destructive detection of changes in biomass accumulation due to experimentally induced stress induction in as little as 2 days. Using this method growers may observe and react to changes in plant-environment interactions in near real time. Moreover, we expect that such a sensitive technique for non-destructive biomass estimation will enable novel research and breeding of improved productivity and yield in response to stress.

Utilizing unsupervised learning to improve sward content prediction and herbage mass estimation

Semi-supervised dry herbage mass estimation using automatic data and synthetic images

Extracting Pasture Phenotype and Biomass Percentages using Weakly Supervised Multi-target Deep Learning on a Small Dataset

Unsupervised domain adaptation and super resolution on drone images for autonomous dry herbage biomass estimation

Assessment of Mixed Sward Using Context Sensitive Convolutional Neural Networks

Energy-Efficient Uncertainty-Aware Biomass Composition Prediction at the Edge

The Application of an Unmanned Aerial System and Machine Learning Techniques for Red Clover-Grass Mixture Yield Estimation under Variety Performance Trials

Estimation of Botanical Composition in Mixed Clover–Grass Fields Using Machine Learning-Based Image Analysis

Estimating Grass Sward Quality and Quantity Parameters Using Drone Remote Sensing with Deep Neural Networks

Mass Estimation from Images using Deep Neural Network and Sparse Ground Truth

Deep Learning with Unsupervised Data Labeling for Weeds Detection on UAV Images

Machine learning estimators for the quantity and quality of grass swards used for silage production using drone-based imaging spectrometry and photogrammetry

Generalizable semi-supervised learning method to estimate mass from sparsely annotated images

Estimation of Bale Grazing and Sacrificed Pasture Biomass through the Integration of Sentinel Satellite Images and Machine Learning Techniques

Quantification of species composition in grass-clover swards using RGB and multispectral UAV imagery and machine learning

Nationwide operational mapping of grassland first mowing dates combining machine learning and Sentinel-2 time series

Detection and Prediction of Nutrient Deficiency Stress using Longitudinal Aerial Imagery

Automatic Grassland Degradation Estimation Using Deep Learning.

PROSAIL-Net: A transfer learning-based dual stream neural network to estimate leaf chlorophyll and leaf angle of crops from UAV hyperspectral images

Non-destructive Plant Biomass Monitoring With High Spatio-Temporal Resolution via Proximal RGB-D Imagery and End-to-End Deep Learning

The GrassClover Image Dataset for Semantic and Hierarchical Species Understanding in Agriculture