Abstract:BackgroundPhenotyping is a critical component of plant research. Accurate and precise trait collection, when integrated with genetic tools, can greatly accelerate the rate of genetic gain in crop improvement. However, efficient and automatic phenotyping of traits across large populations is a challenge; which is further exacerbated by the necessity of sampling multiple environments and growing replicated trials. A promising approach is to leverage current advances in imaging technology, data analytics and machine learning to enable automated and fast phenotyping and subsequent decision support. In this context, the workflow for phenotyping (image capture → data storage and curation → trait extraction → machine learning/classification → models/apps for decision support) has to be carefully designed and efficiently executed to minimize resource usage and maximize utility. We illustrate such an end-to-end phenotyping workflow for the case of plant stress severity phenotyping in soybean, with a specific focus on the rapid and automatic assessment of iron deficiency chlorosis (IDC) severity on thousands of field plots. We showcase this analytics framework by extracting IDC features from a set of ~4500 unique canopies representing a diverse germplasm base that have different levels of IDC, and subsequently training a variety of classification models to predict plant stress severity. The best classifier is then deployed as a smartphone app for rapid and real time severity rating in the field.ResultsWe investigated 10 different classification approaches, with the best classifier being a hierarchical classifier with a mean per-class accuracy of ~96%. We construct a phenotypically meaningful ‘population canopy graph’, connecting the automatically extracted canopy trait features with plant stress severity rating. We incorporated this image capture → image processing → classification workflow into a smartphone app that enables automated real-time evaluation of IDC scores using digital images of the canopy.ConclusionWe expect this high-throughput framework to help increase the rate of genetic gain by providing a robust extendable framework for other abiotic and biotic stresses. We further envision this workflow embedded onto a high throughput phenotyping ground vehicle and unmanned aerial system that will allow real-time, automated stress trait detection and quantification for plant research, breeding and stress scouting applications.

HSI-PP: A flexible open-source software for hyperspectral imaging-based plant phenotyping

Dissecting the Phenotypic Components of Crop Plant Growth and Drought Responses Based on High-Throughput Image Analysis.

IHUP: An Integrated High-Throughput Universal Phenotyping Software Platform to Accelerate Unmanned-Aerial-Vehicle-Based Field Plant Phenotypic Data Extraction and Analysis

Applications of hyperspectral imaging in plant phenotyping

Hyperspectral imaging combined with machine learning as a tool to obtain high-throughput plant salt-stress phenotyping.

High-Throughput Plant Phenotyping Platform (HT3P) as a Novel Tool for Estimating Agronomic Traits From the Lab to the Field

Low-Cost Hyperspectral Imaging to Detect Drought Stress in High-Throughput Phenotyping

Close range hyperspectral imaging of plants: A review

Current Status Of High-Throughput Plant Phenotyping For Abiotic Stress By Imaging Spectroscopy : A Review

Application of unmanned aerial systems for high throughput phenotyping of large wheat breeding nurseries

A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth

High Throughput In vivo Analysis of Plant Leaf Chemical Properties Using Hyperspectral Imaging

A Comprehensive Review of High Throughput Phenotyping and Machine Learning for Plant Stress Phenotyping

PREPs: An Open-Source Software for High-Throughput Field Plant Phenotyping

Resources for image-based high-throughput phenotyping in crops and data sharing challenges

Image-Based High-Throughput Phenotyping in Horticultural Crops

High-Throughput Corn Image Segmentation and Trait Extraction Using Chlorophyll Fluorescence Images

A real-time phenotyping framework using machine learning for plant stress severity rating in soybean

Automated In-Field Leaf-Level Hyperspectral Imaging of Corn Plants Using a Cartesian Robotic Platform

Towards Low-Cost Hyperspectral Single-Pixel Imaging for Plant Phenotyping

Development of a mobile, high-throughput, and low-cost image-based plant growth phenotyping system