Abstract:BackgroundPhenotyping is a critical component of plant research. Accurate and precise trait collection, when integrated with genetic tools, can greatly accelerate the rate of genetic gain in crop improvement. However, efficient and automatic phenotyping of traits across large populations is a challenge; which is further exacerbated by the necessity of sampling multiple environments and growing replicated trials. A promising approach is to leverage current advances in imaging technology, data analytics and machine learning to enable automated and fast phenotyping and subsequent decision support. In this context, the workflow for phenotyping (image capture → data storage and curation → trait extraction → machine learning/classification → models/apps for decision support) has to be carefully designed and efficiently executed to minimize resource usage and maximize utility. We illustrate such an end-to-end phenotyping workflow for the case of plant stress severity phenotyping in soybean, with a specific focus on the rapid and automatic assessment of iron deficiency chlorosis (IDC) severity on thousands of field plots. We showcase this analytics framework by extracting IDC features from a set of ~4500 unique canopies representing a diverse germplasm base that have different levels of IDC, and subsequently training a variety of classification models to predict plant stress severity. The best classifier is then deployed as a smartphone app for rapid and real time severity rating in the field.ResultsWe investigated 10 different classification approaches, with the best classifier being a hierarchical classifier with a mean per-class accuracy of ~96%. We construct a phenotypically meaningful ‘population canopy graph’, connecting the automatically extracted canopy trait features with plant stress severity rating. We incorporated this image capture → image processing → classification workflow into a smartphone app that enables automated real-time evaluation of IDC scores using digital images of the canopy.ConclusionWe expect this high-throughput framework to help increase the rate of genetic gain by providing a robust extendable framework for other abiotic and biotic stresses. We further envision this workflow embedded onto a high throughput phenotyping ground vehicle and unmanned aerial system that will allow real-time, automated stress trait detection and quantification for plant research, breeding and stress scouting applications.

An explainable deep machine vision framework for plant stress phenotyping

Interpretable Deep Learning applied to Plant Stress Phenotyping

Usefulness of interpretability methods to explain deep learning based plant stress phenotyping

Proximal Methods for Plant Stress Detection Using Optical Sensors and Machine Learning

A real-time phenotyping framework using machine learning for plant stress severity rating in soybean

Deep Learning Application in Plant Stress Imaging: A Review

Robust diagnosis and meta visualizations of plant diseases through deep neural architecture with explainable AI

Machine vision and artificial intelligence for plant growth stress detection and monitoring: A review

Plant disease identification using explainable 3D deep learning on hyperspectral images

Machine Vision System for 3D Plant Phenotyping

Drought stress prediction and propagation using time series modeling on multimodal plant image sequences

An Explainable Vision Transformer with Transfer Learning Combined with Support Vector Machine Based Efficient Drought Stress Identification

tCrop: Thermal Imaging Based Plant Stress Identification Using On-Edge Deep Learning

Detection of Plant Stress Condition with Deep Learning Based Detection Models

A Comprehensive Review of High Throughput Phenotyping and Machine Learning for Plant Stress Phenotyping

Explainable Light-Weight Deep Learning Pipeline for Improved Drought Stress Identification

Decoding the physiological response of plants to stress using deep learning for forecasting crop loss due to abiotic, biotic, and climatic variables

Intelligent Monitoring of Stress Induced by Water Deficiency in Plants using Deep Learning

Automated image registration of RGB, hyperspectral and chlorophyll fluorescence imaging data

Infrared thermography for plant stress detection in vertical farms: Investigating spatiotemporal variations and exploring solutions via machine learning