Abstract:Background: High resolution and high throughput genotype to phenotype studies in plants are underway to accelerate breeding of climate ready crops. In the recent years, deep learning techniques and in particular Convolutional Neural Networks (CNNs), Recurrent Neural Networks and Long-Short Term Memories (LSTMs), have shown great success in visual data recognition, classification, and sequence learning tasks. More recently, CNNs have been used for plant classification and phenotyping, using individual static images of the plants. On the other hand, dynamic behavior of the plants as well as their growth has been an important phenotype for plant biologists, and this motivated us to study the potential of LSTMs in encoding these temporal information for the accession classification task, which is useful in automation of plant production and care. Methods: In this paper, we propose a CNN-LSTM framework for plant classification of various genotypes. Here, we exploit the power of deep CNNs for automatic joint feature and classifier learning, compared to using hand-crafted features. In addition, we leverage the potential of LSTMs to study the growth of the plants and their dynamic behaviors as important discriminative phenotypes for accession classification. Moreover, we collected a dataset of time-series image sequences of four accessions of Arabidopsis, captured in similar imaging conditions, which could be used as a standard benchmark by researchers in the field. We made this dataset publicly available. Conclusion: The results provide evidence of the benefits of our accession classification approach over using traditional hand-crafted image analysis features and other accession classification frameworks. We also demonstrate that utilizing temporal information using LSTMs can further improve the performance of the system. The proposed framework can be used in other applications such as in plant classification given the environment conditions or in distinguishing diseased plants from healthy ones.

A deep learning approach to track Arabidopsis seedlings' circumnutation from time-lapse videos

PlantTracing: Tracing Arabidopsis Thaliana Apex with CenterTrack

3D Morphological Analysis of Arabidopsis Sepals.

Deep machine learning for cell segmentation and quantitative analysis of radial plant growth

DeepSeedling: deep convolutional network and Kalman filter for plant seedling detection and counting in the field

TSP-yolo-based Deep Learning Method for Monitoring Cabbage Seedling Emergence

The Early Dodder Gets the Host: Decoding the Coiling Patterns of Cuscuta campestris with Automated Image Processing

Analyzing growing plants from 4D point cloud data

A High-Throughput Imaging System to Quantitatively Analyze the Growth Dynamics of Plant Seedlings

PlantTrack: Task-Driven Plant Keypoint Tracking with Zero-Shot Sim2Real Transfer

Automation of leaf counting in maize and sorghum using deep learning

Automated tracking of stem cell lineages of Arabidopsis shoot apex using local graph matching

Deep phenotyping: deep learning for temporal phenotype/genotype classification

YOLOv8-segANDcal: segmentation, extraction, and calculation of soybean radicle features

Joint Multi-Leaf Segmentation, Alignment and Tracking from Fluorescence Plant Videos

AngleCam: Predicting the temporal variation of leaf angle distributions from image series with deep learning

Simulated Plant Images Improve Maize Leaf Counting Accuracy

High-through Counting of Chinese Cabbage Trichomes Based on Deep Learning and Trinocular Stereo Microscope

Nutrient Status Diagnosis of Infield Oilseed Rape via Deep Learning-Enabled Dynamic Model

Applications of Machine Learning Methods to Quantifying Phenotypic Traits that Distinguish the Wild Type from the Mutant Arabidopsis Thaliana Seedlings during Root Gravitropism

Learning Deformable 3D Graph Similarity to Track Plant Cells in Unregistered Time Lapse Images