Abstract:Abstract Background High throughput non-destructive phenotyping is emerging as a significant approach for phenotyping germplasm and breeding populations for the identification of superior donors, elite lines, and QTLs. Detection and counting of spikes, the grain bearing organs of wheat, is critical for phenomics of a large set of germplasm and breeding lines in controlled and field conditions. It is also required for precision agriculture where the application of nitrogen, water, and other inputs at this critical stage is necessary. Further, counting of spikes is an important measure to determine yield. Digital image analysis and machine learning techniques play an essential role in non-destructive plant phenotyping analysis. Results In this study, an approach based on computer vision, particularly object detection, to recognize and count the number of spikes of the wheat plant from the digital images is proposed. For spike identification, a novel deep-learning network, SpikeSegNet, has been developed by combining two proposed feature networks: Local Patch extraction Network (LPNet) and Global Mask refinement Network (GMRNet). In LPNet, the contextual and spatial features are learned at the local patch level. The output of LPNet is a segmented mask image, which is further refined at the global level using GMRNet. Visual (RGB) images of 200 wheat plants were captured using LemnaTec imaging system installed at Nanaji Deshmukh Plant Phenomics Centre, ICAR-IARI, New Delhi. The precision, accuracy, and robustness (F 1 score) of the proposed approach for spike segmentation are found to be 99.93%, 99.91%, and 99.91%, respectively. For counting the number of spikes, “analyse particles”—function of imageJ was applied on the output image of the proposed SpikeSegNet model. For spike counting, the average precision, accuracy, and robustness are 99%, 95%, and 97%, respectively. SpikeSegNet approach is tested for robustness with illuminated image dataset, and no significant difference is observed in the segmentation performance. Conclusion In this study, a new approach called as SpikeSegNet has been proposed based on combined digital image analysis and deep learning techniques. A dedicated deep learning approach has been developed to identify and count spikes in the wheat plants. The performance of the approach demonstrates that SpikeSegNet is an effective and robust approach for spike detection and counting. As detection and counting of wheat spikes are closely related to the crop yield, and the proposed approach is also non-destructive, it is a significant step forward in the area of non-destructive and high-throughput phenotyping of wheat.

Morpho-Colorimetric Diversity and Genome-Wide Association Study of Wheat Spike Architecture Based on Image Processing Under Well-Watered and Rain-Fed Conditions

Dissecting the molecular basis of spike traits by integrating gene regulatory networks and genetic variation in wheat

Systematic Mining and Functional Analysis of Factors Regulating Wheat Spike Development for Breeding Selection

Evaluation of the Spike Diversity of Seven Hexaploid Wheat Species and an Artificial Amphidiploid Using a Quadrangle Model Obtained from 2D Images

Genomic insights into the modifications of spike morphology traits during wheat breeding

Genome-Wide Association Study and Post-genome-Wide Association Study Analysis for Spike Fertility and Yield Related Traits in Bread Wheat

Transcriptome Association Identifies Regulators of Wheat Spike Architecture.

From Fields to Pixels: UAV Multispectral and Field-Captured RGB Imaging for High-Throughput Wheat Spike and Kernel Counting

Multi-locus genome-wide association mapping for spike-related traits in bread wheat (Triticum aestivum L.)

Development of image-based wheat spike counter through a Faster R-CNN algorithm and application for genetic studies

QTL analysis of genetic loci affecting domestication-related spike characters in common wheat

Automated Spike Detection in Diverse European Wheat Plants Using Textural Features and the Frangi Filter in 2D Greenhouse Images

Detection and characterization of spike architecture based on deep learning and X-ray computed tomography in barley

WheatSpikeNet: an improved wheat spike segmentation model for accurate estimation from field imaging

Effect of leaf and spike morphological traits on the relationship between spectral reflectance indices and yield in wheat

Systematic identification of wheat spike developmental regulators by integrated multi-omics, transcriptional network, GWAS, and genetic analyses

Rapid Recognition of Field-Grown Wheat Spikes Based on a Superpixel Segmentation Algorithm Using Digital Images

Understanding the Genetic Basis of Spike Fertility to Improve Grain Number, Harvest Index, and Grain Yield in Wheat Under High Temperature Stress Environments

Dynamic gene regulatory networks improving spike fertility through regulation of floret primordia fate in wheat

Identification of molecular markers and candidate regions associated with grain number per spike in Pubing3228 using SLAF-BSA

SpikeSegNet-a deep learning approach utilizing encoder-decoder network with hourglass for spike segmentation and counting in wheat plant from visual imaging