Abstract:Fruit cluster characteristics such as compactness, maturity, berry number, and berry size, are important phenotypic traits associated with harvestability and yield of blueberry genotypes and can be used to monitor berry development and improve crop management. The goal of this study was to develop a complete framework of 3D segmentation for individual blueberries as they develop in clusters and to extract blueberry cluster traits. To achieve this goal, an image-capturing system was developed to capture blueberry images to facilitate 3D reconstruction and a 2D-3D projection-based photogrammetric pipeline was proposed to extract berry cluster traits. The reconstruction was performed for four southern highbush blueberry cultivars ('Emerald', 'Farthing', 'Meadowlark' and 'Star') with 10 cluster samples for each cultivar based on photogrammetry. A minimum bounding box was created to surround a 3D blueberry cluster to calculate compactness as the ratio of berry volume and minimum bounding box volume. Mask R-CNN was used to segment individual blueberries with the maturity property from 2D images and the instance masks were projected onto 3D point clouds to establish 2D-3D correspondences. The developed trait extraction algorithm was used to segment individual 3D blueberries to obtain berry number, individual berry volume, and berry maturity. Berry maturity was used to calculate cluster maturity as the ratio of the mature berry (blue colored fruit) number and the total berry (blue, reddish, and green colored fruit) number comprising the cluster. The accuracy of determining the fruit number in a cluster is 97.3%. The linear regression for cluster maturity has a R-2 of 0.908 with a RMSE of 0.068. The cluster berry volume has a RMSE of 2.92 cm(3) compared with the ground truth, indicating that the individual berry volume has an error of less than 0.292 cm(3) for clusters with a berry number greater than 10. The statistical analyses of the traits for the four cultivars reveals that, in the middle of April, 'Emerald' and 'Farthing' were more compact than 'Meadowlark' and 'Star', and the mature berry volume of 'Farthing' was greater than 'Emerald' and 'Meadowlark', while 'Star' had the smallest mature berry size. This study develops an effective method based on 3D photogrammetry and 2D instance segmentation that can determine blueberry cluster traits accurately from a large number of samples and can be used for fruit development monitoring, yield estimation, and harvest time prediction.

Blueberry Harvestability Trait Extraction from 2D Images and 3D Point Clouds Based on Deep Learning and Photogrammetric Reconstruction

Three-dimensional Photogrammetry with Deep Learning Instance Segmentation to Extract Berry Fruit Harvestability Traits

Deep learning image segmentation and extraction of blueberry fruit traits associated with harvestability and yield

3D point cloud data to quantitatively characterize size and shape of shrub crops

Identifying Blueberry Fruit of Different Growth Stages Using Natural Outdoor Color Images

Recognising Blueberry Fruit of Different Maturity Using Histogram Oriented Gradients and Colour Features in Outdoor Scenes

A Deep Learning-Based Web Application for Segmentation and Quantification of Blueberry Internal Bruising.

A fast and efficient approach to estimate wild blueberry yield using machine learning with drone photography: Flight altitude, sampling method and model effects

3D Reconstruction of Strawberry Based on Depth Information

Multi-phenotypic parameters extraction and biomass estimation for lettuce based on point clouds

Blueberry Ripeness Detection Model Based on Enhanced Detail Feature and Content-Aware Reassembly

Quantitative Extraction and Evaluation of Tomato Fruit Phenotypes Based on Image Recognition

Detection of fruit maturity stage and yield estimation in wild blueberry using deep learning convolutional neural networks

Modelling Postharvest Quality of Blueberry Affected by Biological Variability Using Image and Spectral Data.

Object Detection in High-Resolution UAV Aerial Remote Sensing Images of Blueberry Canopy Fruits

Three-dimensional reconstruction of guava fruits and branches using instance segmentation and geometry analysis

Dynamic detection of three-dimensional crop phenotypes based on a consumer-grade RGB-D camera

Automatic Measurement of Seed Geometric Parameters Using a Handheld Scanner

Cotton Phenotypic Trait Extraction Using Multi-Temporal Laser Point Clouds

Three-dimensional Photogrammetric Mapping of Cotton Bolls in Situ Based on Point Cloud Segmentation and Clustering

A Novel Greenhouse-Based System for the Detection and Plumpness Assessment of Strawberry Using an Improved Deep Learning Technique