Automatic Non-Destructive Multiple Lettuce Traits Prediction Based on DeepLabV3+

Yu Zhang,Mengliu Wu,Jinsong Li,Si Yang,Lihua Zheng,Xinliang Liu,Minjuan Wang
DOI: https://doi.org/10.1007/s11694-022-01660-3
IF: 3.4
2022-01-01
Journal of Food Measurement & Characterization
Abstract:In crop growth management, phenotypic traits are an important basis for judging growth status. Manual measurements are labor-intensive, unstable and time-consuming. We propose an image processing pipeline to estimate multiple lettuce traits (fresh weight, dry weight, plant height, diameter, leaf area) based on the lightweight DeepLabV3 + network. Accurate and rapid segmentation of crops from backgrounds is the basis for phenotypic research. First, we propose to combine DeepLabV3 + and MobilenetV2 to realize a high-precision and fast segmentation of lettuce in complex backgrounds and illuminations. Based on the segmentation results, we extracted the morphological factors and vegetation indices. Random forest (RF), partial least squares regression (PLSR) and support vector machine were applied to predict the multiple lettuce traits and compared for optimal model selection. Results showed that DeepLabv3 + (with Mobilenetv2) has the best segmentation performance with pixel accuracy of 97.520 R^2 of 0.898, 0.899, 0.931 and 0.904, respectively. RF yielded the highest accuracy in predicting plant height, with R^2 of 0.858. We proposed method for estimating phenotypic characteristics of lettuce based on deep learning has excellent performance and important application value for lettuce growth monitoring and yield estimation.
What problem does this paper attempt to address?