High-throughput instance segmentation and shape restoration of overlapping vegetable seeds based on sim2real method

Ning Liang,Sashuang Sun,Lei Zhou,Nan Zhao,Mohamed Farag Taha,Yong He,Zhengjun Qiu
DOI: https://doi.org/10.1016/j.measurement.2022.112414
IF: 5.6
2023-02-01
Measurement
Abstract:The high-throughput measurement of morphological parameters for seeds is an essential procedure in vegetable phenotyping. This study drew on sim2real thought to design a novel image simulation method based on multi-feature randomization to synthesize simulated images and generate labels automatically. The Mask R-CNN model was optimized based on seed characteristics to improve the segmentation performance of small vegetable seeds. The optimized Mask R-CNN models trained on simulated datasets achieved superior segmentation performance on real-world datasets, and AP@[0.5:0.95] reached more than 0.85. Furthermore, the Mask R-CNN models had a satisfactory performance in the shape restoration of occluded seeds, and AP@[0.5:0.95] were 0.81, 0.79, and 0.80 for eggplant, tomato, and pepper seeds, respectively. The combination of sim2real and Mask R-CNN realized high-throughput instance segmentation and shape restoration of overlapping vegetable seeds, and it could be used as an alternative for vegetable seed phenotyping.
engineering, multidisciplinary,instruments & instrumentation
What problem does this paper attempt to address?