A Robust Deep Learning Approach for the Quantitative Characterization and Clustering of Peach Tree Crowns Based on UAV Images
Jun Hu,Yanfeng Zhang,Dandan Zhao,Guijun Yang,Feiyun Chen,Chengquan Zhou,Wenxuan Chen
DOI: https://doi.org/10.1109/tgrs.2022.3142288
IF: 8.2
2022-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:The accurate large-scale measurement of peach crowns is vital in horticultural science and the optimization of orchard management. Nowadays, numerous crown parameters (e.g., crown area, height, and volume) can be obtained via the analysis of point clouds or photographs. Current laser-based sensors provide the required reliable and accurate information; however, they are costly and time-consuming. Therefore, a simpler approach for crown measurement is required. For this purpose, this study presents a pipeline for the monitoring and clustering of 259 peach tree crowns based on unmanned aerial vehicle (UAV) images of a peach orchard in Southeast China. Considering the limitation that the original aerial image dataset contains little information, a data augmentation process is adopted, and an efficient deep learning architecture based on conditional generative adversarial networks (cGANs) was designed to extract the crown area. Then, the shape of the crown area was clustered using an edge detection process and a $k$ -means algorithm. Finally, an ellipsoid volume method (EVM) was applied to estimate the crown volume. Five indicators—namely, $Q_{\mathrm {seg}}$ , $S_{\mathrm {r}}$ , Precision, Recall, and F-measure—were employed to evaluate the crown extraction effects, and the average results for testing samples were 0.832, 0.847, 0.851, 0.828, and 0.846, respectively. Compared with other approaches—namely, fully convolutional network (FCN), U-Net, SegNet21, the excess green index (ExG), and the color index of vegetation extraction (CIVE)—the proposed cGAN model performs better, achieving an accuracy improvement of 5%–25%. For the estimation of crown volume, using measurements from a light detection and ranging (LIDAR) scanner as a reference, the correlation coefficient and relative-root-mean-square error (R-RMSE) were found to be 0.836% and 14.93%, respectively. Overall, the results demonstrate that the proposed method is feasible for measuring peach tree crowns. The wide application of such technology would facilitate applied research in plant phenotyping and precision horticulture.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics