CAS: Crop Aerial Sensing Simulation in Smart Farming

Jingyu Liu,Yang Zhao,Xinrui Xiao,Ran Meng,Jie Liu
DOI: https://doi.org/10.1109/secon58729.2023.10287522
2023-01-01
Abstract:Unmanned aerial vehicles (UAV) with onboard sensors become a cost-effective way of crop remote sensing in largescale farms. However, current vision-based crop aerial sensing methods suffer from occlusion issue and require large amount of annotation data. In this paper, we target one particular crop species, corn, and propose to use 3D modeling and simulation to help resolve the issues. We first develop a corn-field 3D model and a crop aerial sensing (CAS) simulation framework. Then we use the CAS framework to generate synthetic data to train various deep learning models for corn leaf segmentation. In addition, we change the 3D model parameters in CAS, e.g., distances between individual corn plants, to derive leaf area index (LAI) correction coefficients for various corn plant and row spacings. Our experimental results from real-world UAV images show that our leaf segmentation model using synthetic data from the CAS framework outperforms state-of-the-art segmentation models by 1.4-3.3%. Our simulation results show that the plant and row spacings of a corn-field have significant effects on correcting the UAV image-based LAI, which can be underestimated by a factor of 2.6, due to the overlap and occlusion issues.
What problem does this paper attempt to address?