Headland Turning Path Planning for Agricultural Vehicles Based on Panoramic Surround View Images

Dongfang Li,Yu Liang,Boliao Li,Jing Fan,Chenglong Li,Shaoqing Cui,Jun Wang
DOI: https://doi.org/10.2139/ssrn.4633294
2023-01-01
Abstract:Headland turning poses a significant challenge to the vision-based autonomous navigation of agricultural vehicles. During a turning process, a single forward-looking vision sensor with limited field of view inevitably loses the perception of the headland area. Unfortunately, no practical pure vision-based headland turning method has been proposed yet. To address this challenge, a panoramic surround view (PSV) system incorporating four fisheye cameras positioned at the front, rear, left, and right of an agricultural vehicle was developed in this study. The stitched PSV image provided a comprehensive 360-degree bird’s-eye view of the vehicle’s surroundings, enabling a continuous perception of the relative position between the agricultural vehicle and the headland. Detection of the headland area in PSV images was accomplished through semantic segmentation. In addition, a headland turning path planning algorithm comprising three steering manoeuvres was devised. Leveraging the lightweight model CGNet, the mean intersection over union (mIoU) for the semantic segmentation of the headland achieving a remarkable 92.84%. The average deviation of the detected headland boundary was 5.63 pixels in an image with a resolution of 640*340. The proposed algorithm demonstrated an inference speed of 18.45 frames per second. Field navigation experiments were conducted, and a successful completion of headland turns further validated the effectiveness of the proposed method.
What problem does this paper attempt to address?