E2CropDet: An efficient end-to-end solution to crop row detection

Dongfang Li,Boliao Li,Shuo Kang,Huaiqu Feng,Sifang Long,Jun Wang
DOI: https://doi.org/10.1016/j.eswa.2023.120345
IF: 8.5
2023-05-05
Expert Systems with Applications
Abstract:Crop row detection is the basis for the visual navigation of agricultural machinery. Previous research has typically developed crop detection schemes based on specific application objects, with cumbersome image processing steps. A compact and efficient deep learning-based crop row detection network, named E2CropDet, is proposed in this study. E2CropDet models each crop row as a complete and independent object to enable an end-to-end detection manner with no involvement of image post-processing. Generic backbones are used as feature extractors in E2CropDet. Line-shaped proposals are developed as pre-defined detection anchors based on the shape characteristics and distribution pattern of crop rows. The feature vector obtained by pooling along the slender crop rows is fed into fully connected layers after aggregating contextual information. Then the final centreline extraction results are obtained by classification and regression. With ResNet-34 as the backbone, the proposed model results in a lateral deviation of 5.945 pixels for centerline extraction, which exceeds the semantic segmentation-based (7.153) and the Hough transform-based (17.834) approaches. Additionally, benefiting from an end-to-end pipeline that requires no post-process, it achieves a remarkable detection speed of 166 frames per second.
computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
What problem does this paper attempt to address?