Field-road Classification for GNSS Recordings of Agricultural Machinery Using Pixel-Level Visual Features.

Ying Chen,Lei Quan,Xiaoqiang Zhang,Kun Zhou,Caicong Wu

DOI: https://doi.org/10.1016/j.compag.2023.107937

IF: 8.3

2023-01-01

Computers and Electronics in Agriculture

Abstract:The understanding of agricultural machinery, whether it is used "in field" or "on road", plays an essential role in optimizing the efficiency of cross-regional agricultural mechanization services that have been available in China for decades. With the widespread availability of Global Navigation Satellite System (GNSS)-enabled devices, developing a method for automatically identifying the activity associated with each point in GNSS recorded trajectories can significantly enhance the optimization of these services. In this paper, we propose a novel fieldroad classification method that utilizes two feature vectors to represent each point in a GNSS trajectory. The first feature vector is a statistical feature vector extracted with existing methods, while the second feature vector is a visual feature vector obtained through an image segmentation model. To extract visual features, we first convert each GNSS trajectory into a trajectory image that encodes the motion information (e.g., speed, direction) of each point and the spatiotemporal relationship between points. Then, an image segmentation model specifically for field-road classification was developed, which can effectively extract a visual feature vector for each pixel in a trajectory image, corresponding to each point in the GNSS trajectory. The image segmentation model used in our approach has a robust feature extraction capability that enhances the statistical feature representation of each point by adding pixel-level visual features. We evaluated the effectiveness of our multi-view field-road classification method using trajectories of corn, wheat, and paddy harvesters. The results demonstrated that our method achieved accuracy scores of 94.17%, 90.93%, and 83.43% for respective datasets. Our method outperformed state-of-the-art field-road classification methods, especially for trajectories with high-frequency GNSS acquisition.