Abstract:Accurate situational awareness is crucial for various agricultural tasks and serves as a foundation for autonomous agricultural robots. Simultaneous localization and mapping (SLAM) based on vision and Light Detection And Ranging (LiDAR) has been applied to agricultural robots, such as state estimation and environment perception; however, most of them adopt feature extraction in the front-end. Owing to disruption in feature extraction in agricultural environments and the dependence on edge and surface features in traditional LiDAR SLAM, system accuracy and stability can rapidly decline. Herein, we introduce a hierarchically-coupled LiDAR-inertial odometry system without feature extraction and a comprehensive SLAM system that incorporates a factor graph via loop closure detection. Initially, points originating from the robot and outliers are removed using crop and statistical filters. Subsequently, inertial measurement unit (IMU) measurements are used to diminish the pointcloud distortion caused by moving and turning. Third, we present an enhanced voxelized generalized iterative closest point method that employs an adaptive probability distribution for front-end pose estimation. Finally, the back-end is hierarchically incorporated with a factor graph and geometric observer to optimize the global states of the LiDAR key and common frame. This includes updating the bias of the IMU's state and the robot's speed state in preparation for next-frame de-distortion. We conducted experiments on four self-collected datasets of a dragon fruit field, a sugarcane field, a mango orchard, and a mixed scene with buildings, as well as two public datasets of a park scene and a street scene. In the mango orchard and mixed scene datasets, we observe derivations of 0.1357 and 0.0564 m, respectively, by returning to the starting point method. For the two public dataset sequences of a park scene and an outdoor street, the absolute positioning RMSEs of our method are 0.4371 and 0.1253 m, respectively. Compared with state-of-the-art benchmarks, our method offers more competitive performance in agricultural scenes. In addition, our approach is immediately adaptable to LiDAR sensors with different scanning models in the case of featureless design. These results demonstrate that our method exhibits good localization and mapping performance in open or dense agricultural environments. This exploratory research provides theoretical and technical references for SLAM in future universal agricultural robot platforms. It has broad basic application capabilities and can provide the necessary technical support required for smart agriculture.

ROW-SLAM: Under-Canopy Cornfield Semantic SLAM

Under-canopy dataset for advancing simultaneous localization and mapping in agricultural robotics

Three-dimensional Localization and Mapping of Multiagricultural Scenes Via Hierarchically-Coupled LiDAR-inertial Odometry

A new covariance intersection based integrated SLAM framework for 3D outdoor agricultural applications

Semantic Feature Matching for Robust Mapping in Agriculture

Design and experiments with a SLAM system for low-density canopy environments in greenhouses based on an improved Cartographer framework

SLAM in the Field: An Evaluation of Monocular Mapping and Localization on Challenging Dynamic Agricultural Environment

Vision based crop row navigation under varying field conditions in arable fields

Towards Over-Canopy Autonomous Navigation: Crop-Agnostic LiDAR-Based Crop-Row Detection in Arable Fields

Toward Semantic Scene Understanding for Fine-Grained 3D Modeling of Plants

Research on Corn Leaf and Stalk Recognition and Ranging Technology Based on LiDAR and Camera Fusion

GNSS-stereo-inertial SLAM for arable farming

Deep learning-based Crop Row Detection for Infield Navigation of Agri-Robots

Autonomous Guidance of a Corn Harvester using Stereo Vision

A novel perception and semantic mapping method for robot autonomy in orchards

A Convolutional Neural Network-Based Method for Corn Stand Counting in the Field

Simultaneous Localization and Mapping System for Agricultural Yield Estimation Based on Improved VINS-RGBD: A Case Study of a Strawberry Field

Large-Scale Autonomous Flight With Real-Time Semantic SLAM Under Dense Forest Canopy

Towards agricultural autonomy: crop row detection under varying field conditions using deep learning

Multi-Crop Navigation Line Extraction Based on Improved YOLO-v8 and Threshold-DBSCAN under Complex Agricultural Environments

3D Global Mapping of Large-Scale Unstructured Orchard Integrating Eye-in-hand Stereo Vision and SLAM