Abstract:Accurate situational awareness is crucial for various agricultural tasks and serves as a foundation for autonomous agricultural robots. Simultaneous localization and mapping (SLAM) based on vision and Light Detection And Ranging (LiDAR) has been applied to agricultural robots, such as state estimation and environment perception; however, most of them adopt feature extraction in the front-end. Owing to disruption in feature extraction in agricultural environments and the dependence on edge and surface features in traditional LiDAR SLAM, system accuracy and stability can rapidly decline. Herein, we introduce a hierarchically-coupled LiDAR-inertial odometry system without feature extraction and a comprehensive SLAM system that incorporates a factor graph via loop closure detection. Initially, points originating from the robot and outliers are removed using crop and statistical filters. Subsequently, inertial measurement unit (IMU) measurements are used to diminish the pointcloud distortion caused by moving and turning. Third, we present an enhanced voxelized generalized iterative closest point method that employs an adaptive probability distribution for front-end pose estimation. Finally, the back-end is hierarchically incorporated with a factor graph and geometric observer to optimize the global states of the LiDAR key and common frame. This includes updating the bias of the IMU's state and the robot's speed state in preparation for next-frame de-distortion. We conducted experiments on four self-collected datasets of a dragon fruit field, a sugarcane field, a mango orchard, and a mixed scene with buildings, as well as two public datasets of a park scene and a street scene. In the mango orchard and mixed scene datasets, we observe derivations of 0.1357 and 0.0564 m, respectively, by returning to the starting point method. For the two public dataset sequences of a park scene and an outdoor street, the absolute positioning RMSEs of our method are 0.4371 and 0.1253 m, respectively. Compared with state-of-the-art benchmarks, our method offers more competitive performance in agricultural scenes. In addition, our approach is immediately adaptable to LiDAR sensors with different scanning models in the case of featureless design. These results demonstrate that our method exhibits good localization and mapping performance in open or dense agricultural environments. This exploratory research provides theoretical and technical references for SLAM in future universal agricultural robot platforms. It has broad basic application capabilities and can provide the necessary technical support required for smart agriculture.

An Integrated in Situ Image Acquisition and Annotation Scheme for Instance Segmentation Models in Open Scenes with a Human–Robot Interaction Approach

From One To Many: Unsupervised Traversable Area Segmentation In Off-Road Environment

Interactive Image Segmentation Based Field Boundary Perception Method and Software for Autonomous Agricultural Machinery Path Planning

A Depth Information Aided Real-Time Instance Segmentation Method for Space Task Scenarios under CPU Platform

A Semi-Supervised Domain Adaptive Learning Approach to Unstructured Road Region Semantic Segmentation for Greenhouse Robots

A Lightweight Bilateral Semantic Segmentation Network for Robots

A novel perception and semantic mapping method for robot autonomy in orchards

Three-dimensional Localization and Mapping of Multiagricultural Scenes Via Hierarchically-Coupled LiDAR-inertial Odometry

Research on Human-Machine Collaborative Annotation for Traffic Scene Data

Large-scale environment mapping and immersive human-robot interaction for agricultural mobile robot teleoperation

Fast boundary tracking and projective transformation of cut-uncut surfaces for agricultural robot navigation

Robot Instance Segmentation with Few Annotations for Grasping

3D Global Mapping of Large-Scale Unstructured Orchard Integrating Eye-in-hand Stereo Vision and SLAM

Enhanced Motion Estimation for Autonomous Excavation: Accelerated Semantic Segmentation and ORB Features for Unstructured Environments

Real-Time Segmentation of Unstructured Environments by Combining Domain Generalization and Attention Mechanisms

Real-time object detection and robotic manipulation for agriculture using a YOLO-based learning approach

Efficient Occlusion Avoidance Based on Active Deep Sensing for Harvesting Robots

GDMR-Net: A Novel Graphic Detection Neural Network via Multi-Crossed Attention and Rotation Annotation for Agronomic Applications in Supply Cyber Security

Enhancing Agricultural Environment Perception via Active Vision and Zero-Shot Learning

Monocular Pose Estimation Method for Automatic Citrus Harvesting Using Semantic Segmentation and Rotating Target Detection

A Mobile Robot Visual SLAM System With Enhanced Semantics Segmentation