Abstract:Traditional robot navigation systems primarily utilize occupancy grid maps and laser-based sensing technologies, as demonstrated by the popular move_base package in ROS. Unlike robots, humans navigate not only through spatial awareness and physical distances but also by integrating external information, such as elevator maintenance updates from public notification boards and experiential knowledge, like the need for special access through certain doors. With the development of Large Language Models (LLMs), which posses text understanding and intelligence close to human performance, there is now an opportunity to infuse robot navigation systems with a level of understanding akin to human cognition. In this study, we propose using osmAG (Area Graph in OpensStreetMap textual format), an innovative semantic topometric hierarchical map representation, to bridge the gap between the capabilities of ROS move_base and the contextual understanding offered by LLMs. Our methodology employs LLMs as actual copilot in robot navigation, enabling the integration of a broader range of informational inputs while maintaining the robustness of traditional robotic navigation systems. Our code, demo, map, experiment results can be accessed at <a class="link-external link-https" href="https://github.com/xiexiexiaoxiexie/Intelligent-LiDAR-Navigation-LLM-as-Copilot" rel="external noopener nofollow">this https URL</a>.

Mapless Navigation With Safety-Enhanced Imitation Learning

Mapless Navigation With Safety-Enhanced Imitation Learning

Learning Safety-Aware Policy with Imitation Learning for Context-Adaptive Navigation

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

A Mapless Navigation Method Based on Reinforcement Learning and Local Obstacle Map

Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot

A Deep Safe Reinforcement Learning Approach for Mapless Navigation.

Deep reinforcement learning based mapless navigation for industrial AMRs: advancements in generalization via potential risk state augmentation

Using Deep Reinforcement Learning with Automatic Curriculum Learning for Mapless Navigation in Intralogistics

Sim-to-Real: Mapless Navigation for USVs Using Deep Reinforcement Learning

Mapless Navigation Based on 2D LIDAR in Complex Unknown Environments

Learning Autonomous Navigation in Unmapped and Unknown Environments

Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation

Towards Target-Driven Visual Navigation in Indoor Scenes via Generative Imitation Learning

A Soft Actor-Critic Deep Reinforcement-Learning-Based Robot Navigation Method Using LiDAR

Intelligent LiDAR Navigation: Leveraging External Information and Semantic Maps with LLM as Copilot

Learning Complicated Navigation Skills from Limited Experience Via Augmenting Offline Datasets

Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigation

Robot Mapless Navigation in VUCA Environments Via Deep Reinforcement Learning

XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees