Abstract:Robot navigation is an important research field with applications in various domains. However, traditional approaches often prioritize efficiency and obstacle avoidance, neglecting a nuanced understanding of human behavior or intent in shared spaces. With the rise of service robots, there's an increasing emphasis on endowing robots with the capability to navigate and interact in complex real-world environments. Socially aware navigation has recently become a key research area. However, existing work either predicts pedestrian movements or simply emits alert signals to pedestrians, falling short of facilitating genuine interactions between humans and robots. In this paper, we introduce the Hybrid Soft Actor-Critic with Large Language Model (HSAC-LLM), an innovative model designed for socially-aware navigation in robots. This model seamlessly integrates deep reinforcement learning with large language models, enabling it to predict both continuous and discrete actions for navigation. Notably, HSAC-LLM facilitates bidirectional interaction based on natural language with pedestrian models. When a potential collision with pedestrians is detected, the robot can initiate or respond to communications with pedestrians, obtaining and executing subsequent avoidance strategies. Experimental results in 2D simulation, the Gazebo environment, and the real-world environment demonstrate that HSAC-LLM not only efficiently enables interaction with humans but also exhibits superior performance in navigation and obstacle avoidance compared to state-of-the-art DRL algorithms. We believe this innovative paradigm opens up new avenues for effective and socially aware human-robot interactions in dynamic environments. Videos are available at <a class="link-external link-https" href="https://hsacllm.github.io/" rel="external noopener nofollow">this https URL</a>.

Towards Dialogue-based Navigation with Multivariate Adaptation driven by Intention and Politeness for Social Robots

Enhancing Socially-Aware Robot Navigation through Bidirectional Natural Language Conversation

Enabling Socially Competent navigation through incorporating HRI

Socially Integrated Navigation: A Social Acting Robot with Deep Reinforcement Learning

Exploratory evaluation of politeness in human-robot interaction

Setting Up Pepper For Autonomous Navigation And Personalized Interaction With Users

The Emotionally Intelligent Robot: Improving Social Navigation in Crowded Environments

EmoiPlanner: Human emotion and intention aware socially acceptable robot navigation in human‐centric environments

Preference-Based People-Aware Navigation for Telepresence Robots

More than just a Tool: People's Perception and Acceptance of Prosocial Delivery Robots as Fellow Road Users

Socially-Aware Navigation: A Non-linear Multi-Objective Optimization Approach

Improving User's Sense of Participation in Robot-Driven Dialogue

The experience of humans' and robots' mutual (im)politeness in enacted service scenarios: An empirical study

Humanising robot-assisted navigation

Hey Robot! Personalizing Robot Navigation through Model Predictive Control with a Large Language Model

Language-guided Robust Navigation for Mobile Robots in Dynamically-changing Environments

Reflective Dialogues with a Humanoid Robot Integrated with an LLM and a Curated NLU System for Positive Behavioral Change in Older Adults

Social Robot Navigation Tasks: Combining Machine Learning Techniques and Social Force Model

From Learning to Relearning: A Framework for Diminishing Bias in Social Robot Navigation

Personalizing Interfaces to Humans with User-Friendly Priors

Read the Room: Adapting a Robot's Voice to Ambient and Social Contexts