Abstract:Robots navigating in crowded areas should negotiate free space with humans rather than fully controlling collision avoidance, as this can lead to freezing behavior. Game theory provides a framework for the robot to reason about potential cooperation from humans for collision avoidance during path planning. In particular, the mixed strategy Nash equilibrium captures the negotiation behavior under uncertainty, making it well suited for crowd navigation. However, computing the mixed strategy Nash equilibrium is often prohibitively expensive for real-time decision-making. In this paper, we propose an iterative Bayesian update scheme over probability distributions of trajectories. The algorithm simultaneously generates a stochastic plan for the robot and probabilistic predictions of other pedestrians' paths. We prove that the proposed algorithm is equivalent to solving a mixed strategy game for crowd navigation, and the algorithm guarantees the recovery of the global Nash equilibrium of the game. We name our algorithm Bayes' Rule Nash Equilibrium (BRNE) and develop a real-time model prediction crowd navigation framework. Since BRNE is not solving a general-purpose mixed strategy Nash equilibrium but a tailored formula specifically for crowd navigation, it can compute the solution in real-time on a low-power embedded computer. We evaluate BRNE in both simulated environments and real-world pedestrian datasets. BRNE consistently outperforms non-learning and learning-based methods regarding safety and navigation efficiency. It also reaches human-level crowd navigation performance in the pedestrian dataset benchmark. Lastly, we demonstrate the practicality of our algorithm with real humans on an untethered quadruped robot with fully onboard perception and computation.

What problem does this paper attempt to address?

This paper mainly focuses on the issue of effective navigation negotiation between robots and individuals in a crowded environment. Specifically, the authors propose a method based on Mixed Strategy Nash Equilibrium (MSNE) to address this problem. ### Research Background 1. **Current Situation Analysis**: Current robot navigation methods often assume humans are passive obstacles, leading to inefficient navigation in dense crowds as robots frequently need to slow down or stop to avoid collisions. 2. **Theoretical Foundation**: Game theory provides a framework that allows robots to predict and utilize possible cooperative behaviors of humans for path planning. In particular, Mixed Strategy Nash Equilibrium can capture the negotiation behavior between parties under uncertainty, making it very suitable for crowd navigation scenarios. ### Main Contributions 1. **Algorithm Proposal**: This paper proposes an iterative Bayesian update scheme that can simultaneously generate random path planning for the robot and probabilistically predict the paths of other pedestrians. This method is called Bayes' Rule Nash Equilibrium (BRNE). 2. **Theoretical Proof**: The authors prove that the proposed algorithm is equivalent to solving a Nash equilibrium problem in a mixed strategy game and guarantees finding a global Nash equilibrium. 3. **Computational Efficiency**: Compared to general Nash equilibrium solvers, BRNE is not solving a general mixed strategy Nash equilibrium problem but is a customized solution for crowd navigation scenarios, thus enabling real-time computation on low-power embedded computers. 4. **Experimental Validation**: The performance of BRNE was evaluated through simulated environments and real-world crowd datasets. The results show that BRNE outperforms non-learning and learning-based methods in terms of safety and navigation efficiency, achieving near-human-level crowd navigation performance. 5. **Practical Application**: To demonstrate the practical feasibility of the algorithm, the authors also conducted experiments on a cordless quadruped robot, using full onboard perception and computing capabilities to interact with real humans. ### Innovations - **Combination of Theory and Practice**: Applying the concept of Mixed Strategy Nash Equilibrium to the practical problem of crowd navigation and validating its effectiveness through experiments. - **Improved Computational Efficiency**: Achieving real-time computation on resource-limited devices through customized algorithm design, which was difficult to achieve with previous methods. - **Optimization of Human-Robot Interaction**: By considering the uncertainty of human behavior, the BRNE algorithm can better handle complex situations in human-robot interaction, avoiding issues such as "freezing behavior." In summary, this paper introduces the BRNE algorithm, providing a new solution for efficient and safe navigation of robots in crowds.

Mixed Strategy Nash Equilibrium for Crowd Navigation

CrowdMove: Autonomous Mapless Navigation in Crowded Scenarios

Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning

Robot navigation in a crowd by integrating deep reinforcement learning and online planning

SafeCrowdNav: safety evaluation of robot crowd navigation in complex scenes

Risk-Aware Deep Reinforcement Learning for Robot Crowd Navigation

Robot Navigation in Crowd Based on Dual Social Attention Deep Reinforcement Learning

Real-Time Navigation In Dynamic Human Environments Using Optimal Reciprocal Collision Avoidance

Crowd-Steer: Realtime Smooth and Collision-Free Robot Navigation in Densely Crowded Scenarios Trained using High-Fidelity Simulation

Crowd-Aware Socially Compliant Robot Navigation via Deep Reinforcement Learning

Decentralized Social Navigation with Non-Cooperative Robots via Bi-Level Optimization

Realtime Collision Avoidance for Mobile Robots in Dense Crowds using Implicit Multi-sensor Fusion and Deep Reinforcement Learning

Robot Navigation Based on Human Trajectory Prediction and Multiple Travel Modes

Learning Strategies For Successful Crowd Navigation

Learning Contact-based Navigation in Crowds

Pedestrian-Robot Interactions on Autonomous Crowd Navigation: Reactive Control Methods and Evaluation Metrics

Multi-objective deep reinforcement learning for crowd-aware robot navigation with dynamic human preference

Safe and socially compliant robot navigation in crowds with fast-moving pedestrians via deep reinforcement learning

Deep Reinforcement Learning-Based Mapless Crowd Navigation with Perceived Risk of the Moving Crowd for Mobile Robots

Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space

Multi-Objective Crowd-Aware Robot Navigation System Using Deep Reinforcement Learning