Abstract:This paper presents a hybrid online Partially Observable Markov Decision Process (POMDP) planning system that addresses the problem of autonomous navigation in the presence of multi-modal uncertainty introduced by other agents in the environment. As a particular example, we consider the problem of autonomous navigation in dense crowds of pedestrians and among obstacles. Popular approaches to this problem first generate a path using a complete planner (e.g., Hybrid A*) with ad-hoc assumptions about uncertainty, then use online tree-based POMDP solvers to reason about uncertainty with control over a limited aspect of the problem (i.e. speed along the path). We present a more capable and responsive real-time approach enabling the POMDP planner to control more degrees of freedom (e.g., both speed AND heading) to achieve more flexible and efficient solutions. This modification greatly extends the region of the state space that the POMDP planner must reason over, significantly increasing the importance of finding effective roll-out policies within the limited computational budget that real time control affords. Our key insight is to use multi-query motion planning techniques (e.g., Probabilistic Roadmaps or Fast Marching Method) as priors for rapidly generating efficient roll-out policies for every state that the POMDP planning tree might reach during its limited horizon search. Our proposed approach generates trajectories that are safe and significantly more efficient than the previous approach, even in densely crowded dynamic environments with long planning horizons.

Real-Time, Secure, and Computationally Efficient Navigation: A Prediction-Planning Framework Using Occupancy Grid Map

Mapless-Planner: A Robust and Fast Planning Framework for Aggressive Autonomous Flight Without Map Fusion

High-Speed Robot Navigation using Predicted Occupancy Maps

An Approach for Multi-Objective Obstacle Avoidance Using Dynamic Occupancy Grid Map

Robot Navigation in Unknown and Cluttered Workspace with Dynamical System Modulation in Starshaped Roadmap

Real-Time Navigation For A Mobile Robot Based On The Autonomous Behavior Agent

A Vision-Based Approach for Autonomous Motion in Cluttered Environments

Real-time Optimal Navigation Planning Using Learned Motion Costs

A Unified Framework for Pedestrian Trajectory Prediction and Social-Friendly Navigation

A Realtime Autonomous Robot Navigation Framework for Human like High-level Interaction and Task Planning in Global Dynamic Environment

Decentralized Multi-Agent Trajectory Planning in Dynamic Environments with Spatiotemporal Occupancy Grid Maps

Map-Predictive Motion Planning in Unknown Environments

Planning by Simulation: Motion Planning with Learning-based Parallel Scenario Prediction for Autonomous Driving

Efficient Exploration in Crowds by Coupling Navigation Controller and Exploration Planner

AGRNav: Efficient and Energy-Saving Autonomous Navigation for Air-Ground Robots in Occlusion-Prone Environments

Long-term Navigation for Autonomous Robots Based on Spatio-Temporal Map Prediction

Interactive-FAR:Interactive, Fast and Adaptable Routing for Navigation Among Movable Obstacles in Complex Unknown Environments

Intention-Aware Navigation in Crowds with Extended-Space POMDP Planning

An Efficient Spatial-Temporal Trajectory Planner for Autonomous Vehicles in Unstructured Environments

Learning-based 3D Occupancy Prediction for Autonomous Navigation in Occluded Environments

Edge Accelerated Robot Navigation With Collaborative Motion Planning