Abstract:As autonomous systems and robots are applied to more real world situations, they must reason about uncertainty when planning actions. Mission success oftentimes cannot be guaranteed and the planner must reason about the probability of failure. Unfortunately, computing a trajectory that satisfies mission goals while constraining the probability of failure is difficult because of the need to reason about complex, multidimensional probability distributions. Recent methods have seen success using chance-constrained, model-based planning. However, the majority of these methods can only handle simple environment and agent models. We argue that there are two main drawbacks of current approaches to goal-directed motion planning under uncertainty. First, current methods suffer from an inability to deal with expressive environment models such as 3D non-convex obstacles. Second, most planners rely on considerable simplifications when computing trajectory risk including approximating the agent’s dynamics, geometry, and uncertainty. In this article, we apply hybrid search to the risk-bound, goal-directed planning problem. The hybrid search consists of a region planner and a trajectory planner. The region planner makes discrete choices by reasoning about geometric regions that the autonomous agent should visit in order to accomplish its mission. In formulating the region planner, we propose landmark regions that help produce obstacle-free paths. The region planner passes paths through the environment to a trajectory planner; the task of the trajectory planner is to optimize trajectories that respect the agent’s dynamics and the user’s desired risk of mission failure. We discuss three approaches to modeling trajectory risk: a CDF-based approach, a sampling-based collocation method, and an algorithm named Shooting Method Monte Carlo. These models allow computation of trajectory risk with more complex environments, agent dynamics, geometries, and models of uncertainty than past approaches. A variety of 2D and 3D test cases are presented including a linear case, a Dubins car model, and an underwater autonomous vehicle. The method is shown to outperform other methods in terms of speed and utility of the solution. Additionally, the models of trajectory risk are shown to better approximate risk in simulation.

Safe Multiagent Motion Planning Under Uncertainty for Drones Using Filtered Reinforcement Learning

Safe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning

Collision-Free Path Planning for Multiple Drones Based on Safe Reinforcement Learning

Scalable and Safe Multi-Agent Motion Planning with Nonlinear Dynamics and Bounded Disturbances

Distributionally Robust CVaR-Based Safety Filtering for Motion Planning in Uncertain Environments

Multi-agent Motion Planning for Dense and Dynamic Environments via Deep Reinforcement Learning

Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Distributed Safe Learning and Planning for Multi-robot Systems

Online Mapping and Motion Planning Under Uncertainty for Safe Navigation in Unknown Environments

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

CaRT: Certified Safety and Robust Tracking in Learning-based Motion Planning for Multi-Agent Systems

Motion Planning Under Uncertainty with Complex Agents and Environments via Hybrid Search

A Model Predictive Path Integral Method for Fast, Proactive, and Uncertainty-Aware UAV Planning in Cluttered Environments

3M-RL: Multi-Resolution, Multi-Agent, Mean-Field Reinforcement Learning for Autonomous UAV Routing

Safe Reinforcement Learning With Stability Guarantee for Motion Planning of Autonomous Vehicles

Reactive motion planning with probabilistic safety guarantees

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning

Safe Reinforcement Learning Using Black-Box Reachability Analysis

Dashing for the Golden Snitch: Multi-Drone Time-Optimal Motion Planning with Multi-Agent Reinforcement Learning

Model-free Motion Planning of Autonomous Agents for Complex Tasks in Partially Observable Environments