Abstract:Robotic navigation in unknown, cluttered environments with limited sensing capabilities poses significant challenges in robotics. Local trajectory optimization methods, such as Model Predictive Path Intergal (MPPI), are a promising solution to this challenge. However, global guidance is required to ensure effective navigation, especially when encountering challenging environmental conditions or navigating beyond the planning horizon. This study presents the GP-MPPI, an online learning-based control strategy that integrates MPPI with a local perception model based on Sparse Gaussian Process (SGP). The key idea is to leverage the learning capability of SGP to construct a variance (uncertainty) surface, which enables the robot to learn about the navigable space surrounding it, identify a set of suggested subgoals, and ultimately recommend the optimal subgoal that minimizes a predefined cost function to the local MPPI planner. Afterward, MPPI computes the optimal control sequence that satisfies the robot and collision avoidance constraints. Such an approach eliminates the necessity of a global map of the environment or an offline training process. We validate the efficiency and robustness of our proposed control strategy through both simulated and real-world experiments of 2D autonomous navigation tasks in complex unknown environments, demonstrating its superiority in guiding the robot safely towards its desired goal while avoiding obstacles and escaping entrapment in local minima. The GPU implementation of GP-MPPI, including the supplementary video, is available at <a class="link-external link-https" href="https://github.com/IhabMohamed/GP-MPPI" rel="external noopener nofollow">this https URL</a>.

Autonomous exploration for navigating in non-stationary CMPs

Learning Exploration Policies for Navigation

Bounded Optimal Exploration in MDP

Learning to explore by reinforcement over high-level options

Learning Augmented, Multi-Robot Long-Horizon Navigation in Partially Mapped Environments

Functional Path Optimisation for Exploration in Continuous Occupancy Maps

Cognitive Mapping and Planning for Visual Navigation

Autonomous Exploration Method of Unmanned Ground Vehicles Based on an Incremental B-Spline Probability Roadmap

GP-guided MPPI for Efficient Navigation in Complex Unknown Cluttered Environments

Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation

Learning Autonomous Navigation in Unmapped and Unknown Environments

Safe Exploration And Optimization Of Constrained Mdps Using Gaussian Processes

Safe Exploration in Markov Decision Processes with Time-Variant Safety using Spatio-Temporal Gaussian Process

STAGE: Scalable and Traversability-Aware Graph based Exploration Planner for Dynamically Varying Environments

Efficient Autonomous Exploration and Mapping in Unknown Environments

Epistemic Exploration for Generalizable Planning and Learning in Non-Stationary Settings

A safe exploration approach to constrained Markov decision processes

Act as You Learn: Adaptive Decision-Making in Non-Stationary Markov Decision Processes

Multi-Objective Autonomous Exploration on Real-Time Continuous Occupancy Maps

Dynamic Subgoal-based Exploration via Bayesian Optimization

A Unified Approach to Multi-task Legged Navigation: Temporal Logic Meets Reinforcement Learning