Abstract:Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize both a differentiable reward function and the likelihood under the data distribution captured by a diffusion model. Reward-gradient guided denoising requires a differentiable reward function fitted to both clean and noised samples, limiting its applicability as a general trajectory optimizer. In this paper, we propose DiffusionES, a method that combines gradient-free optimization with trajectory denoising to optimize black-box non-differentiable objectives while staying in the data manifold. Diffusion-ES samples trajectories during evolutionary search from a diffusion model and scores them using a black-box reward function. It mutates high-scoring trajectories using a truncated diffusion process that applies a small number of noising and denoising steps, allowing for much more efficient exploration of the solution space. We show that DiffusionES achieves state-of-the-art performance on nuPlan, an established closed-loop planning benchmark for autonomous driving. Diffusion-ES outperforms existing sampling-based planners, reactive deterministic or diffusion-based policies, and reward-gradient guidance. Additionally, we show that unlike prior guidance methods, our method can optimize non-differentiable language-shaped reward functions generated by few-shot LLM prompting. When guided by a human teacher that issues instructions to follow, our method can generate novel, highly complex behaviors, such as aggressive lane weaving, which are not present in the training data. This allows us to solve the hardest nuPlan scenarios which are beyond the capabilities of existing trajectory optimization methods and driving policies.

PRESTO: Fast motion planning using diffusion models based on key-configuration environment representation

Efficient Optimization-Based Trajectory Planning for Unmanned Systems in Confined Environments

Efficient Motion Planning Based on Kinodynamic Model for Quadruped Robots Following Persons in Confined Spaces

Motion Planning Diffusion: Learning and Adapting Robot Motion Planning with Diffusion Models

Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Models

DiffusionSeeder: Seeding Motion Optimization with Diffusion for Rapid Motion Planning

EDMP: Ensemble-of-costs-guided Diffusion for Motion Planning

Trajectory planning in 3D dynamic environment with non-cooperative agents via fast marching and Bézier curve

FASTER: Fast and Safe Trajectory Planner for Navigation in Unknown Environments

Adaptive Online Replanning with Diffusion Models

STITCHER: Real-Time Trajectory Planning with Motion Primitive Search

Dynamic Obstacle Avoidance through Uncertainty-Based Adaptive Planning with Diffusion

A Hybrid Method for Online Trajectory Planning of Mobile Robots in Cluttered Environments

Denoising Heat-inspired Diffusion with Insulators for Collision Free Motion Planning

Fast Motion Planning Via Free C-Space Estimation Based On Deep Neural Network

Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

Safe Interval Motion Planning for Quadrotors in Dynamic Environments

Task-agnostic Pre-training and Task-guided Fine-tuning for Versatile Diffusion Planner

Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following

Multi-Robot Motion Planning with Diffusion Models

DPMPC-Planner: A real-time UAV trajectory planning framework for complex static environments with dynamic obstacles