EDMP: Ensemble-of-costs-guided Diffusion for Motion Planning

Kallol Saha,Vishal Mandadi,Jayaram Reddy,Ajit Srikanth,Aditya Agarwal,Bipasha Sen,Arun Singh,Madhava Krishna
2023-09-20
Abstract:Classical motion planning for robotic manipulation includes a set of general algorithms that aim to minimize a scene-specific cost of executing a given plan. This approach offers remarkable adaptability, as they can be directly used off-the-shelf for any new scene without needing specific training datasets. However, without a prior understanding of what diverse valid trajectories are and without specially designed cost functions for a given scene, the overall solutions tend to have low success rates. While deep-learning-based algorithms tremendously improve success rates, they are much harder to adopt without specialized training datasets. We propose EDMP, an Ensemble-of-costs-guided Diffusion for Motion Planning that aims to combine the strengths of classical and deep-learning-based motion planning. Our diffusion-based network is trained on a set of diverse kinematically valid trajectories. Like classical planning, for any new scene at the time of inference, we compute scene-specific costs such as "collision cost" and guide the diffusion to generate valid trajectories that satisfy the scene-specific constraints. Further, instead of a single cost function that may be insufficient in capturing diversity across scenes, we use an ensemble of costs to guide the diffusion process, significantly improving the success rate compared to classical planners. EDMP performs comparably with SOTA deep-learning-based methods while retaining the generalization capabilities primarily associated with classical planners.
Robotics,Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the trajectory generation problem in robot motion planning, especially planning from the starting position to the target position while avoiding collisions (including self - collisions and collisions with surrounding objects). Traditional methods have some limitations: 1. **Classical motion planning algorithms**: Although they can adapt well to new scenarios without the need for specific training data sets, they rely on carefully designed cost functions and may not be able to capture enough diversity when dealing with different scenarios. 2. **Deep - learning - based algorithms**: Although they perform well in improving the task success rate, these methods usually require a large amount of high - quality demonstration data for training, and their performance will decline significantly when dealing with unseen out - of - distribution scenarios. To solve the above problems, the authors propose EDMP (Ensemble - of - costs - guided Diffusion for Motion Planning), that is, **a diffusion model guided by a cost ensemble for motion planning**. This method combines the advantages of classical planning and deep learning, which is specifically reflected in the following aspects: - **Learning prior knowledge**: Train a diffusion model to learn a series of smooth and kinematically - constrained effective trajectories as prior knowledge. - **Scene - specific guidance during inference**: Use scene - specific cost functions (such as collision costs) to directly guide the diffusion process during the inference stage to generate effective trajectories that meet the scene constraints. - **Multi - cost function integration**: Instead of relying on a single cost function, an ensemble of multiple cost functions (ensemble - of - costs) is adopted, so as to better cope with various different scene structures and improve the probability of success. In addition, EDMP also has the following characteristics: - It can be generalized to diverse, even out - of - distribution new scenarios. - It can generate multi - modal trajectories (that is, different path choices from point A to point B), which helps to select the optimal solution according to the specific requirements of downstream tasks. In summary, EDMP aims to fuse the advantages of classical planning and deep learning and provide a more general and efficient robot motion planning solution.