Abstract:The International Journal of Robotics Research, Ahead of Print. In this work, we introduce composable energy policies (CEP), a novel framework for multi-objective motion generation. We frame the problem of composing multiple policy components from a probabilistic view. We consider a set of stochastic policies represented in arbitrary task spaces, where each policy represents a distribution of the actions to solve a particular task. Then, we aim to find the action in the configuration space that optimally satisfies all the policy components. The presented framework allows the fusion of motion generators from different sources: optimal control, data-driven policies, motion planning, and handcrafted policies. Classically, the problem of multi-objective motion generation is solved by the composition of a set of deterministic policies, rather than stochastic policies. However, there are common situations where different policy components have conflicting behaviors, leading to oscillations or the robot getting stuck in an undesirable state. While our approach is not directly able to solve the conflicting policies problem, we claim that modeling each policy as a stochastic policy allows more expressive representations for each component in contrast with the classical reactive motion generation approaches. In some tasks, such as reaching a target in a cluttered environment, we show experimentally that CEP additional expressivity allows us to model policies that reduce these conflicting behaviors. A field that benefits from these reactive motion generators is the one of robot reinforcement learning. Integrating these policy architectures with reinforcement learning allows us to include a set of inductive biases in the learning problem. These inductive biases guide the reinforcement learning agent towards informative regions or improve collision safety while exploring. In our work, we show how to integrate our proposed reactive motion generator as a structured policy for reinforcement learning. Combining the reinforcement learning agent exploration with the prior-based CEP, we can improve the learning performance and explore safer.

RMPflow: A Computational Graph for Automatic Motion Policy Generation

RMPflow: A Geometric Framework for Generation of Multi-Task Motion Policies

Riemannian Flow Matching Policy for Robot Motion Learning

FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulation

Fast and Robust Visuomotor Riemannian Flow Matching Policy

Wasserstein Gradient Flows for Optimizing Gaussian Mixture Policies

Composable Geometric Motion Policies using Multi-Task Pullback Bundle Dynamical Systems

Learning Robotic Manipulation Policies from Point Clouds with Conditional Flow Matching

FlowNav: Learning Efficient Navigation Policies via Conditional Flow Matching

Flow as the Cross-Domain Manipulation Interface

Motion Flow Matching for Human Motion Synthesis and Editing

Composable energy policies for reactive motion generation and reinforcement learning

G3Flow: Generative 3D Semantic Flow for Pose-aware and Generalizable Object Manipulation

Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation

PDP: Physics-Based Character Animation via Diffusion Policy

Hierarchical Policy Blending as Inference for Reactive Robot Control

Probabilistic motion planning for non-Euclidean and multi-vehicle problems

Guided Imitation of Task and Motion Planning

Relative Policy-Transition Optimization for Fast Policy Transfer

Motion Planning for Hybrid Dynamical Systems: Framework, Algorithm Template, and a Sampling-based Approach

Geometric Fabrics for the Acceleration-based Design of Robotic Motion