Abstract:Recent advances in robot skill learning have unlocked the potential to construct task-agnostic skill libraries, facilitating the seamless sequencing of multiple simple manipulation primitives (aka. skills) to tackle significantly more complex tasks. Nevertheless, determining the optimal sequence for independently learned skills remains an open problem, particularly when the objective is given solely in terms of the final geometric configuration rather than a symbolic goal. To address this challenge, we propose Logic-Skill Programming (LSP), an optimization-based approach that sequences independently learned skills to solve long-horizon tasks. We formulate a first-order extension of a mathematical program to optimize the overall cumulative reward of all skills within a plan, abstracted by the sum of value functions. To solve such programs, we leverage the use of tensor train factorization to construct the value function space, and rely on alternations between symbolic search and skill value optimization to find the appropriate skill skeleton and optimal subgoal sequence. Experimental results indicate that the obtained value functions provide a superior approximation of cumulative rewards compared to state-of-the-art reinforcement learning methods. Furthermore, we validate LSP in three manipulation domains, encompassing both prehensile and non-prehensile primitives. The results demonstrate its capability to identify the optimal solution over the full logic and geometric path. The real-robot experiments showcase the effectiveness of our approach to cope with contact uncertainty and external disturbances in the real world.

Constraint Logic Programming for Real-World Test Laboratory Scheduling

Investigating Constraint Programming for Real World Industrial Test Laboratory Scheduling

Investigating Constraint Programming and Hybrid Methods for Real World Industrial Test Laboratory Scheduling

Local search approaches for the test laboratory scheduling problem with variable task grouping

A Translational Approach to Constraint Answer Set Solving

Scheduling of Automated Wet-Etch Stations with One Robot in Semiconductor Manufacturing via Constraint Answer Set Programming

Constraint programming algorithms and models for scheduling applications

Weight Constraint Programs with Functions

Constraint Answer Set Programming: Integrational and Translational (or SMT-based) Approaches

Solver Scheduling via Answer Set Programming

Weight Constraint Programs with Evaluable Functions

Constraint Programing for Solving Four Complex Flexible Shop Scheduling Problems

ECLiPSe - from LP to CLP

Logic-Constrained Shortest Paths for Flight Planning

Innovative Applications of Constraint Programming

Logic-Skill Programming: An Optimization-based Approach to Sequential Skill Planning

Building Industrial Applications with Constraint Programming

Modular Constraint Solver Cooperation via Abstract Interpretation

An Extended Formalism To Constraint Logic Programming For Decision Analysis

Possibilistic Constraint Satisfaction Problems or "How to handle soft constraints?"

Stochastic Constraint Programming as Reinforcement Learning