Abstract:As robots play an increasingly important role in the industrial, the expectations about their applications for everyday living tasks are getting higher. Robots need to perform long-horizon tasks that consist of several sub-tasks that need to be accomplished. Task and Motion Planning (TAMP) provides a hierarchical framework to handle the sequential nature of manipulation tasks by interleaving a symbolic task planner that generates a possible action sequence, with a motion planner that checks the kinematic feasibility in the geometric world, generating robot trajectories if several constraints are satisfied, e.g., a collision-free trajectory from one state to another. Hence, the reasoning about the task plan's geometric grounding is taken over by the motion planner. However, motion planning is computationally intense and is usability as feasibility checker casts TAMP methods inapplicable to real-world scenarios. In this paper, we introduce neural feasibility classifier (NFC), a simple yet effective visual heuristic for classifying the feasibility of proposed actions in TAMP. Namely, NFC will identify infeasible actions of the task planner without the need for costly motion planning, hence reducing planning time in multi-step manipulation tasks. NFC encodes the image of the robot's workspace into a feature map thanks to convolutional neural network (CNN). We train NFC using simulated data from TAMP problems and label the instances based on IK feasibility checking. Our empirical results in different simulated manipulation tasks show that our NFC generalizes to the entire robot workspace and has high prediction accuracy even in scenes with multiple obstructions. When combined with state-of-the-art integrated TAMP, our NFC enhances its performance while reducing its planning time.

NOD-TAMP: Generalizable Long-Horizon Planning with Neural Object Descriptors

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Accelerating Integrated Task and Motion Planning with Neural Feasibility Checking

Extended Task and Motion Planning of Long-horizon Robot Manipulation

Learn2Decompose: Learning Problem Decomposition for Efficient Task and Motion Planning

Automated Planning Domain Inference for Task and Motion Planning

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

Guided Imitation of Task and Motion Planning

Whole-Body Inverse Kinematics and Operation-Oriented Motion Planning for Robot Mobile Manipulation

Toward Holistic Planning and Control Optimization for Dual-Arm Rearrangement

Long-term Robot Manipulation Task Planning with Scene Graph and Semantic Knowledge

Long-Horizon Multi-Robot Rearrangement Planning for Construction Assembly

Learning Task Planning from Multi-Modal Demonstration for Multi-Stage Contact-Rich Manipulation

Modeling Long-horizon Tasks as Sequential Interaction Landscapes

Open-World Task and Motion Planning via Vision-Language Model Inferred Constraints

Anticipatory Task and Motion Planning

Multi-Robot Geometric Task-and-Motion Planning for Collaborative Manipulation Tasks

Extended Tree Search for Robot Task and Motion Planning

Object-Centric Kinodynamic Planning for Nonprehensile Robot Rearrangement Manipulation

Pixels to Plans: Learning Non-Prehensile Manipulation by Imitating a Planner

RHH-LGP: Receding Horizon And Heuristics-Based Logic-Geometric Programming For Task And Motion Planning