Abstract:In the domain of flexible manufacturing, Deep Reinforcement Learning (DRL) has emerged as a pivotal technology for robotic assembly tasks. Despite advancements in sample efficiency and interaction safety through residual reinforcement learning with initial policies, challenges persist in achieving context generalization amidst stochastic systems characterized by large random errors and variable backgrounds. Addressing these challenges, this study introduces a novel framework that integrates task attention-based multimodal fusion with an adaptive error curriculum within a residual reinforcement learning paradigm. Our approach commences with the formulation of a task attention-based multimodal policy that synergizes task-centric visual, relative pose, and tactile data into a compact, end-to-end model. This model is explicitly designed to enhance context generalization by improving observability, thereby ensuring robustness against stochastic errors and variable backgrounds. The second facet of our framework, curriculum residual learning, introduces an adaptive error curriculum that intelligently modulates the guidance and constraints of a model-based feedback controller. This progression from perfect to significantly imperfect initial policies incrementally enhances policy robustness and learning process stability. Empirical validation demonstrates the capability of our method to efficiently acquire a high-precision policy for assembly tasks with clearances as tight as 0.1 mm and error margins up to 20 mm within a 3.5-hour training window-a feat challenging for existing RL-based methods. The results indicate a substantial reduction in average completion time by 75 % and a 34 % increase in success rate over the classical two-step approach. An ablation study was conducted to assess the contribution of each component within our framework. Real-world task experiments further corroborate the robustness and generalization of our method, achieving over a 90 % success rate in variable contexts.

Substructure-Preserving Generalization for On-Site Robotic Construction Planning

Generalizable Task Planning Through Representation Pretraining

Robot-Enabled Construction Assembly with Automated Sequence Planning based on ChatGPT: RoboGPT

Learning Parameterized Task Structure for Generalization to Unseen Entities

Transferring Foundation Models for Generalizable Robotic Manipulation

Pave the Way to Grasp Anything: Transferring Foundation Models for Universal Pick-Place Robots

Rearrangement Planning for General Part Assembly

Structural Concept Learning via Graph Attention for Multi-Level Rearrangement Planning

Long-term Robot Manipulation Task Planning with Scene Graph and Semantic Knowledge

Learning to Design and Construct Bridge Without Blueprint

Deep Reinforcement Learning-based Task Assignment and Path Planning for Multi-agent Construction Robots

Sketch-Plan-Generalize: Continual Few-Shot Learning of Inductively Generalizable Spatial Concepts

Task Attention-Based Multimodal Fusion and Curriculum Residual Learning for Context Generalization in Robotic Assembly

A Formal Framework for Robot Construction Problems: A Hybrid Planning Approach

SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning

Generalization of Compositional Tasks with Logical Specification via Implicit Planning

Long-Horizon Multi-Robot Rearrangement Planning for Construction Assembly

Robot Active Neural Sensing and Planning in Unknown Cluttered Environments

GRID: Scene-Graph-based Instruction-driven Robotic Task Planning

From Abstractions to Grounded Languages for Robust Coordination of Task Planning Robots

A Framework to Co-Optimize Robot Exploration and Task Planning in Unknown Environments