Abstract:Nowadays industrial robots have become the key equipment in the context of smart manufacturing and the assembly process is seen as one of the dominant fields of robotic applications. However, robotic assembly still greatly relies on manual programming and performs in a highly controlled and structured environment in a repetitive manner with weak generalization. Recent successes in robot learning show that endowing robot intelligence to obtain skills autonomously is a promising approach. The existing robot learning methods are difficult to apply due to the requirement of sufficient trial-and-error exploration which is hardware-cost and time-consuming. When encountering an unfamiliar task, it is natural for human to use their prior knowledge as guidance to derive the explorative action and then leaning the related skills from the accumulated experience. Inspired by that, this paper proposes a knowledge-guided robot learning method with predictive model to improve the safety and efficiency of assembly skills acquisition. Concretely, based on Cartesian compliance control, a knowledge-guided exploration strategy (KGES) using the fuzzy logic about position/force feedback is built to provide direction and limit the range of exploration in the early learning stages. Upon KGES, a predictive model-based reinforcement learning method is proposed to optimize the local searching trajectory, where the training data, generated from the trained ensemble predictive models with a knowledge-guided branched progressive rollout method, is used for policy optimization. Finally, the proposed method is tested in two peg-in-hole assembly tasks in MuJoCo environment, and the results show that the robot can learn the assembly skill faster and perform better in success rate than model-free and knowledge-free settings while maintaining the contact force within a safe range.

Skill Manipulation Method of Industrial Robot Based on Knowledge Graph for Assembly Scene

Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge

KGAssembly: Knowledge Graph-Driven Assembly Process Generation and Evaluation for Complex Components

Knowledge-based Intelligent Assembly Planning System and Its Related Key Technologies

Semantic Representation of Robot Manipulation with Knowledge Graph

Robotic Task Oriented Knowledge Graph for Human-Robot Collaboration in Disassembly

Manipulation Skill Acquisition for Robotic Assembly Based on Multi-Modal Information Description

A Robotic Manipulation Framework for Industrial Human–robot Collaboration Based on Continual Knowledge Graph Embedding

Integrating Knowledge and Augmented Reality: A Novel Framework for Intelligent Assembly Assistance

Skill-based programming of complex robotic assembly tasks for industrial application

Cognitive Manipulation: Semi-supervised Visual Representation and Classroom-to-real Reinforcement Learning for Assembly in Semi-structured Environments

KGGPT: Empowering Robots with OpenAI's ChatGPT and Knowledge Graph.

Robot Planning Based on Behavior Tree and Knowledge Graph

Probabilistic Graph Based Spatial Assembly Relation Inference for Programming of Assembly Task by Demonstration.

Knowledge-guided Robot Learning on Compliance Control for Robotic Assembly Task with Predictive Model

Manipulation Skill Acquisition for Robotic Assembly Using Deep Reinforcement Learning

Hierarchical Understanding in Robotic Manipulation: A Knowledge-Based Framework

Long-term Robot Manipulation Task Planning with Scene Graph and Semantic Knowledge

A Robot Programming by Demonstration Method for Precise Manipulation in 3C Assembly

Robot Skill Acquisition in Assembly Process Using Deep Reinforcement Learning

Construction and Application of the Knowledge Graph Method in Maintenance of Robot in Automotive Manufacturing Industry