Abstract:Human-robot collaborative (HRC) assembly combines the advantages of robot's operation consistency with human's cognitive ability and adaptivity, which provides an efficient and flexible way for complex assembly tasks. In the process of HRC assembly, the robot needs to understand the operator's intention accurately to assist the collaborative assembly tasks. At present, operator intention recognition considering context information such as assembly objects in a complex environment remains challenging. In this paper, we propose a human-object integrated approach for context-aware assembly intention recognition in the HRC, which integrates the recognition of assembly actions and assembly parts to improve the accuracy of the operator's intention recognition. Specifically, considering the real-time requirements of HRC assembly, spatial-temporal graph convolutional networks (ST-GCN) model based on skeleton features is utilized to recognize the assembly action to reduce unnecessary redundant information. Considering the disorder and occlusion of assembly parts, an improved YOLOX model is proposed to improve the focusing capability of network structure on the assembly parts that are difficult to recognize. Afterwards, taking decelerator assembly tasks as an example, a rule-based reasoning method that contains the recognition information of assembly actions and assembly parts is designed to recognize the current assembly intention. Finally, the feasibility and effectiveness of the proposed approach for recognizing human intentions are verified. The integration of assembly action recognition and assembly part recognition can facilitate the accurate operator's intention recognition in the complex and flexible HRC assembly environment.

Assembly task allocation of human-robot collaboration based on deep reinforcement learning

A reinforcement learning method for human-robot collaboration in assembly tasks

Human-robot collaborative assembly task planning for mobile cobots based on deep reinforcement learning

Spacecraft Attitude Maneuver Planning Based on Deep Reinforcement Learning under Complex Constraints

Mastering the working sequence in human-robot collaborative assembly based on reinforcement learning

Adaptive Disassembly Sequence Planning for VR Maintenance Training Via Deep Reinforcement Learning

Robot autonomous grasping and assembly skill learning based on deep reinforcement learning

A strategy transfer approach for intelligent human-robot collaborative assembly

Hand-in-Hand Guidance: an Explore-Exploit Based Reinforcement Learning Method for Performance Driven Assembly-Adjustment

A Deep Learning-Enabled Human-Cyber-physical Fusion Method Towards Human-Robot Collaborative Assembly.

A digital twin-driven human–robot collaborative assembly-commissioning method for complex products

AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning

Hierarchical Hybrid Learning for Long-Horizon Contact-Rich Robotic Assembly

A graph-based reinforcement learning-enabled approach for adaptive human-robot collaborative assembly operations

Autonomous Human-Robot Collaborative Assembly Method Driven by the Fusion of Large Language Model and Digital Twin

Data-Efficient Hierarchical Reinforcement Learning for Robotic Assembly Control Applications

Compliant Robotic Assembly based on Deep Reinforcement Learning

Initial Task Allocation for Multi-Human Multi-Robot Teams with Attention-based Deep Reinforcement Learning

Human-object integrated assembly intention recognition for context-aware human-robot collaborative assembly

Integrated Task Sequence Planning and Assignment for Human–robot Collaborative Assembly Station

Adaptive Task Allocation in Multi-Human Multi-Robot Teams under Team Heterogeneity and Dynamic Information Uncertainty