Abstract:Humanoid robots are equipped with humanoid arms to make them more acceptable to the general public. Humanoid robots are a great challenge in robotics. The concept of digital twin technology complies with the guiding ideology of not only Industry 4.0, but also Made in China 2025. This paper proposes a scheme that combines deep reinforcement learning (DRL) with digital twin technology for controlling humanoid robot arms. For rapid and stable motion planning for humanoid robots, multitasking-oriented training using the twin synchro-control (TSC) scheme with DRL is proposed. For switching between tasks, the robot arm training must be quick and diverse. In this work, an approach for obtaining a priori knowledge as input to DRL is developed and verified using simulations. Two simple examples are developed in a simulation environment. We developed a data acquisition system to generate angle data efficiently and automatically. These data are used to improve the reward function of the deep deterministic policy gradient (DDPG) and quickly train the robot for a task. The approach is applied to a model of the humanoid robot BHR-6, a humanoid robot with multiple-motion mode and a sophisticated mechanical structure. Using the policies trained in the simulations, the humanoid robot can perform tasks that are not possible to train with existing methods. The training is fast and allows the robot to perform multiple tasks. Our approach utilizes human joint angle data collected by the data acquisition system to solve the problem of a sparse reward in DRL for two simple tasks. A comparison with simulation results for controllers trained using the vanilla DDPG show that the designed controller developed using the DDPG with the TSC scheme have great advantages in terms of learning stability and convergence speed.

Human-robot collaborative assembly task planning for mobile cobots based on deep reinforcement learning

Assembly task allocation of human-robot collaboration based on deep reinforcement learning

A strategy transfer approach for intelligent human-robot collaborative assembly

Integrated Task Sequence Planning and Assignment for Human–robot Collaborative Assembly Station

Toward Proactive Human–Robot Collaborative Assembly: A Multimodal Transfer-Learning-Enabled Action Prediction Approach

Human-in-the-loop Robotic Manipulation Planning for Collaborative Assembly

A reinforcement learning method for human-robot collaboration in assembly tasks

Adaptive Disassembly Sequence Planning for VR Maintenance Training Via Deep Reinforcement Learning

Robust Task Planning for Assembly Lines with Human-Robot Collaboration

Coordinated Transportation of Dual-arm Robot Based on Deep Reinforcement Learning

Hierarchical Hybrid Learning for Long-Horizon Contact-Rich Robotic Assembly

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

Reinforcement Learning Based User-Guided Motion Planning for Human-Robot Collaboration

Mastering the working sequence in human-robot collaborative assembly based on reinforcement learning

Deep Reinforcement Learning-based Task Assignment and Path Planning for Multi-agent Construction Robots

Learning Robotic Assembly from CAD

A digital twin-driven human–robot collaborative assembly-commissioning method for complex products

A graph-based reinforcement learning-enabled approach for adaptive human-robot collaborative assembly operations

A Multitasking-Oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-Control

Multi-Agent Reinforcement Learning for Real-Time Dynamic Production Scheduling in a Robot Assembly Cell

A Deep Learning-Enabled Human-Cyber-physical Fusion Method Towards Human-Robot Collaborative Assembly.