Abstract:Humanoid robots are equipped with humanoid arms to make them more acceptable to the general public. Humanoid robots are a great challenge in robotics. The concept of digital twin technology complies with the guiding ideology of not only Industry 4.0, but also Made in China 2025. This paper proposes a scheme that combines deep reinforcement learning (DRL) with digital twin technology for controlling humanoid robot arms. For rapid and stable motion planning for humanoid robots, multitasking-oriented training using the twin synchro-control (TSC) scheme with DRL is proposed. For switching between tasks, the robot arm training must be quick and diverse. In this work, an approach for obtaining a priori knowledge as input to DRL is developed and verified using simulations. Two simple examples are developed in a simulation environment. We developed a data acquisition system to generate angle data efficiently and automatically. These data are used to improve the reward function of the deep deterministic policy gradient (DDPG) and quickly train the robot for a task. The approach is applied to a model of the humanoid robot BHR-6, a humanoid robot with multiple-motion mode and a sophisticated mechanical structure. Using the policies trained in the simulations, the humanoid robot can perform tasks that are not possible to train with existing methods. The training is fast and allows the robot to perform multiple tasks. Our approach utilizes human joint angle data collected by the data acquisition system to solve the problem of a sparse reward in DRL for two simple tasks. A comparison with simulation results for controllers trained using the vanilla DDPG show that the designed controller developed using the DDPG with the TSC scheme have great advantages in terms of learning stability and convergence speed.

Modelling Inter-Task Relations to Transfer Robot Skills with Three-Way Rbms

ACQUISITION SLOPE SURFACE WALKING FOR HUMANOIDS VIA TRANSFER LEARNING

Combining Model-Based $Q$ -Learning with Structural Knowledge Transfer for Robot Skill Learning

Modelling and Generalizing Achieved Robot Skills with Temporal Restricted Boltzmann Machines

Body Calibration: Automatic Inter-Task Mapping between Multi-Legged Robots with Different Embodiments in Transfer Reinforcement Learning

Innovative multi-dimensional learning algorithm and experiment design for human-robot cooperation

Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

Human-Robot Skill Transfer with Enhanced Compliance via Dynamic Movement Primitives

Bridging Locomotion and Manipulation Using Reconfigurable Robotic Limbs via Reinforcement Learning

One-shot sim-to-real transfer policy for robotic assembly via reinforcement learning with visual demonstration

A Multitasking-Oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-Control

Diff-Transfer: Model-based Robotic Manipulation Skill Transfer via Differentiable Physics Simulation

A data-efficient goal-directed deep reinforcement learning method for robot visuomotor skill

Policy Stitching: Learning Transferable Robot Policies

Learning Task Transition from Standing-Up to Walking for a Squatted Bipedal Humanoid Robot.

Multimodality Driven Impedance-Based Sim2Real Transfer Learning for Robotic Multiple Peg-in-Hole Assembly

Learning Invariant Feature Spaces to Transfer Skills with Reinforcement Learning

Robot Manipulation Skills Transfer for Sim-to-Real in Unstructured Environments

Multi-Task Trust Transfer for Human-Robot Interaction

Learning to combine primitive skills: A step towards versatile robotic manipulation