Abstract:Purpose As complex analysis of contact models is required in the traditional assembly strategy, it is still a challenge for a robot to complete the multiple peg-in-hole assembly tasks autonomously. This paper aims to enable the robot to complete the assembly tasks autonomously and more efficiently, with the strategies learned by reinforcement learning (RL), a learning-accelerated deep deterministic policy gradient (LADDPG) algorithm is proposed. Design/methodology/approach The multiple peg-in-hole assembly strategy is designed in two modules: an advanced planning module and a bottom control module. The advanced module is completed by the LADDPG agent, which is used to derive advanced commands based on geometric and environmental constraints, that is, the desired contact force. The bottom-level control module will drive the robot to complete the compliant assembly task through the adaptive impedance algorithm according to the command set issued by the advanced module. In addition, a set of safety assurance mechanisms is developed to safely train a collaborative robot to complete autonomous learning. Findings The method can complete the assembly tasks well through RL, and it can realize satisfactory compliance of the robot to the environment. Compared with the original DDPG algorithm, the average values of the instantaneous maximum contact force and contact torque during the assembly process are reduced by approximately 38% and 74%, respectively. Practical implications The entire algorithm can also be applied to other robots and the assembly strategy can be applied in the field of the automatic assembly. Originality/value A compliant assembly strategy based on the LADDPG algorithm is proposed to complete the automated multiple peg-in-hole assembly tasks.

Learning-based Contact Status Recognition for Peg-in-Hole Assembly

Learning-based Optimization Algorithms Combining Force Control Strategies for Peg-in-Hole Assembly.

Learning Active Force–Torque Based Policy for Sub-mm Localization of Unseen Holes

An Approach for Peg-in-Hole Assembling Based on Force Feedback Control

Sensor-Based Control Using an Image Point and Distance Features for Rivet-in-Hole Insertion.

Learning A Simulation-based Visual Policy for Real-world Peg in Unseen Holes.

Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes

Compare Contact Model-based Control and Contact Model-free Learning: A Survey of Robotic Peg-in-hole Assembly Strategies.

Position/Force Visual-Sensing-Based Robotic Sheet-Like Peg-in-Hole Assembly

Active compliance control of robot peg-in-hole assembly based on combined reinforcement learning

Vision-based robotic peg-in-hole research: integrating object recognition, positioning, and reinforcement learning

A Noncontact Control Strategy for Circular Peg-in-Hole Assembly Guided by the 6-DOF Robot Based on Hybrid Vision

Active Extrinsic Contact Sensing: Application to General Peg-in-Hole Insertion

Contact State Recognition for Dual Peg-in-Hole Assembly of Tightly Coupled Dual Manipulator

A Novel Approach for Flexible Manipulator Conducting Screwing Task Based on Robot–environment Contact Classification

Multiple peg-in-hole compliant assembly based on a learning-accelerated deep deterministic policy gradient strategy

Learning-Based Variable Compliance Control for Robotic Assembly

Contact Force Guidance Assembly Towards Unknown-Shaped Dual Peg-in-Hole

Peg-in-Hole Assembly With Dual-Arm Robot and Dexterous Robot Hands

Multiple Peg-in-Hole Assembly of Tightly Coupled Multi-manipulator Using Learning-based Visual Servo

Imitation and Supervised Learning of Compliance for Robotic Assembly