Abstract:Given the problem of exploration and utilization, the high interaction cost of deep reinforcement learning (DRL) is sometimes unacceptable. Moreover, the model trained by DRL cannot adapt to the complex and changeable assembly environment quickly owing to the weak generalization ability. Thus, the knowledge transfer framework is established for different robot peg-in-hole assemblies in this article to reinforce the generalization ability of the assembly model and the utilization efficiency of data. In the framework, the source domain model is trained through the proximal policy optimization (PPO) algorithm. The model accurately predicts environmental information and dynamically adjusts the robot’s movements based on the prediction. Combined with the PI controller, the flexible peg-in-hole assembly can be quickly achieved by the robot. The policy fusion between the source and target domain MDP is realized by the policy fusion transfer (PFT) algorithm designed in this article. The effectiveness of the algorithm is verified and discussed based on the transfer experiments, involving different assembly objects and different assembly environments. The training results demonstrate that the environment is explored by the PFT algorithm in a safe range at the initial stage of training by reusing the assembly policy of the source domain and that the faster model convergence speed is achieved. Furthermore, the testing results suggest that the assembly success rate is improved by 26% and the assembly force is reduced by 30 N. Moreover, the knowledge transfer between different peg-in-hole assemblies is realized successfully.

FORGE: Force-Guided Exploration for Robust Contact-Rich Manipulation under Uncertainty

Learning Active Force–Torque Based Policy for Sub-mm Localization of Unseen Holes

FoAR: Force-Aware Reactive Policy for Contact-Rich Robotic Manipulation

Just Add Force for Contact-Rich Robot Policies

Robust Pushing: Exploiting Quasi-static Belief Dynamics and Contact-informed Optimization

Feeling the Force: Integrating Force and Pose for Fluent Discovery Through Imitation Learning to Open Medicine Bottles.

AugInsert: Learning Robust Visual-Force Policies via Data Augmentation for Object Assembly Tasks

A2G: Leveraging Intuitive Physics for Force-Efficient Robotic Grasping

Leveraging Contact Forces for Learning to Grasp

Can't Touch This: Real-Time, Safe Motion Planning and Control for Manipulators Under Uncertainty

Policy Fusion Transfer: the Knowledge Transfer for Different Robot Peg-in-Hole Insertion Assemblies.

Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation

Admittance Visuomotor Policy Learning for General-Purpose Contact-Rich Manipulations

Sampling-based Exploration for Reinforcement Learning of Dexterous Manipulation

Robust Planning for Multi-stage Forceful Manipulation

Feedback Deep Deterministic Policy Gradient With Fuzzy Reward for Robotic Multiple Peg-in-Hole Assembly Tasks

Meta-Policy Learning over Plan Ensembles for Robust Articulated Object Manipulation

IndustReal: Transferring Contact-Rich Assembly Tasks from Simulation to Reality

Transferable Force-Torque Dynamics Model for Peg-in-hole Task.

Bridging the Sim-to-Real Gap with Dynamic Compliance Tuning for Industrial Insertion