Abstract:Nowadays the robot manipulation skills are usually learned by human demonstration via trajectory-level learning, which somewhat lacks robustness and generalization. In this paper, we propose a novel contact state level learning method for robot manipulation skill acquisition via human demonstration. The robot-environment contact states are described via environment dynamics modelling and geometric constraints modelling for flexible contact and rigid contact cases, respectively. During human demonstration process, the robot-environment interaction force, the robot position, and velocity data are collected. After that, the environment dynamics and geometric constraints modelling methods are presented to determine the contact state changes during the robot manipulation process. Then the robot manipulator learns the contact state information rather than specific manipulation trajectory. On this basis, the manipulation control law using active exploration method is presented to control the robot during the button pressing process and peg-hole-insertion process, respectively. Finally, the performance of the presented methodology has been verified via experimental studies. Note to Practitioners—Intelligent robots will become the right assistants of human beings in the future, especially in various areas of manipulation occasions. The important premise of realizing this vision is that the robots should have certain ability of manipulation skill learning. A lot of research has been carried out in this field, many of which are focusing on trajectory level manipulation skill learning and reproduction. Other than the trajectory level learning, human beings can learn many other higher levels of manipulation skills, such as the contact state level and semantic level learning, which makes the learning results more robust and general. In this paper, the contact state estimation and learning method via environment dynamics and geometric constraints modelling is presented to learn the robot manipulation skill based on the contact state transition conditions. In this way, the robot needs less data in the skill learning process, and the trajectory level learning is avoided. After learning the contact state level manipulation skill, the lower trajectory level command is autonomously generated. Experiments on button pressing and peg-hole-insertion tasks by KUKA iiwa robot have obtained very good results. Other than the button pressing and peg-hole-insertion tasks, the presented methodology can be applied to many other manipulation tasks, as long as there are contact state changes in the manipulation process. The work of this paper lays a foundation for the robot learning of higher-level manipulation skills.

Transferring Optimal Contact Skills to Flexible Manipulators by Reinforcement Learning

Dexterous Manoeuvre Through Touch in a Cluttered Scene

Towards Transferring Skills to Flexible Surgical Robots with Programming by Demonstration and Reinforcement Learning

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Reinforcement Learning Based Manipulation Skill Transferring for Robot-assisted Minimally Invasive Surgery.

A Contact-Safe Reinforcement Learning Framework for Contact-Rich Robot Manipulation

A Combined Learning and Optimization Framework to Transfer Human Whole-body Loco-manipulation Skills to Mobile Manipulators

Tactile Active Inference Reinforcement Learning for Efficient Robotic Manipulation Skill Acquisition

A Novel Contact State Estimation Method for Robot Manipulation Skill Learning Via Environment Dynamics and Constraints Modeling

Efficient Reinforcement Learning Method for Multi-Phase Robot Manipulation Skill Acquisition Via Human Knowledge, Model-Based, and Model-Free Methods

Efficient Sim-to-real Transfer of Contact-Rich Manipulation Skills with Online Admittance Residual Learning

A Physical Human-Robot Interaction Algorithm Based on Fuzzy Reinforcement Learning for Minimally Invasive Surgery Manipulator

Enhancing Task Performance of Learned Simplified Models via Reinforcement Learning

Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulation

Exploring CausalWorld: Enhancing robotic manipulation via knowledge transfer and curriculum learning

Moving Object Flexible Grasping Based on Deep Reinforcement Learning

Learning Cross-hand Policies for High-DOF Reaching and Grasping

Admittance Visuomotor Policy Learning for General-Purpose Contact-Rich Manipulations

A High-Efficient Reinforcement Learning Approach for Dexterous Manipulation

Reinforcement learning of shared control for dexterous telemanipulation: Application to a page turning skill

Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation