Abstract:Introduction:Behavioral Cloning (BC) is a common imitation learning method which utilizes neural networks to approximate the demonstration action samples for task manipulation skill learning. However, in the real world, the demonstration trajectories from human are often sparse and imperfect, which makes it challenging to comprehensively learn directly from the demonstration action samples. Therefore, in this paper, we proposes a streamlined imitation learning method under the terse geometric representation to take good advantage of the demonstration data, and then realize the manipulation skill learning of assembly tasks.Methods:We map the demonstration trajectories into the geometric feature space. Then we align the demonstration trajectories by Dynamic Time Warping (DTW) method to get the unified data sequence so we can segment them into several time stages. The Probability Movement Primitives (ProMPs) of the demonstration trajectories are then extracted, so we can generate a lot of task trajectories to be the global strategy action samples for training the neural networks. Notalby, we regard the current state of the assembly task as the via point of the ProMPs model to get the generated trajectories, while the time point of the via point is calculated according to the probability model of the different time stages. And we get the action of the current state according to the target position of the next time state. Finally, we train the neural network to obtain the global assembly strategy by Behavioral Cloning.Results:We applied the proposed method to the peg-in-hole assembly task in the simulation environment based on Pybullet + Gym to test its task skill learning performance. And the learned assembly strategy was also executed on a real robotic platform to verify the feasibility of the method further.Discussion:According to the result of the experiment, the proposed method achieves higher success rates compared to traditional imitation learning methods while exhibiting reasonable generalization capabilities. It shows that the ProMPs under geometric representation can help the BC method make better use of the demonstration trajectory and thus better learn the task skills.

Robotic Peg-in-hole Assembly Based on Generative Adversarial Imitation Learning with Hindsight Transformation

Learning-based Optimization Algorithms Combining Force Control Strategies for Peg-in-Hole Assembly.

Learning A Simulation-based Visual Policy for Real-world Peg in Unseen Holes.

Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes

Ensemble Bootstrapped Deep Deterministic Policy Gradient For Vision-Based Robotic Grasping

Imitation Learning Study for Robotic Peg-in-hole Assembly

Knowledge-Driven Deep Deterministic Policy Gradient for Robotic Multiple Peg-in-Hole Assembly Tasks

Multiple peg-in-hole compliant assembly based on a learning-accelerated deep deterministic policy gradient strategy

Vision-based robotic peg-in-hole research: integrating object recognition, positioning, and reinforcement learning

Goal-Aware Generative Adversarial Imitation Learning from Imperfect Demonstration for Robotic Cloth Manipulation

Feedback Deep Deterministic Policy Gradient With Fuzzy Reward for Robotic Multiple Peg-in-Hole Assembly Tasks

Variable Compliance Control for Robotic Peg-in-Hole Assembly: A Deep Reinforcement Learning Approach

Robotic Multiple Peg-in-Hole Assembly with Deviation Estimation and Fast Insertion Control

Peg-in-Hole Assembly With Dual-Arm Robot and Dexterous Robot Hands

Mastering Autonomous Assembly in Fusion Application with Learning-by-doing: a Peg-in-hole Study

Generative Adversarial Imitation Learning from Failed Experiences

Peg-in-hole Assembly Skill Imitation Learning Method Based on ProMPs under Task Geometric Representation.

Latent Policies for Adversarial Imitation Learning

Robotic peg-in-hole assembly based on reversible dynamic movement primitives and trajectory optimization

Hand-in-Hand Guidance: an Explore-Exploit Based Reinforcement Learning Method for Performance Driven Assembly-Adjustment

Quickly Inserting Pegs into Uncertain Holes using Multi-view Images and Deep Network Trained on Synthetic Data