Abstract:With sufficient practice, humans can grab objects they have never seen before through brain decision-making. However, the manipulators, which has a wide range of applications in industrial production, can still only grab specific objects. Because most of the grasp algorithms rely on prior knowledge such as hand-eye calibration results, object model features, and can only target specific types of objects. When the task scenario and the operation target change, it cannot perform effective redeployment. In order to solve the above problems, academia often uses reinforcement learning to train grasping algorithms. However, the method of reinforcement learning in the field of manipulators grasping mainly encounters these main problems: insufficient sample utilization, poor algorithm stability, and limited exploration. This article uses LfD, BC, and DDPG to improve sample utilization. Use multiple critics to integrate and evaluate input actions to solve the problem of algorithm instability. Finally, inspired by Thompson's sampling idea, the input action is evaluated from different angles, which increases the algorithm's exploration of the environment and reduces the number of interactions with the environment. EDDPG and EBDDPG algorithm is designed in the article. In order to further improve the generalization ability of the algorithm, this article does not use extra information that is difficult to obtain directly on the physical platform, such as the real coordinates of the target object and the continuous motion space at the end of the manipulator in the Cartesian coordinate system is used as the output of the decision. The simulation results show that, under the same number of interactions, the manipulators' success rate in grabbing 1000 random objects has increased more than double and reached state-of-the-art(SOTA) performance.

Learning Robotic Manipulation from Demonstrations by Combining Deep Generative Model and Dynamic Control System

Learning Robot Manipulation Skills from Human Demonstration Videos Using Two-Stream 2-D/3-D Residual Networks with Self-Attention

Human Demonstration Trajectory Refinement for Redundant Manipulators.

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

Ensemble Bootstrapped Deep Deterministic Policy Gradient For Vision-Based Robotic Grasping

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Learning Robotic Manipulation through Visual Planning and Acting

Biologically Inspired Motion Modeling and Neural Control for Robot Learning From Demonstrations

Learning and Inferring Movement with Deep Generative Model

Diff-LfD: Contact-aware Model-based Learning from Visual Demonstration for Robotic Manipulation Via Differentiable Physics-based Simulation and Rendering.

Vision-based Robot Manipulation Learning via Human Demonstrations

Learning From Human Demonstrations for Wheel Mobile Manipulator: An Unscented Model Predictive Control Approach

Learning Generalizable 3D Manipulation With 10 Demonstrations

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

DMotion: Robotic Visuomotor Control with Unsupervised Forward Model Learned from Videos

Cooperative Manipulation for a Mobile Dual-Arm Robot Using Sequences of Dynamic Movement Primitives

Learning Cooperative Dynamic Manipulation Skills from Human Demonstration Videos

Manipulate by Seeing: Creating Manipulation Controllers from Pre-Trained Representations

A Human–Robot Collaboration Method Using a Pose Estimation Network for Robot Learning of Assembly Manipulation Trajectories From Demonstration Videos

Vision-based reinforcement learning control of soft robot manipulators