Abstract:With sufficient practice, humans can grab objects they have never seen before through brain decision-making. However, the manipulators, which has a wide range of applications in industrial production, can still only grab specific objects. Because most of the grasp algorithms rely on prior knowledge such as hand-eye calibration results, object model features, and can only target specific types of objects. When the task scenario and the operation target change, it cannot perform effective redeployment. In order to solve the above problems, academia often uses reinforcement learning to train grasping algorithms. However, the method of reinforcement learning in the field of manipulators grasping mainly encounters these main problems: insufficient sample utilization, poor algorithm stability, and limited exploration. This article uses LfD, BC, and DDPG to improve sample utilization. Use multiple critics to integrate and evaluate input actions to solve the problem of algorithm instability. Finally, inspired by Thompson's sampling idea, the input action is evaluated from different angles, which increases the algorithm's exploration of the environment and reduces the number of interactions with the environment. EDDPG and EBDDPG algorithm is designed in the article. In order to further improve the generalization ability of the algorithm, this article does not use extra information that is difficult to obtain directly on the physical platform, such as the real coordinates of the target object and the continuous motion space at the end of the manipulator in the Cartesian coordinate system is used as the output of the decision. The simulation results show that, under the same number of interactions, the manipulators' success rate in grabbing 1000 random objects has increased more than double and reached state-of-the-art(SOTA) performance.

Trajectory-based Split Hindsight Reverse Curriculum Learning

Ensemble Bootstrapped Deep Deterministic Policy Gradient For Vision-Based Robotic Grasping

TendencyRL: Multi-stage Discriminative Hints for Efficient Goal-Oriented Reverse Curriculum Learning.

Improving reinforcement learning based moving object grasping with trajectory prediction

Model Based Reinforcement Learning for Robot Grasping Trajectory Generation.

Learning to Regrasp Using Visual–Tactile Representation-Based Reinforcement Learning

Learning Complicated Navigation Skills from Limited Experience Via Augmenting Offline Datasets

Solving Robotic Manipulation With Sparse Reward Reinforcement Learning Via Graph-Based Diversity and Proximity

From Temporal-Evolving to Spatial-Fixing: A Keypoints-Based Learning Paradigm for Visual Robotic Manipulation

Physics-Guided Hierarchical Reward Mechanism for Learning-Based Robotic Grasping

Trajectory Planning for Teleoperated Space Manipulators Using Deep Reinforcement Learning

Learning from Trajectories via Subgoal Discovery

Hindsight States: Blending Sim and Real Task Elements for Efficient Reinforcement Learning

Learning of Long-Horizon Sparse-Reward Robotic Manipulator Tasks With Base Controllers

Diversity-based Trajectory and Goal Selection with Hindsight Experience Replay

Quantile Regression Hindsight Experience Replay

Hierarchical Kernelized Movement Primitives for Learning Human-Robot Collaborative Trajectories in Referred Object Handover

Off-road Autonomous Vehicles Traversability Analysis and Trajectory Planning Based on Deep Inverse Reinforcement Learning

Exploration via Hindsight Goal Generation

Combining Hindsight with Goal-enhanced Prediction for Multi-goal Reinforcement Learning

Spatial Repetitive Learning Control for Trajectory Learning in Human-Robot Collaboration.