Abstract:With sufficient practice, humans can grab objects they have never seen before through brain decision-making. However, the manipulators, which has a wide range of applications in industrial production, can still only grab specific objects. Because most of the grasp algorithms rely on prior knowledge such as hand-eye calibration results, object model features, and can only target specific types of objects. When the task scenario and the operation target change, it cannot perform effective redeployment. In order to solve the above problems, academia often uses reinforcement learning to train grasping algorithms. However, the method of reinforcement learning in the field of manipulators grasping mainly encounters these main problems: insufficient sample utilization, poor algorithm stability, and limited exploration. This article uses LfD, BC, and DDPG to improve sample utilization. Use multiple critics to integrate and evaluate input actions to solve the problem of algorithm instability. Finally, inspired by Thompson's sampling idea, the input action is evaluated from different angles, which increases the algorithm's exploration of the environment and reduces the number of interactions with the environment. EDDPG and EBDDPG algorithm is designed in the article. In order to further improve the generalization ability of the algorithm, this article does not use extra information that is difficult to obtain directly on the physical platform, such as the real coordinates of the target object and the continuous motion space at the end of the manipulator in the Cartesian coordinate system is used as the output of the decision. The simulation results show that, under the same number of interactions, the manipulators' success rate in grabbing 1000 random objects has increased more than double and reached state-of-the-art(SOTA) performance.

Collaborative Pushing and Grasping of Tightly Stacked Objects via Deep Reinforcement Learning

Synergistic Pushing and Grasping for Enhanced Robotic Manipulation Using Deep Reinforcement Learning

Ensemble Bootstrapped Deep Deterministic Policy Gradient For Vision-Based Robotic Grasping

Efficient-Learning Grasping and Pushing in Dense Stacking Via Mask Function and Pixel Overlap Rate

Grasp for Stacking Via Deep Reinforcement Learning

Reinforcement Learning Based Pushing and Grasping Objects from Ungraspable Poses

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Self-Supervised Learning for Joint Pushing and Grasping Policies in Highly Cluttered Environments

Grasp with Push Policy for Multi-Finger Dexterity Hand Based on Deep Reinforcement Learning☆

Position-aware pushing and grasping synergy with deep reinforcement learning in clutter

Efficient Stacking and Grasping in Unstructured Environments

Visual-Based Deep Reinforcement Learning for Robot Grasping with Pushing

Learning Separate Objects in Clutter with Deep Reinforcement Learning

Deep Reinforcement Learning for Robotic Pushing and Picking in Cluttered Environment

Learning Dual-Arm Push and Grasp Synergy in Dense Clutter

Learning Pushing Skills Using Object Detection and Deep Reinforcement Learning

A Graph-Based Deep Reinforcement Learning Approach to Grasping Fully Occluded Objects

A Deep Learning Approach to Grasping the Invisible

A pushing-grasping collaborative method based on deep Q-network algorithm in dual viewpoints

Robust Grasp Operation in Clutter for Multi-Objective Robotic Tasks Using Deep Reinforcement Learning

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach