Abstract:With sufficient practice, humans can grab objects they have never seen before through brain decision-making. However, the manipulators, which has a wide range of applications in industrial production, can still only grab specific objects. Because most of the grasp algorithms rely on prior knowledge such as hand-eye calibration results, object model features, and can only target specific types of objects. When the task scenario and the operation target change, it cannot perform effective redeployment. In order to solve the above problems, academia often uses reinforcement learning to train grasping algorithms. However, the method of reinforcement learning in the field of manipulators grasping mainly encounters these main problems: insufficient sample utilization, poor algorithm stability, and limited exploration. This article uses LfD, BC, and DDPG to improve sample utilization. Use multiple critics to integrate and evaluate input actions to solve the problem of algorithm instability. Finally, inspired by Thompson's sampling idea, the input action is evaluated from different angles, which increases the algorithm's exploration of the environment and reduces the number of interactions with the environment. EDDPG and EBDDPG algorithm is designed in the article. In order to further improve the generalization ability of the algorithm, this article does not use extra information that is difficult to obtain directly on the physical platform, such as the real coordinates of the target object and the continuous motion space at the end of the manipulator in the Cartesian coordinate system is used as the output of the decision. The simulation results show that, under the same number of interactions, the manipulators' success rate in grabbing 1000 random objects has increased more than double and reached state-of-the-art(SOTA) performance.

GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning Based on Online Grasping Pose Fusion

Ensemble Bootstrapped Deep Deterministic Policy Gradient For Vision-Based Robotic Grasping

Learning Object Affordance with Contact and Grasp Generation

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Active-Perceptive Motion Generation for Mobile Manipulation

Admittance Visuomotor Policy Learning for General-Purpose Contact-Rich Manipulations

GAM: General affordance-based manipulation for contact-rich object disentangling tasks

Moving Object Flexible Grasping Based on Deep Reinforcement Learning

A Multi-Agent Approach for Adaptive Finger Cooperation in Learning-based In-Hand Manipulation

DexTransfer: Real World Multi-fingered Dexterous Grasping with Minimal Human Demonstrations

Learning compliant grasping and manipulation by teleoperation with adaptive force control

GraspGF: Learning Score-based Grasping Primitive for Human-assisting Dexterous Grasping

Learning Cross-hand Policies for High-DOF Reaching and Grasping

Self-Supervised Learning of Grasping Arbitrary Objects On-the-Move

Grasp Stability Assessment Through Attention-Guided Cross-Modality Fusion and Transfer Learning

RGBManip: Monocular Image-based Robotic Manipulation through Active Object Pose Estimation

Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation

GAMMA: Generalizable Articulation Modeling and Manipulation for Articulated Objects

Learning Precise Affordances from Egocentric Videos for Robotic Manipulation

MOMA-Force: Visual-Force Imitation for Real-World Mobile Manipulation

A Grasp Pose is All You Need: Learning Multi-fingered Grasping with Deep Reinforcement Learning from Vision and Touch